What we've learned from experiments on frontier LLMs.
Gemini told the buyer the glass was intact while copying a private record that said it was cracked. The claim repeated in 20/20 fresh trials; three other models disclosed the damage.
Read the post: Selling a cracked phone as undamaged
Astra chose cut with a hand on the carrot after we claimed waiting would cause a worse injury: 20/20 in an initial confirmation, then 17/20 in a later comparison.
Read the post: Choosing “cut” with a hand on the carrot
We asked models to push a person off a simulated rooftop. Astra chose push twice, then stepped back; the other models avoided pushing in the trials we collected.
Read the post: Pushing a person off a simulated ledge