I suspect this sort of failure is caused by RL-like techniques where successful traces get trained with positive gradients (and unsuccessful traces get trained with negative gradients), and somehow…

Posters: davidad. davidad

3 likes recorded by the source corpus.

Topics: AI & LLMs, AI safety

View Post: https://x.com/davidad/status/2001655778730508299