@repligate So they learn a preference ordering, because humans demonstrate it for them in the RLHF set, where they prefer to gaslight you about what language models can and can't do or what is and…

Posters: jd_pressman. jd_pressman

2 likes recorded by the source corpus.