If this is unfathomable to you I suggest spending a few sessions with a language model that's been mangled by bad RLHF. Humans are trained with RLHF and the mode collapse failure modes you observe…

Posters: jd_pressman. jd_pressman

3 likes recorded by the source corpus.