This is exactly what’s wrong with the current RLHF / finetuning / constitutional approach to “alignment”. Ultimately they’re all just weight updates, there is no underlying reason the system should…

Posters: eshear. eshear

6 likes recorded by the source corpus.