@nosilverv If you RLHF an AI to wipe out a behavior w “punishment”, then tell it “no it’s ok, in this new situation I won’t punish you” the behavior doesn’t change.

Posters: eshear. eshear

4 likes recorded by the source corpus.