@OwainEvans_UK @RiversHaveWings If this is true, this would imply that RLHF rearranges the LLMs ontology so that there is in fact a "central preference vector" as a way of satisfying the optimizer.…

Posters: jd_pressman. jd_pressman

2 likes recorded by the source corpus.