@connormcmk @eshear like how a base model LLM is just trying to predict the next token, whereas an RLHF’d (or DPO’d or ORPO’d etc) model is trying to predict the next token but ALSO have it be a…
Posters: davidad. davidad
2 likes recorded by the source corpus.
Topics: Group dynamics