@wordgrammer The loss measures the improbability of the token basically, but the policy entropy measures the extent to which the model has a coherent guess for what the next token is. The latter is…

Posters: jd_pressman. jd_pressman

2 likes recorded by the source corpus.