@wordgrammer Policy entropy isn't the loss it's the extent to which the policy is concentrated in certain tokens or not. A uniform distribution over tokens would be max policy entropy.

Posters: jd_pressman. jd_pressman

3 likes recorded by the source corpus.