@ptrschmdtnlsn If the input data distribution is specified, then the minimum expected compressed size is indeed the Shannon entropy of the distribution.If it’s just an empirical distribution…

Posters: davidad. davidad

2 likes recorded by the source corpus.

Topics: Math, Software

View Post: https://x.com/davidad/status/1795505562756468999