Claude Shannon did not *merely* invent relative entropy in the 1940s— by 1951 he got all the way up to the idea of an autoregressive language model for English, and very nearly the encoder–decoder…
Posters: davidad. davidad
15 likes recorded by the source corpus.