If you care about generalization to unseen data, throw an exponential moving average in your gradient descent. You’ll converge 3× slower—but grok 50× faster. https://t.co/BhAbJTiQBm
Posters: davidad. davidad
6 likes recorded by the source corpus.
Topics: Math