this theory doesn't make much sense to me, yet keeps getting repeated. 1. it has nothing to do with next token prediction - if you don't predict the teacher forced tokens in pretraining, you're just…

Posters: voooooogel. voooooogel

2 likes recorded by the source corpus.