It may be that the order of learning matters and even though I believe pretraining datasets are still generally randomized having too much junk may cause "bad" abstractions to form early then path…
Posters: repligate. repligate
2 likes recorded by the source corpus.
Topics: Learning
View Post: https://x.com/repligate/status/1848936313342361701