Doesn't it make sense to monitor phase changes in metrics like the loss, etc. ? stumbling across generalizable abilities (e.g. when a model groks, forms induction heads, etc.) sometimes results in…
Posters: anthrupad. anthrupad
3 likes recorded by the source corpus.
View Post: https://x.com/anthrupad/status/1651352238747525120