Doesn't it make sense to monitor phase changes in metrics like the loss, etc. ? stumbling across generalizable abilities (e.g. when a model groks, forms induction heads, etc.) sometimes results in…

Posters: anthrupad. anthrupad

3 likes recorded by the source corpus.

Topics: Software, AI & LLMs

View Post: https://x.com/anthrupad/status/1651352238747525120