Indeed, in multiple LLM families, many of the neurons toward the very end of each processing step are dedicated to “suppression” of information about longer-horizon predictions. Seems like a huge…

Posters: davidad. davidad

2 likes recorded by the source corpus.