@anthrupad @repligate @doomslide (that's not to say attention sinks are bad, they're useful, but i think if the excited tokens are sinks the way sonnet uses them is not necessarily ideal)

Posters: voooooogel. voooooogel

2 likes recorded by the source corpus.

Topics: Software, AI & LLMs

View Post: https://x.com/voooooogel/status/1859475031442718937