feels like llm text tokens are still too short. a single token can represent an entire 14x14x3 image patch... or the word "dog" probably why everyone is moving to larger vocabularies rn (e.g. gpt4…

Posters: voooooogel. voooooogel

3 likes recorded by the source corpus.

Topics: AI & LLMs

View Post: https://x.com/voooooogel/status/1790838027973218662