@Mihoda @kalomaze layer looping is running the same layers multiple times for each token, instead of serially once like in a regular transformer. it's just a way to spend more compute per token for…

Posters: voooooogel. voooooogel

3 likes recorded by the source corpus.