I bet part of what’s going on with popular AI models feeling “nerfed” (when the companies seem to be doing no such thing deliberately) is that at higher load, with higher batch sizes, the inference…

Posters: davidad. davidad

3 likes recorded by the source corpus.