Will this stack of tricks be the correct tricks? Maybe there are even better tricks that only work on server -- MoE, fp8, long context -- such that local inference becomes nonviable. The question of…

Posters: cis_female. cis_female

2 likes recorded by the source corpus.

Topics: Software, AI & LLMs

View Post: https://x.com/cis_female/status/1710623380985331954