Will this stack of tricks be the correct tricks? Maybe there are even better tricks that only work on server -- MoE, fp8, long context -- such that local inference becomes nonviable. The question of…
Posters: cis_female. cis_female
2 likes recorded by the source corpus.
View Post: https://x.com/cis_female/status/1710623380985331954