here's the transformer implementation: https://t.co/bkCnSz8s38 here's the microcode for fp16 matmul (mlp_up, mlp_down, qkv, o) https://t.co/1ylFDIhdfQ here's the microcode for flashattn…
Posters: cis_female. cis_female
2 likes recorded by the source corpus.
Topics: Software
View Post: https://x.com/cis_female/status/1660386870386376704