@__drewface modern flashattn softmax implementations do use 2^x because there's 2^x hardware in gpus https://t.co/uzgOrt9ZQQ https://t.co/Gp35QDWYFD

Posters: cis_female. cis_female

3 likes recorded by the source corpus.