New quantization technique (tl;dr leave 1% of oft-activated weights unquantized) shows decent performance at...INT2 (!!!). Still not great, but I'm curious how it would be competitive w/ a…

Posters: georgejrjrjr. georgejrjrjr

2 likes recorded by the source corpus.

Topics: Art

View Post: https://x.com/georgejrjrjr/status/1666072809360048129