deepseek v3 has 37b active params.they trained on 14.8 trillion tokens.flops estimate to train 37b params x 14.8T tokens is 3.3e24 flops, totally achievable with 2.8M H800 hours.for people who don't…
Posters: xlr8harder. xlr8harder
5 likes recorded by the source corpus.
Topics: AI & LLMs
View Post: https://x.com/xlr8harder/status/1882916046044279261