Post by Emad on X
Emad@EMostaque
XSimpler way to understand DeepSeek weren't lying about 50k H100s or training costs for V3/R1
We have the model, its a 35b active, 640b Mixture of Experts
We know that spec is 2-3m hours to train
Models get worse with more compute after a certain point! t.co

255 likes11 repliesPosted Jan 27, 2025