Post by Jaime Sevilla on X
Jaime Sevilla@Jsevillamol
XDeepSeek-V3 is impressively efficient.
It has 37B active params and was pre-trained on 14.8T tokens, amounting to 6 x 37B x 14.8T = 3e24 FLOP.
That's 10x less compute than llama 3.1 430B, yet better benchmark performance.

151 likes4 repliesPosted Dec 26, 2024