Post by François Fleuret on X
François Fleuret@francoisfleuret
XThis being said, here is the TL;DR:
On the model architecture side, @deepseek_ai v3/r1 is a standard GPT that is a "causal decoder only", hence an auto-regressive models made of causal attention blocks. It is huge, with 671 billion parameters.
1/6
834 likes7 repliesPosted Jan 24, 2025