Post by Emad on X
Emad@EMostaque
XThe furore over DeepSeep R1 costing $5.5m buried the actual lede..
It didn’t.
That’s how much the base v3 model cost (GPT 4o level).
R1 likely cost O($100k), but the real buried lede is the distilled versions of Qwen & Llama which cost O($10k) to tune & can still improve..
655 likes16 repliesPosted Jan 25, 2025