Post by Bob McGrew on X
Bob McGrew@bobmcgrewai
XThat o1 is better than GPT-4.5 on most problems tells us that pre-training isn't the optimal place to spend compute in 2025. There's a lot of low-hanging fruit in reasoning still.
But pre-training isn't dead, it's just waiting for reasoning to catch up to log-linear returns.
749 likes35 repliesPosted Feb 27, 2025