Post by Jeremy Howard on X
Jeremy Howard@jeremyphoward
X# The *actual* LLM scaling law.
Adding more compute and data to LLMs makes them:
- Linearly more expensive, and
- Logarithmically more useful.
Therefore:
- Scaling becomes less useful the more you do it (once you reach a point where cost is non-trivial).
1.1K likes65 repliesPosted Feb 27, 2025