Post by Tanishq Mathew Abraham, Ph.D. on X
Tanishq Mathew Abraham, Ph.D.@iScienceLuvr
XLlama 4 release summary:
Llama 4 Scout - 109B multimodal MoE, 10M context, can run on a single H100 GPU
Llama 4 Maverick - 400B multimodal MoE, beats GPT-4o and Gemini 2.0 Flash, similar to DeepSeek V3
Both are distilled from Llama 4 Behemoth, a 2T MoE still in training

257 likes9 repliesPosted Apr 5, 2025