Shital Shah@sytelusIf you were to train GPT-4, 1.8T params model, On A100, it will take 25k A100s and take 3-5 months. On H100, it will take 8k GPUs and take ~3 months. On B100, it will take 2k GPUs and take ~ 3 months. - Jenson at GTC.Opens with direct address
Shital Shah@sytelusWe have been completely amazed by the response to phi-4 release. A lot of folks had been asking us for weight release. Few even uploaded bootlegged phi-4 weights on HuggingFace😬. Well, wait no more. We are releasing today official phi-4 model on HuggingFace! With MIT licence!!Opens with an observation