Post by Dylan Patel on X
Dylan Patel@dylan522p
XDatabricks DBRX model is AMAZING, generally great but CRUSHES code.
132B parameters, 12T token, 16 experts, 4 per forward, 36B active.
~2.6e24
HumanEval5, 0-Shot
DBRX - 70.1%
GPT-4 - 67%
Gemini 1.5 Pro - 71.9%
Mixtral - 54.8%
Grok - 63.2%
LLAMA 2 - 32.2%
t.co
352 likes14 repliesPosted Mar 27, 2024