Cody Blakeney@code_starIt’s finally here 🎉🥳 In case you missed us, MosaicML/ Databricks is back at it, with a new best in class open weight LLM named DBRX. An MoE with 132B total parameters and 32B active 32k context length and trained for 12T tokens 🤯Opens with an observation
Cody Blakeney@code_starThis is kind of insane. Seems like we have recursive self-improvement in the open source now. Impressive for _only_ 753B parameters. Congrats to the @Zai_org team!Opens with an observation