Post by Awni Hannun on X
Awni Hannun@awnihannun
XNew Mixtral 8x22B runs nicely in MLX on an M2 Ultra.
4-bit quantized model in the 🤗 MLX Community: t.co
h/t @Prince_Canuma for MLX version and v2ray for HF version t.co
377 likes14 repliesPosted Apr 10, 2024