Post by Alex Cheema on X
Alex Cheema@alexocheema
XI will run Deepseek-V3-Base 685B on M4 Mac Minis or die trying.
685B MoE with 256 experts -- perfect for Apple Silicon since they have a lot of GPU memory and only a small subset of params are active at once.
Outperforms SOTA closed-source models on benchmarks including Aider.

4.4K likes100 repliesPosted Dec 26, 2024