Best home rig for DeepSeek R1 671B
Will it fit my GPU? Best value GPU per euro →
Real, measured generation speeds for DeepSeek R1 671B on home hardware, fastest first. Different quants/engines aren't directly comparable.
| Build | Quant | Engine | tok/s | Cost | |
|---|---|---|---|---|---|
| Mac Studio M3 Ultra 512GB (Geerling test) | llama.cpp | 19.89 | source | ||
| Mac Studio M3 Ultra, 512 GB | Q4 | MLX | 18.43 | source ⚠ unchecked | |
| EPYC + single RTX 3090 (hybrid) | Q2_K | llama.cpp CUDA | 8.97 | source ⚠ unchecked | |
| $2K EPYC 64-core, 512 GB DDR4, CPU-only | Q4 | llama.cpp (bare metal Ubuntu 24) | 4.31 | $2,000 (≈€1,784) | source |
| AmpereOne A192-32X 512GB (CPU only) | llama.cpp | 4.18 | source |
SPONSOR
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod
FAQ
How much VRAM does DeepSeek R1 671B need?
The weights are about 410.5 GB at Q4_K_M (671B params × 4.89 bits ÷ 8, before context/KV cache). Add memory for context (KV cache) and the runtime. The smallest-memory setup with a measured result here, fully in memory, is Apple M3 Ultra (512 GB) at 19.89 tok/s.
What is the fastest measured hardware for DeepSeek R1 671B?
Apple M3 Ultra: 19.89 tok/s generation (llama.cpp), from https://github.com/geerlingguy/ai-benchmarks/issues/42.
Which GPUs have measured results for DeepSeek R1 671B?
Apple M3 Ultra, RTX 3090.
Can it run on… Apple M3 Ultra · RTX 3090
Related: what GPU do you need for 2026 models · all builds