$2K EPYC 64-core, 512 GB DDR4, CPU-only
| GPU(s) | None (CPU inference) |
|---|---|
| VRAM / unified memory (GB) | 0 |
| CPU | AMD EPYC 64-core (7702 / 7C13 / 7V13) Amazon · eBay (used) · Newegg |
| Motherboard | Gigabyte MZ32-AR0 Amazon · eBay (used) · Newegg |
| RAM | 512 GB DDR4 Amazon · eBay (used) · Newegg |
| PSU | 850W Amazon · eBay (used) · Newegg |
| Other | Samsung 980 Pro 1TB, rack frame, Corsair H170i cooler |
| Reported total cost | $2,000 (≈€1,784) |
| Power |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| DeepSeek R1 671B | Q4 | llama.cpp (bare metal Ubuntu 24) | 4.31 |
Source: https://www.youtube.com/watch?v=Tq_cmN4j2yY
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod