EPYC + single RTX 3090 (hybrid)
⚠ Source not independently checked. This build comes from a Reddit post we could not fetch to re-verify the numbers. Treat as reported, not confirmed.
| GPU(s) | RTX 3090 Amazon · eBay (used) · Newegg |
|---|---|
| VRAM / unified memory (GB) | 24 |
| CPU | AMD EPYC Amazon · eBay (used) · Newegg |
| Motherboard | |
| RAM | |
| PSU | |
| Other | llama-bench |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| DeepSeek R1 671B | Q2_K | llama.cpp CUDA | 8.97 |
Source: https://www.reddit.com/r/LocalLLaMA/comments/1j2c7b4/unsloth_ds_r1_222b_2_ts_on_dell_r730_cpu_help/
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod
Quick answers: Can RTX 3090 run DeepSeek R1 671B?