EPYC 7F52 jank rig: 4x3090 + 4090 + 4080 (136 GB VRAM)
⚠ Source not independently checked. This build comes from a Reddit post we could not fetch to re-verify the numbers. Treat as reported, not confirmed.
| GPU(s) | 4x RTX 3090, RTX 4090, RTX 4080 Amazon · eBay (used) · Newegg |
|---|---|
| VRAM / unified memory (GB) | 136 |
| CPU | AMD EPYC 7F52 Amazon · eBay (used) · Newegg |
| Motherboard | ASRock Rack ROMED8-2T Amazon · eBay (used) · Newegg |
| RAM | 32 GB RDIMM 3200 Amazon · eBay (used) · Newegg |
| PSU | SuperFlower 1600W + 1200W server PSU Amazon · eBay (used) · Newegg |
| Other | WD Black 4TB NVMe |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| Llama 3.1 70B | Q8_0 | Oobabooga | 9 |
Source: https://www.reddit.com/r/LocalLLaMA/comments/1fqwler/show_me_your_ai_rig/
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod