Can RTX Pro 6000 (Blackwell, 96 GB) run gpt-oss 120B?
Yes. Measured 196.31 tok/s generation (llama.cpp, MXFP4; source).
Every measured result for gpt-oss 120B on RTX Pro 6000 (Blackwell, 96 GB)
| Build | Quant / setup | Engine | tok/s | |
|---|---|---|---|---|
| RTX Pro 6000 96GB workstation card | MXFP4 | llama.cpp | 196.31 | source |
Memory: RTX Pro 6000 (Blackwell, 96 GB) has 96 GB. gpt-oss 120B weights are about 65 GB in its native format (OpenAI model card: 117B total, 5.1B active). Arithmetic, not a measurement; long contexts need more. Check other quants in the VRAM calculator.
Speeds are decode (generation) tokens/sec as reported by each source; quant, engine and context differ, so small gaps are noise.
All measured speeds for gpt-oss 120B: best home rig for gpt-oss 120B.
gpt-oss 120B on other hardware: Apple M2 Ultra
Other models measured on RTX Pro 6000 (Blackwell, 96 GB): gpt-oss 20B
Not enough VRAM? Rent before you buy. Run gpt-oss 120B on a bigger GPU on a rented 24–96 GB cloud GPU by the hour and see the real speed before spending €1,000+. Try it on RunPod
Referral link: RigBase may earn RunPod credit if you sign up. It never affects our data.
Referral link: RigBase may earn RunPod credit if you sign up. It never affects our data.
SPONSOR
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →