Can RTX Pro 6000 (Blackwell, 96 GB) run gpt-oss 20B?

Q: Can RTX Pro 6000 (Blackwell, 96 GB) run gpt-oss 20B?

Yes. Measured 286.91 tok/s generation on RTX Pro 6000 (Blackwell, 96 GB), via llama.cpp, MXFP4. Source: https://github.com/ggml-org/llama.cpp/discussions/15396

Yes. Measured 286.91 tok/s generation (llama.cpp, MXFP4; source).

Every measured result for gpt-oss 20B on RTX Pro 6000 (Blackwell, 96 GB)

Build	Quant / setup	Engine	tok/s
RTX Pro 6000 96GB workstation card	MXFP4	llama.cpp	286.91	source

Memory: RTX Pro 6000 (Blackwell, 96 GB) has 96 GB. gpt-oss 20B weights are about 13 GB in its native format (GGUF param count via llamabench.ai (OpenAI model card: 21B total, 3.6B active)). Arithmetic, not a measurement; long contexts need more. Check other quants in the VRAM calculator.

Speeds are decode (generation) tokens/sec as reported by each source; quant, engine and context differ, so small gaps are noise.

All measured speeds for gpt-oss 20B: best home rig for gpt-oss 20B.

gpt-oss 20B on other hardware: Apple M1 Max · Apple M1 Ultra · Apple M2 Ultra · Apple M3 Ultra · Apple M4 Max · DGX Spark (GB10) · RTX 3060 12GB · RTX 3090 · RTX 4070 Ti · RTX 4090 · RTX 5060 Ti 16GB · RTX 5070 Ti · RTX 5080 · RTX 5090 · RTX A4000 · RTX Spark N1X · Radeon AI Pro R9700

Other models measured on RTX Pro 6000 (Blackwell, 96 GB): gpt-oss 120B

Not enough VRAM? Rent before you buy. Run gpt-oss 20B on a bigger GPU on a rented 24–96 GB cloud GPU by the hour and see the real speed before spending €1,000+. Try it on RunPod
Referral link: RigBase may earn RunPod credit if you sign up. It never affects our data.

SPONSOR
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →