Best home rig for gpt-oss 120B
Will it fit my GPU? Best value GPU per euro →
Real, measured generation speeds for gpt-oss 120B on home hardware, fastest first. Different quants/engines aren't directly comparable.
| Build | Quant | Engine | tok/s | Cost | |
|---|---|---|---|---|---|
| RTX Pro 6000 96GB workstation card | MXFP4 | llama.cpp | 196.31 | source | |
| Mac Studio M2 Ultra 76-core GPU, 192 GB | MXFP4 | llama.cpp | 79.68 | source |
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →
FAQ
How much VRAM does gpt-oss 120B need?
The weights are about 65 GB in its native format (OpenAI model card: 117B total, 5.1B active). Add memory for context (KV cache) and the runtime. The smallest-memory setup with a measured result here, fully in memory, is RTX Pro 6000 (Blackwell, 96 GB) (96 GB) at 196.31 tok/s.
What is the fastest measured hardware for gpt-oss 120B?
RTX Pro 6000 (Blackwell, 96 GB): 196.31 tok/s generation (llama.cpp, MXFP4), from https://github.com/ggml-org/llama.cpp/discussions/15396.
Which GPUs have measured results for gpt-oss 120B?
Apple M2 Ultra, RTX Pro 6000 (Blackwell, 96 GB).
Can it run on… Apple M2 Ultra · RTX Pro 6000 (Blackwell, 96 GB)
Related: what GPU do you need for 2026 models · all builds