Best home rig for Mistral Small 22B
Older model. For current picks see 2025–2026 models.
Real, measured generation speeds for Mistral Small 22B on home hardware, fastest first. Different quants/engines aren't directly comparable.
| Build | Quant | Engine | tok/s | Cost | |
|---|---|---|---|---|---|
| RTX 4090 desktop (speed comparison vs Macs) | Q6_K | llama.cpp-based | 26.72 | source |
SPONSOR
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod
FAQ
What is the fastest measured hardware for Mistral Small 22B?
RTX 4090: 26.72 tok/s generation (llama.cpp-based, Q6_K), from https://www.someoddcodeguy.dev/low-context-speed-comparison-macbook-mac-studios-and-rtx-4090/.
Related: what GPU do you need for 2026 models · all builds