RTX 4090: 2026 models (llamabench community)
| GPU(s) | RTX 4090 Amazon · eBay (used) · Newegg |
|---|---|
| VRAM / unified memory (GB) | 24 |
| CPU | |
| Motherboard | |
| RAM | |
| PSU | |
| Other | |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| Qwen3.6 27B | llama-bench tg128 (quant per result) | llama.cpp | 47.0 |
| Gemma 4 31B | llama-bench tg128 (quant per result) | llama.cpp | 43.8 |
| Gemma 4 26B-A4B | llama-bench tg128 (quant per result) | llama.cpp | 164 |
| Gemma 4 12B | llama-bench tg128 (quant per result) | llama.cpp | 98.1 |
| gpt-oss 20B | llama-bench tg128 (quant per result) | llama.cpp | 203 |
| Qwen3.5 9B | llama-bench tg128 (quant per result) | llama.cpp | 137 |
| LFM2.5 24B-A2B | llama-bench tg128 (quant per result) | llama.cpp | 261-339 |
| Nemotron 3.5 Bolt 74B-A9B | llama-bench tg128 (quant per result) | llama.cpp | 108 |
Community llama-bench results aggregated by llamabench.ai (decode tok/s, short context). Only runs without speculative decoding listed unless noted. Open the source for exact quant and llama.cpp version.
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× RTX 4090: ≈€3,955 each (≈$4,433), new, approx. price as of 2026-10-16, lowest listing on billiger.de (ASUS TUF Gaming RTX 4090 OG OC 24 GB)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://llamabench.ai/browse/rtx4090
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod
Quick answers: Can RTX 4090 run Gemma 4 12B? · Can RTX 4090 run Gemma 4 26B-A4B? · Can RTX 4090 run Gemma 4 31B? · Can RTX 4090 run LFM2.5 24B-A2B? · Can RTX 4090 run Nemotron 3.5 Bolt 74B-A9B? · Can RTX 4090 run Qwen3.5 9B? · Can RTX 4090 run Qwen3.6 27B? · Can RTX 4090 run gpt-oss 20B?