Builds / RTX 5090
RTX 5090: Nemotron 3.5 Bolt (IQ2) and Qwen3.8 27B
Source: llm-speed.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- RTX 5090
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 32
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- not stated
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Nemotron 3.5 Bolt 74B-A9B | NVIDIA mixed 2-bit IQ2 GGUF (22.0 GB) | llama.cpp build 11669 | 154.7 | prefill 2,623.3 tok/s📏 Measured decode, llm-speed run |
| Qwen3.8 27B | Q4_K_M | llama.cpp | 75.19 | 📏 Comparison run in the same llm-speed post |
Published 2026-10-16 by llm-speed. Rest of the system not stated.
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× RTX 5090: ≈€7,140 each (≈$8,003), new, approx. price as of 2026-10-24, lowest listing on billiger.de (MSI GeForce RTX 5090 (lowest variant))
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://llm-speed.com/blog/nemotron-3-5-bolt-74b-24gb-measured
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 5090 run Nemotron 3.5 Bolt 74B-A9B? · Can RTX 5090 run Qwen3.8 27B?