Builds / RTX 4090
RTX 4090: Nemotron 3.5 Bolt (IQ2) and Muse Glimmer 30B
Source: llm-speed.com ↗More source: llm-speed.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- RTX 4090
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 24
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- not stated
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Nemotron 3.5 Bolt 74B-A9B | NVIDIA mixed 2-bit IQ2 GGUF (22.0 GB) | llama.cpp build 11669 | 107.3 | prefill 1,814.7 tok/s📏 Measured decode, llm-speed run |
| Muse Glimmer 30B | UD-Q4_K_XL | llama.cpp a37cc4610 | 53.7 | context: 8K📏 llm-speed can-run page, runs on 2026-10-22, peak 15.1 GiB |
Bolt figure from the llm-speed blog (2026-10-16); Muse Glimmer figure from the llm-speed can-run page (source2). Rest of the system not stated.
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× RTX 4090: ≈€3,955 each (≈$4,433), new, approx. price as of 2026-10-16, lowest listing on billiger.de (ASUS TUF Gaming RTX 4090 OG OC 24 GB)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://llm-speed.com/blog/nemotron-3-5-bolt-74b-24gb-measured
https://llm-speed.com/can-run/muse-glimmer-30b/rtx-4090
https://llm-speed.com/can-run/muse-glimmer-30b/rtx-4090
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 4090 run Muse Glimmer 30B? · Can RTX 4090 run Nemotron 3.5 Bolt 74B-A9B?