Builds / RTX A4000
RTX A4000 16GB (llm-speed signed run, Oct 2026): Muse Glimmer 30B UD-IQ3_XXS at 21.4 tok/s
Source: llm-speed.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- RTX A4000
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 16
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- llm-speed suite-v1 chat-short workload, 16K context
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Muse Glimmer 30B | UD-IQ3_XXS | llama.cpp 0.7.0-dev (build 11803) | 21.42 |
Signed run on llm-speed.com, 22 Oct 2026. chat-long decode 20.82 tok/s (prefill 687 tok/s); agent-trace 20.08 tok/s. For comparison, an RTX 4090 ran UD-Q4_K_XL at 53.70 tok/s chat-short (https://llm-speed.com/r/r_21z5pn8262x).
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× RTX A4000: ≈€1,050 each (≈$1,177), new, approx. price as of 2026-10-24, lowest listing on billiger.de (PNY RTX A4000 16 GB GDDR6 VCNRTXA4000-PB)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://llm-speed.com/r/r_y9y09s77lfa
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX A4000 run Muse Glimmer 30B?