Builds / RTX 5090
RTX 5090 running Gemma 4 31B Q4_K_M (llama-bench)
Source: localllmadvisor.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- RTX 5090
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 32
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- not stated
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Gemma 4 31B | Q4_K_M | llama.cpp b11658 (llama-bench) | 71.3 | prefill 3,841 tok/s📏 llama-bench tg128 / pp512; 64.6 tok/s at 16K depth |
localllmadvisor llama-bench page. Rest of the system not stated.
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× RTX 5090: ≈€7,140 each (≈$8,003), new, approx. price as of 2026-10-24, lowest listing on billiger.de (MSI GeForce RTX 5090 (lowest variant))
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://localllmadvisor.com/can-run/gemma-4-31b-on-rtx-5090-32gb.html
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 5090 run Gemma 4 31B?