Builds / RTX 4090
RTX 4090 (llm-speed signed run, Oct 2026): Flint 40B-A2.5B at 169-179 tok/s on llama.cpp
Source: llm-speed.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- RTX 4090
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 24
- CPU
- AMD EPYC 7452 (32 cores)
Amazon · eBay (used) · Newegg - Motherboard
- not stated
- RAM
- 504 GB
Amazon · eBay (used) · Newegg - PSU
- not stated
- Other
- Server host; llm-speed suite-v1 chat-short workload
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Flint 40B-A2.5B | NVFP4 | llama.cpp 0.7.0-dev (build 11803) | 179.4 | |
| Flint 40B-A2.5B | UD-Q3_K_XL | llama.cpp 0.7.0-dev (build 11803) | 169.2 |
Signed community runs on llm-speed.com, 22 Oct 2026. NVFP4 run: https://llm-speed.com/r/r_0i0a9uq6fdx (chat-long 167.2 tok/s). Q3_K_XL run (16K context) chat-long: 157.8 tok/s.
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× RTX 4090: ≈€3,955 each (≈$4,433), new, approx. price as of 2026-10-16, lowest listing on billiger.de (ASUS TUF Gaming RTX 4090 OG OC 24 GB)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://llm-speed.com/r/r_sw92j6kg7js
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 4090 run Flint 40B-A2.5B?