Builds / RTX 3090
RTX 3090 (llm-speed signed run, Oct 2026): Flint 40B-A2.5B Q3_K_XL at 128.9 tok/s
Source: llm-speed.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- RTX 3090
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 24
- CPU
- AMD EPYC 7763 (64 cores)
Amazon · eBay (used) · Newegg - Motherboard
- not stated
- RAM
- 1008 GB
Amazon · eBay (used) · Newegg - PSU
- not stated
- Other
- Server host; llm-speed suite-v1 chat-short workload
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Flint 40B-A2.5B | UD-Q3_K_XL | llama.cpp 0.7.0-dev (build 11803) | 128.9 |
Signed community run on llm-speed.com, 22 Oct 2026, 16K context. chat-long (4K prompt) decode: 123.0 tok/s. An 8K-context run on the same host: 130.8 tok/s (https://llm-speed.com/r/r_-yeg4qnhjp7).
Source: https://llm-speed.com/r/r_v-sdiljpm7i
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 3090 run Flint 40B-A2.5B?