Builds / RTX 4090 24GB
RTX 4090: Qwen3.8 27B Q4_K_M at 43.1 tok/s (llm-speed, llama.cpp b11803, 6 runs)
Last updated:
- GPU(s)
- RTX 4090 24GB
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 24
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- not stated
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Prompt processing (tok/s) | Details |
|---|---|---|---|---|---|
| Qwen3.8 27B | Q4_K_M | llama.cpp build 11803 (a37cc4610) | 43.1 | 515 @ 154-token prompt measured TTFT: 0.30 s @ 154-token prompt | context: 8K ctx, chat-short (154-token prompt)📏 Lowest of 6 llm-speed runs on 22 Oct 2026 (43.1-44.2); peak VRAM 18.7 GiB at 8K |
| Qwen3.8 27B | Q4_K_M | llama.cpp build 11803 (a37cc4610) | 43.0 | 2,015 @ 3,224-token prompt est. TTFT @8k ≈ 4.1 s (calculated from measured prefill) prefill source: llm-speed.com ↗ measured TTFT: 1.6 s @ 3,224-token prompt | context: chat-long (3,224-token prompt, 1,024 out)📏 Lowest chat-long run listed (43.0-43.7) |
Prompt processing = prefill speed (how fast the prompt is read) as reported by the source, with the prompt length it was measured at; blank = the source does not report it. est. TTFT @8k is calculated from the measured prefill speed (8,192 ÷ prefill tok/s), shown only when prefill was measured on a prompt of 512+ tokens. It is not a measurement and ignores load time and caching. measured TTFT is the source's own time-to-first-token. Why prefill matters for coding assistants.
Measured by llm-speed on its own RTX 4090, 22 Oct 2026. Rest of the system not stated.
- 1× RTX 4090: ≈€3,955 each (≈$4,433), new, approx. price as of 2026-10-16, lowest listing on billiger.de (ASUS TUF Gaming RTX 4090 OG OC 24 GB)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
https://llm-speed.com/r/r_tt9io-8lu9p
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Quick answers: Can RTX 4090 run Qwen3.8 27B?