Builds / 2x RTX 3060
2x RTX 3060 12GB (24 GB): Qwen3.8 27B Q4_K_M at 18.1 tok/s, ~950 tok/s prefill on a 9.5K prompt (llama.cpp CUDA)
Last updated:
- GPU(s)
- 2x RTX 3060
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 24
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- llama.cpp CUDA build (commit 19ff817 of 27 Oct 2026, then master 8ca4060 of 28 Oct 2026); all layers across both cards (--n-gpu-layers 999); ~20.6 GB VRAM used
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Prompt processing (tok/s) | Details |
|---|---|---|---|---|---|
| Qwen3.8 27B | Q4_K_M (GGUF) | llama.cpp (CUDA, 2 GPUs) | 18.1 | 949 @ 9.5K-token prompt est. TTFT @8k ≈ 8.6 s (calculated from measured prefill) | context: short prompt (~20 tokens) for decode; 9,451-token prompt for prefill📏 Forum post by @techman: three decode runs on the new build gave 17.9 / 18.1 / 18.1 tok/s (17.9 on the older build 0005475); cold prefill of a 9,451-token prompt 949-953 tok/s on the new build (759-797 on the old one); a warm prompt-cache hit returned in 177 ms; measured 28 Oct 2026 |
Prompt processing = prefill speed (how fast the prompt is read) as reported by the source, with the prompt length it was measured at; blank = the source does not report it. est. TTFT @8k is calculated from the measured prefill speed (8,192 ÷ prefill tok/s), shown only when prefill was measured on a prompt of 512+ tokens. It is not a measurement and ignores load time and caching. measured TTFT is the source's own time-to-first-token. Why prefill matters for coding assistants.
Homelab Brisbane community forum thread, posted 28 Oct 2026. The same rig also ran Qwen3.8 Flash-Next (a ~76 GB file, mostly offloaded to system RAM) at 21.0 tok/s with an expert cache and 13.0 without, prefill ~150 tok/s, but the post does not state that quant, so it is not listed. CPU, motherboard, system RAM and PSU are not given in the post.
- 2× RTX 3060: ≈€429 each (≈$481), new, approx. price as of 2026-10-16, lowest listing on billiger.de (Asus GeForce RTX 3060 V2 Dual 12 GB GDDR6)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Quick answers: Can 2x RTX 3060 12GB run Qwen3.8 27B?