Can RTX 4060 Ti 16GB run Qwen3.8 27B?

Partly: part of the model runs from system RAM (CPU offload, per the source). Measured 10.7-17.6 tok/s generation with part of the model offloaded to system RAM (llama.cpp, llama-bench tg128 (quant per result); source).

Every measured result for Qwen3.8 27B on RTX 4060 Ti 16GB

Build	Quant / setup	Engine	tok/s
RTX 4060 Ti 16GB: 2026 models (llamabench community)	llama-bench tg128 (quant per result)	llama.cpp	10.7-17.6 CPU offload	source

Memory: RTX 4060 Ti 16GB has 16 GB. Qwen3.8 27B weights are about 16.5 GB at Q4_K_M (27B params × 4.89 bits ÷ 8, before context/KV cache). Arithmetic, not a measurement; long contexts need more. Check other quants in the VRAM calculator.

Speeds are decode (generation) tokens/sec as reported by each source; quant, engine and context differ, so small gaps are noise.

All measured speeds for Qwen3.8 27B: best home rig for Qwen3.8 27B.

Qwen3.8 27B on other hardware: 2x Apple M5 Ultra · 4x Apple M5 Ultra · Apple M3 Ultra · Apple M5 Ultra · RTX 3060 12GB · RTX 3090 · RTX Spark N1X

Other models measured on RTX 4060 Ti 16GB: LFM2.5 24B-A2B

Not enough VRAM? Rent before you buy. Run Qwen3.8 27B on a bigger GPU on a rented 24–96 GB cloud GPU by the hour and see the real speed before spending €1,000+. Try it on RunPod
Referral link: RigBase may earn RunPod credit if you sign up. It never affects our data.

SPONSOR
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →