Can 2x RTX 3090 run Qwen3.6 35B-A3B?

Q: Can 2x RTX 3090 run Qwen3.6 35B-A3B?

Yes. Measured 225-231 tok/s generation on 2x RTX 3090, via vLLM, AWQ-INT4 + MTP-3 (TP=2). Source: https://github.com/tfriedel/qwen3.6-rtx3090-lab

Yes. Measured 225-231 tok/s generation (vLLM, AWQ-INT4 + MTP-3 (TP=2); source).

Every measured result for Qwen3.6 35B-A3B on 2x RTX 3090

Build	Quant / setup	Engine	tok/s
4x RTX 3090 lab: Qwen3.6 on vLLM vs llama.cpp	AWQ-INT4 + MTP-3 (TP=2)	vLLM	225-231	source
4x RTX 3090 lab: Qwen3.6 on vLLM vs llama.cpp	AWQ-INT4 (TP=2)	vLLM	149	source

Memory: 2x RTX 3090 has 48 GB. Qwen3.6 35B-A3B weights are about 21.7 GB at Q4_K_M (35.51B params × 4.89 bits ÷ 8, before context/KV cache). Arithmetic, not a measurement; long contexts need more. Check other quants in the VRAM calculator.

Speeds are decode (generation) tokens/sec as reported by each source; quant, engine and context differ, so small gaps are noise.

All measured speeds for Qwen3.6 35B-A3B: best home rig for Qwen3.6 35B-A3B.

Qwen3.6 35B-A3B on other hardware: RTX 3090 · RTX 5090 · RTX Spark N1X

Not enough VRAM? Rent before you buy. Run Qwen3.6 35B-A3B on a bigger GPU on a rented 24–96 GB cloud GPU by the hour and see the real speed before spending €1,000+. Try it on RunPod
Referral link: RigBase may earn RunPod credit if you sign up. It never affects our data.

SPONSOR
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →