Single RTX 3090: Qwen3.6 35B-A3B (Giles Thomas)
| GPU(s) | RTX 3090 Amazon · eBay (used) · Newegg |
|---|---|
| VRAM / unified memory (GB) | 24 |
| CPU | |
| Motherboard | |
| RAM | |
| PSU | |
| Other | |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| Qwen3.6 35B-A3B | Q4 GGUF, all layers on GPU, ~90K ctx | llama.cpp CUDA | 139.6 |
At full 262K context with 12 layers of FFNs offloaded to CPU: ~66 tok/s.
Source: https://www.gilesthomas.com/2026/07/benchmarking-qwen-3-6-35b-moe-rtx-3090
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod
Quick answers: Can RTX 3090 run Qwen3.6 35B-A3B?