Builds / RTX 5080 Laptop 16GB
RTX 5080 Laptop 16 GB + 32 GB RAM (LM Studio, MTP): Qwen3.6 35B-A3B at 102 tok/s @17k context after offload retune
Last updated:
Source: dev.to ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- RTX 5080 Laptop 16GB
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 16
- CPU
- not stated
- Motherboard
- gaming laptop
Amazon · eBay (used) · Newegg - RAM
- 32 GB
Amazon · eBay (used) · Newegg - PSU
- not stated
- Other
- LM Studio serving over the network; model 21.7 GB so experts partially in system RAM. After retune: GPU Offload max (all 40 layers on GPU), force MoE weights onto CPU for 40% of layers (~16), KV cache q8_0 (~14.5 GB VRAM in use). Speculative decoding (MTP) enabled via a separate load flag
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Prompt processing (tok/s) | Details |
|---|---|---|---|---|---|
| Qwen3.6 35B-A3B | 4-bit (LM Studio / MoE) | LM Studio (CUDA), MTP on | 102 | not stated | ⚡ spec-decode (MTP)context: ~17k tokens of agent context after retune📏 Author's before/after table: at 17k context, generation rose from 21 tok/s to 102 tok/s after the offload retune; at 42k from 9.5 to 94 tok/s. Short-context speed after retune was not re-measured (before retune: 54 tok/s short). MTP draft head on — without the flag the author says the model runs about twice as slow |
dev.to post of 4 Nov 2026. Laptop RTX 5080 (16 GB), not a desktop 5080. Headline is the 17k-context figure after the MoE/CPU-expert retune with MTP on; not comparable with short-context plain-decode rows. Agent quality scores from the same post are not tok/s and are omitted.
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× RTX 5080: ≈€1,770 each (≈$1,984), new, approx. price as of 2026-10-24, lowest listing on billiger.de (MSI GeForce RTX 5080 Inspire 3X OC Black 16 GB GDDR7)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://dev.to/ngirchev/can-local-llms-replace-opus-and-codex-i-tested-a-macbook-an-rtx-5080-a-dgx-spark-and-cheap-4hdb
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 5080 run Qwen3.6 35B-A3B?
Speculative-decoding rows on this page are not like-for-like with plain decode. See how much MTP and DFlash really speed things up (measured pairs).