Builds / 2x AMD Radeon AI PRO R9700 32 GB
2x Radeon AI PRO R9700 32 GB, vLLM with custom RDNA4 FP8 kernels: Qwen3.6 27B FP8 at 26.5 tok/s single stream, 55.3 with MTP (k=3)
Last updated:
- GPU(s)
- 2x AMD Radeon AI PRO R9700 32 GB
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 64
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- ROCm 7.2, vLLM fork mininmaxim/vllm branch esdmax-r9700-fp8 (ESDMAX FP8 GEMM kernels for gfx1201), tensor parallel across both cards, max-model-len 262,144
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Prompt processing (tok/s) | Details |
|---|---|---|---|---|---|
| Qwen3.6 27B legacy | FP8 (Qwen/Qwen3.6-27B-FP8) | vLLM fork esdmax-r9700-fp8, ROCm 7.2, TP=2 | 26.5 | 1,242 @ 570-token prompt est. TTFT @8k ≈ 6.6 s (calculated from measured prefill) | context: single stream📏 Single-stream decode after the kernel work (stock vLLM on the same box: 6-7 tok/s, FP8 silently fell back to FP32); author's bandwidth roofline 43.2; 570-token prompt prefill 1,242 tok/s |
| Qwen3.6 27B legacy | FP8 (Qwen/Qwen3.6-27B-FP8) | vLLM fork esdmax-r9700-fp8, ROCm 7.2, TP=2 + MTP k=3 | 55.3 | not stated | ⚡ spec-decode (MTP)context: single stream📏 qwen3_5_mtp speculative config, 3 speculative tokens, mean 2.94 accepted per step (k=1 44.4, k=2 51.9, k=4 57.3); temperature 0; 188 tok/s total at 8 concurrent requests |
Prompt processing = prefill speed (how fast the prompt is read) as reported by the source, with the prompt length it was measured at; blank = the source does not report it. est. TTFT @8k is calculated from the measured prefill speed (8,192 ÷ prefill tok/s), shown only when prefill was measured on a prompt of 512+ tokens. It is not a measurement and ignores load time and caching. measured TTFT is the source's own time-to-first-token. Why prefill matters for coding assistants.
Owner write-up in a public vLLM fork (committed 9 Jul 2026). CPU, RAM and board are not stated. The author's own llama.cpp Q8 run on the same box: 16 tok/s. Compare with Puget Systems' 2x R9700 build (stock vLLM FP8 15.88, tuned + MTP 62.75) - different builds and prompts.
- 2× Radeon AI Pro R9700: ≈€1,848 each (≈$2,071), new, approx. price as of 2026-10-24, lowest listing on billiger.de (PowerColor Radeon AI PRO R9700 32 GB GDDR6)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Quick answers: Can 2x Radeon AI Pro R9700 run Qwen3.6 27B?
Speculative-decoding rows on this page are not like-for-like with plain decode. See how much MTP and DFlash really speed things up (measured pairs).