More
Submit build

Builds / 2x AMD Radeon AI PRO R9700 32 GB

2x Radeon AI PRO R9700 32 GB (Threadripper PRO 5995WX): Qwen3.6 27B at 23.4 tok/s on llama.cpp Q4_K_M, 15.9 on stock vLLM FP8 TP=2, 62.75 with tuned vLLM + MTP (Puget Systems)

Last updated:

Source: pugetsystems.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
Legacy models only. Every model measured on this rig now has a newer successor: Qwen3.6 27B → Qwen3.8 27B, Qwen3.6 27B → Qwen3.8 27B, Qwen3.6 27B → Qwen3.8 27B, Qwen3.6 27B → Qwen3.8 27B. The hardware numbers are still a useful reference.
GPU(s)
2x AMD Radeon AI PRO R9700 32 GB
Amazon · eBay (used) · Newegg
VRAM / unified memory (GB)
64
CPU
AMD Ryzen Threadripper PRO 5995WX (64 cores)
Amazon · eBay (used) · Newegg
Motherboard
ASUS Pro WS WRX80E-SAGE SE
Amazon · eBay (used) · Newegg
RAM
128 GB
Amazon · eBay (used) · Newegg
PSU
not stated
Other
Puget Systems test workstation, bare-metal Rocky Linux 10.1, PCIe 5.0 x16 per card, containerized runtimes (Podman/Docker) with PCIe peer-to-peer
Reported total cost
not stated
Power
about 310-340 W for both cards at one user (measured from the amdgpu driver)

Measured speed (generation tokens/sec)

ModelQuantEnginetok/sPrompt processing (tok/s)Details
Qwen3.6 27B legacyQ4_K_M (GGUF)llama.cpp ROCm, layer split across both cards23.4not statedcontext: 500-token prompts📏 NVIDIA GenAI-Perf streaming, 500 input / 200 output tokens, 50 prompts, 3 warm-up requests discarded, concurrency 1; TTFT 382 ms, ITL 41.0 ms; 55.7 tok/s total at 4 users, 56.0 at 8
Qwen3.6 27B legacyFP8vLLM v0.20.2 ROCm (stock image), TP=215.88not statedcontext: 500-token prompts📏 NVIDIA GenAI-Perf streaming, 500 input / 200 output tokens, 50 prompts, 3 warm-up requests discarded, concurrency 1; TTFT 337 ms, ITL 61.6 ms; 69.3 tok/s total at 4 users, 156.2 at 8
Qwen3.6 27B legacyFP8vLLM tuned build (vllm-radiance), TP=232.0not statedcontext: 500-token prompts📏 NVIDIA GenAI-Perf streaming, 500 input / 200 output tokens, 50 prompts, 3 warm-up requests discarded, concurrency 1; TTFT 136 ms, ITL 30.7 ms; 110.6 tok/s total at 4 users, 198.8 at 8
Qwen3.6 27B legacyFP8vLLM tuned build (vllm-radiance), TP=2 + MTP62.75not stated⚡ spec-decode (MTP)context: 500-token prompts📏 NVIDIA GenAI-Perf streaming, 500 input / 200 output tokens, 50 prompts, 3 warm-up requests discarded, concurrency 1; TTFT 184 ms, ITL 15.1 ms; 186.3 tok/s total at 4 users, 320.2 at 8; Puget reports bit-identical output to plain decode

Vendor-lab test by Puget Systems (posted 18 Aug 2026, last updated 10 Sep 2026 after a bare-metal re-test: an earlier claim that stock vLLM multi-GPU fails on RDNA 4 came from their KVM/VFIO passthrough setup and was withdrawn). Throughput is the GenAI-Perf generation rate for one user. GPU power for both cards: 310 W (stock vLLM), 312 W (tuned), 315 W (tuned + MTP), 339 W (llama.cpp). The article's single-card FP16 results are a separate RigBase build.

Current GPU street price (estimate, not the builder's cost)Estimated GPU cost for this build today: ≈€3,696
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://www.pugetsystems.com/labs/articles/amd-radeon-ai-pro-r9700-dual-gpu-ai-inference-performance/

Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.

Embed this result

Copy into a README or blog. Links back to this build. See badge docs (CC BY 4.0 attribution). The SVG does not invent speeds — numbers stay on the build page.

Markdown

[![Measured on RigBase](https://getrigbase.com/badge/2x-radeon-ai-pro-r9700-threadripper-pro-5995wx-qwen36-27b-vllm-mtp-puget.svg)](https://getrigbase.com/builds/2x-radeon-ai-pro-r9700-threadripper-pro-5995wx-qwen36-27b-vllm-mtp-puget/)

HTML

<a href="https://getrigbase.com/builds/2x-radeon-ai-pro-r9700-threadripper-pro-5995wx-qwen36-27b-vllm-mtp-puget/" rel="noopener"><img src="https://getrigbase.com/badge/2x-radeon-ai-pro-r9700-threadripper-pro-5995wx-qwen36-27b-vllm-mtp-puget.svg" alt="Measured on RigBase" height="20"/></a>

Preview: Measured on RigBase · How to use

Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)

Quick answers: Can 2x Radeon AI Pro R9700 run Qwen3.6 27B?

Speculative-decoding rows on this page are not like-for-like with plain decode. See how much MTP and DFlash really speed things up (measured pairs).