Builds / AMD Radeon AI Pro R9700 (1 of 2 cards in the rig used)
Radeon AI Pro R9700: Qwen3.8 27B on llama.cpp, Ollama and vLLM (Vadi Taslim)
Source: vaditaslim.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- AMD Radeon AI Pro R9700 (1 of 2 cards in the rig used)
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 32
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- ROCm 7.x; GPU P2P broken, so every run used one GPU
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Qwen3.8 27B | Q4_K_M + MTP speculative decoding, reasoning on | llama.cpp Vulkan | 57 | ⚡ spec-decode (MTP) |
| Qwen3.8 27B | Q4_K_M | Ollama | 30 | |
| Qwen3.8 27B | AWQ INT4, single request | vLLM (radiance) | 22 |
Blog post of 17 Aug 2026. 'Raw' generation speed including hidden reasoning tokens; the author measured about half of that as visible answer text (29 tok/s on llama.cpp). vLLM radiance reached 55 tok/s total at 4 concurrent requests.
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× Radeon AI Pro R9700: ≈€1,848 each (≈$2,071), new, approx. price as of 2026-10-24, lowest listing on billiger.de (PowerColor Radeon AI PRO R9700 32 GB GDDR6)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://www.vaditaslim.com/blog/ai/qwen3.8-27b-two-rigs
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can Radeon AI Pro R9700 run Qwen3.8 27B?