32 measured results from 9 builds, each linked to its source.
| Build | GPU(s) | Memory GB (total) | Results |
|---|
| Strix Halo + Radeon AI Pro R9700 over OCuLink: Qwen3.8 Flash-Next at ~102 tok/s (custom engine) | AMD Radeon AI Pro R9700 32 GB (OCuLink x4) + Ryzen AI Max+ 395 Radeon 8060S iGPU | 160 | 4 |
| Strix Halo (Corsair AI Workstation 300, 128 GB): ROCm vs Vulkan on Qwen3.8 27B and Qwen3.6 35B-A3B | AMD Ryzen AI Max+ 395 (Radeon 8060S iGPU) | 128 | 7 |
| Strix Halo (Ryzen AI Max+ 395, 128 GB): Qwen3.8 27B Q6_K, 9.6 to 18 tok/s with MTP | AMD Ryzen AI Max+ 395 (Radeon 8060S iGPU) | 128 | 3 |
| Minisforum MS-S1 MAX (Strix Halo, 128 GB): Qwen3.6 35B-A3B at 62 tok/s on llama.cpp Vulkan | AMD Ryzen AI Max+ 395 (Radeon 8060S iGPU) | 128 | 4 |
| HP ZBook Ultra G1a (Strix Halo laptop, 128 GB): Qwen3.6 35B-A3B at 59.4 tok/s, gpt-oss 120B at 44.7 | AMD Ryzen AI Max+ PRO 395 (Radeon 8060S iGPU, 32 GB dedicated) | 128 | 6 |
| Strix Halo mini PC (Ryzen AI Max+ 395, 128 GB): Qwen3.8 27B at 12.6 tok/s Q4_K_M, 7.7 Q8_0 | AMD Ryzen AI Max+ 395 (Radeon 8060S iGPU) | 128 | 2 |
| Strix Halo (Ryzen AI Max+ 395, 128 GB) running Kolibri-1 Q4_K_M | AMD Ryzen AI Max+ 395 (Radeon 8060S iGPU, gfx1151) | 128 | 1 |
| Strix Halo (Radeon 8060S, 96 GB): 2026 models (llamabench community) | AMD Ryzen AI Max+ (Radeon 8060S iGPU) | 96 | 1 |
| Framework Desktop (AMD Strix Halo) mainboard | AMD Ryzen AI Max+ 395 (Radeon 8060S iGPU; Ollama runs CPU only, llama.cpp runs on iGPU via Vulkan) | | 4 |
| Model | Build | Ran on | Quant | Engine | tok/s | Details |
|---|
| Gemma 4 26B-A4B | HP ZBook Ultra G1a (Strix Halo laptop, 128 GB): Qwen3.6 35B-A3B at 59.4 tok/s, gpt-oss 120B at 44.7 | Strix Halo (Radeon 8060S) | 4-bit | Ollama 0.34.0 | 51.8 | |
| Gemma 4 31B | HP ZBook Ultra G1a (Strix Halo laptop, 128 GB): Qwen3.6 35B-A3B at 59.4 tok/s, gpt-oss 120B at 44.7 | Strix Halo (Radeon 8060S) | 4-bit | Ollama 0.34.0 | 8.8 | |
| Kolibri-1 | Strix Halo (Ryzen AI Max+ 395, 128 GB) running Kolibri-1 Q4_K_M | Strix Halo (Radeon 8060S) | Q4_K_M (47.45 GB) | llama.cpp ROCm (Seraphiel102 fork 8798b65), -ngl 99, f16 KV | 58.6 | prefill 951 tok/scontext: 512 (30.5 tok/s at 131K; prefill measured at 32K)📏 C3MA AI_Benchmarks repository, commit 22c9f2dcf2 (2026-10-19) |
| Qwen3.6 35B-A3B | Minisforum MS-S1 MAX (Strix Halo, 128 GB): Qwen3.6 35B-A3B at 62 tok/s on llama.cpp Vulkan | Strix Halo (Radeon 8060S) | Q4_K_M (Unsloth) | llama.cpp Vulkan + MTP | 93 | ⚡ spec-decode (MTP) |
| Qwen3.6 35B-A3B | Minisforum MS-S1 MAX (Strix Halo, 128 GB): Qwen3.6 35B-A3B at 62 tok/s on llama.cpp Vulkan | Strix Halo (Radeon 8060S) | Q4_K_M (Unsloth) | llama.cpp Vulkan | 62 | |
| Qwen3.6 35B-A3B | Strix Halo (Corsair AI Workstation 300, 128 GB): ROCm vs Vulkan on Qwen3.8 27B and Qwen3.6 35B-A3B | Strix Halo (Radeon 8060S) | Q8_0 + MTP (draft-n-max 3), coding workload | llama.cpp ROCm | 60.92 | ⚡ spec-decode (MTP) |
| Qwen3.6 35B-A3B | HP ZBook Ultra G1a (Strix Halo laptop, 128 GB): Qwen3.6 35B-A3B at 59.4 tok/s, gpt-oss 120B at 44.7 | Strix Halo (Radeon 8060S) | Q4_K_M | llama.cpp b11213 Vulkan | 59.4 | |
| Qwen3.6 35B-A3B | HP ZBook Ultra G1a (Strix Halo laptop, 128 GB): Qwen3.6 35B-A3B at 59.4 tok/s, gpt-oss 120B at 44.7 | Strix Halo (Radeon 8060S) | 4-bit | Ollama 0.34.0 | 54.4 | |
| Qwen3.6 35B-A3B | Strix Halo (Corsair AI Workstation 300, 128 GB): ROCm vs Vulkan on Qwen3.8 27B and Qwen3.6 35B-A3B | Strix Halo (Radeon 8060S) | Q8_0, llama-bench tg128 | llama.cpp Vulkan | 54.22 | |
| Qwen3.6 35B-A3B | Minisforum MS-S1 MAX (Strix Halo, 128 GB): Qwen3.6 35B-A3B at 62 tok/s on llama.cpp Vulkan | Strix Halo (Radeon 8060S) | Q8_0 | llama.cpp Vulkan | 54 | |
| Qwen3.6 35B-A3B | Minisforum MS-S1 MAX (Strix Halo, 128 GB): Qwen3.6 35B-A3B at 62 tok/s on llama.cpp Vulkan | Strix Halo (Radeon 8060S) | Q4_K_M (Unsloth) | llama.cpp ROCm | 51 | |
| Qwen3.6 35B-A3B | Strix Halo (Radeon 8060S, 96 GB): 2026 models (llamabench community) | Strix Halo (Radeon 8060S) | llama-bench tg128 (quant per result) | llama.cpp | 50.2-62.4 | |
| Qwen3.6 35B-A3B | Strix Halo (Corsair AI Workstation 300, 128 GB): ROCm vs Vulkan on Qwen3.8 27B and Qwen3.6 35B-A3B | Strix Halo (Radeon 8060S) | Q8_0, llama-bench tg128 | llama.cpp ROCm | 47.47 | |
| Qwen3.8 27B | Strix Halo (Ryzen AI Max+ 395, 128 GB): Qwen3.8 27B Q6_K, 9.6 to 18 tok/s with MTP | Strix Halo (Radeon 8060S) | Q6_K + MTP (draft-n-max 2) | llama.cpp Vulkan (RADV) | 18.01 | ⚡ spec-decode (MTP) |
| Qwen3.8 27B | Strix Halo (Corsair AI Workstation 300, 128 GB): ROCm vs Vulkan on Qwen3.8 27B and Qwen3.6 35B-A3B | Strix Halo (Radeon 8060S) | Q8_0 + MTP (draft-n-max 3), coding workload, reasoning on | llama.cpp ROCm | 15.67 | ⚡ spec-decode (MTP) |
| Qwen3.8 27B | Strix Halo (Ryzen AI Max+ 395, 128 GB): Qwen3.8 27B Q6_K, 9.6 to 18 tok/s with MTP | Strix Halo (Radeon 8060S) | Q6_K + MTP (draft-n-max 5) | llama.cpp Vulkan (RADV) | 15.16 | ⚡ spec-decode (MTP) |
| Qwen3.8 27B | Strix Halo (Corsair AI Workstation 300, 128 GB): ROCm vs Vulkan on Qwen3.8 27B and Qwen3.6 35B-A3B | Strix Halo (Radeon 8060S) | Q8_0 + MTP (draft-n-max 3), coding workload, reasoning on | llama.cpp Vulkan | 13.19 | ⚡ spec-decode (MTP) |
| Qwen3.8 27B | Strix Halo mini PC (Ryzen AI Max+ 395, 128 GB): Qwen3.8 27B at 12.6 tok/s Q4_K_M, 7.7 Q8_0 | Strix Halo (Radeon 8060S) | Q4_K_M | llama.cpp/Ollama, ROCm | 12.6 | |
| Qwen3.8 27B | Strix Halo (Ryzen AI Max+ 395, 128 GB): Qwen3.8 27B Q6_K, 9.6 to 18 tok/s with MTP | Strix Halo (Radeon 8060S) | Q6_K, no MTP | llama.cpp Vulkan (RADV) | 9.59 | |
| Qwen3.8 27B | Strix Halo (Corsair AI Workstation 300, 128 GB): ROCm vs Vulkan on Qwen3.8 27B and Qwen3.6 35B-A3B | Strix Halo (Radeon 8060S) | Q8_0, llama-bench tg128 | llama.cpp Vulkan | 7.77 | |
| Qwen3.8 27B | Strix Halo (Corsair AI Workstation 300, 128 GB): ROCm vs Vulkan on Qwen3.8 27B and Qwen3.6 35B-A3B | Strix Halo (Radeon 8060S) | Q8_0, llama-bench tg128 | llama.cpp ROCm | 7.76 | |
| Qwen3.8 27B | Strix Halo mini PC (Ryzen AI Max+ 395, 128 GB): Qwen3.8 27B at 12.6 tok/s Q4_K_M, 7.7 Q8_0 | Strix Halo (Radeon 8060S) | Q8_0, --reasoning off | llama.cpp/Ollama, ROCm | 7.7 | |
| Qwen3.8 Flash-Next | Strix Halo + Radeon AI Pro R9700 over OCuLink: Qwen3.8 Flash-Next at ~102 tok/s (custom engine) | mixed / see build | custom int4 experts / 6-bit trunk | strixpro (MTP depth 3 + prompt lookup) | 102 | ⚡ spec-decode (MTP) |
| Qwen3.8 Flash-Next | Strix Halo + Radeon AI Pro R9700 over OCuLink: Qwen3.8 Flash-Next at ~102 tok/s (custom engine) | mixed / see build | custom int4 experts / 6-bit trunk | strixpro, ~100K context | 82 | |
| Qwen3.8 Flash-Next | Strix Halo + Radeon AI Pro R9700 over OCuLink: Qwen3.8 Flash-Next at ~102 tok/s (custom engine) | mixed / see build | custom int4 experts / 6-bit trunk | strixpro, ~980K context | 71 | |
| Qwen3.8 Flash-Next | Strix Halo + Radeon AI Pro R9700 over OCuLink: Qwen3.8 Flash-Next at ~102 tok/s (custom engine) | mixed / see build | GGUF | llama.cpp (Strix Halo iGPU only) | 29-34 | |
| gpt-oss 120B | HP ZBook Ultra G1a (Strix Halo laptop, 128 GB): Qwen3.6 35B-A3B at 59.4 tok/s, gpt-oss 120B at 44.7 | Strix Halo (Radeon 8060S) | MXFP4 | llama.cpp b11213 Vulkan | 44.7 | |
| DeepSeek R1 Distill 70B legacy | Framework Desktop (AMD Strix Halo) mainboard | mixed / see build | Ollama default | Ollama (CPU only, iGPU not used) | 2.43 | |
| DeepSeek R1 Distill 8B legacy | Framework Desktop (AMD Strix Halo) mainboard | mixed / see build | Ollama default | Ollama (CPU only, iGPU not used) | 19.49 | |
| Llama 3.1 70B legacy | Framework Desktop (AMD Strix Halo) mainboard | mixed / see build | Q4_K_M | llama.cpp Vulkan (iGPU, llama-bench tg128) | 4.97 | |
| Llama 3.2 3B legacy | Framework Desktop (AMD Strix Halo) mainboard | mixed / see build | Q4_K_M | llama.cpp Vulkan (iGPU, llama-bench tg128) | 88.14 | |
| Qwen3.6 27B legacy | HP ZBook Ultra G1a (Strix Halo laptop, 128 GB): Qwen3.6 35B-A3B at 59.4 tok/s, gpt-oss 120B at 44.7 | Strix Halo (Radeon 8060S) | 4-bit | Ollama 0.34.0 | 11.4 | |
The fastest plain-decode result we have is 88.14 tok/s on Llama 3.2 3B (Q4_K_M, llama.cpp Vulkan (iGPU, llama-bench tg128)) in Framework Desktop (AMD Strix Halo) mainboard. Speed depends heavily on the model, quant and engine, so compare like with like in the table. RigBase lists 32 measured results from 9 builds.
unified memory: 96–128 GB in our builds. Memory bandwidth: 256 GB/s (memory bandwidth as listed on llamabench).
DeepSeek R1 Distill 70B, DeepSeek R1 Distill 8B, Gemma 4 26B-A4B, Gemma 4 31B, Kolibri-1, Llama 3.1 70B, Llama 3.2 3B, Qwen3.6 27B, Qwen3.6 35B-A3B, Qwen3.8 27B, Qwen3.8 Flash-Next, gpt-oss 120B.
Every row links to a build page with its original public source (benchmark logs, READMEs, forum posts). RigBase does not re-run the benchmarks. Results marked ⚡ use speculative decoding and are not comparable 1:1 with plain decode.