Framework Desktop (AMD Strix Halo) mainboard
| GPU(s) | AMD Ryzen AI Max+ 395 (these Ollama runs used CPU only) Amazon · eBay (used) · Newegg |
|---|---|
| VRAM / unified memory (GB) | |
| CPU | AMD Ryzen AI Max (Strix Halo) Amazon · eBay (used) · Newegg |
| Motherboard | Framework Desktop mainboard Amazon · eBay (used) · Newegg |
| RAM | |
| PSU | |
| Other | Ollama benchmark |
| Reported total cost | |
| Power | ~141 W during inference |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| DeepSeek R1 Distill 8B | Ollama default | Ollama (CPU only, iGPU not used) | 19.49 |
| DeepSeek R1 Distill 70B | Ollama default | Ollama (CPU only, iGPU not used) | 2.43 |
| Llama 3.1 70B | llama.cpp | 4.97 | |
| Llama 3.2 3B | llama.cpp | 88.14 |
Source: https://github.com/geerlingguy/ai-benchmarks/issues/21
https://github.com/geerlingguy/ai-benchmarks
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod