Mac Studio M1 Ultra (64-core GPU) 128GB
| GPU(s) | Apple M1 Ultra 64-core GPU (unified) |
|---|---|
| VRAM / unified memory (GB) | 128 |
| CPU | Apple M1 Ultra |
| Motherboard | |
| RAM | |
| PSU | |
| Other | |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| gpt-oss 20B | llama.cpp | 100.43 | |
| DeepSeek R1 Distill 14B | llama.cpp | 41.51 | |
| Llama 3.1 70B | llama.cpp | 9.84 | |
| Llama 3.2 3B | llama.cpp | 127.6 |
Numbers from Jeff Geerling's ai-benchmarks results table (llama.cpp/Ollama eval rate). Quantization not stated in the summary table. Power is peak whole-system draw during that test.
Source: https://github.com/geerlingguy/ai-benchmarks/issues/48
https://github.com/geerlingguy/ai-benchmarks
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod
Quick answers: Can Apple M1 Ultra run gpt-oss 20B?