Mac Studio M1 Ultra
| GPU(s) | Apple M1 Ultra |
|---|---|
| VRAM / unified memory (GB) | |
| CPU | Apple M1 Ultra |
| Motherboard | |
| RAM | |
| PSU | |
| Other | Total T/s incl. prompt processing |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| Llama 3.1 8B | Q8 | llama.cpp-based | 37.92 |
Source: https://www.someoddcodeguy.dev/low-context-speed-comparison-macbook-mac-studios-and-rtx-4090/
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod