Mac Studio M5 Ultra 512GB: Qwen3.8 27B and Mistral Medium 3.5 (Apple MLX benchmark)
| GPU(s) | Apple M5 Ultra (unified) |
|---|---|
| VRAM / unified memory (GB) | 512 |
| CPU | Apple M5 Ultra |
| Motherboard | |
| RAM | |
| PSU | |
| Other | |
| Reported total cost | |
| Power | Peak ~300 W (Apple, 65K-token context) |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| Qwen3.8 27B | BF16, 8,192-token context | MLX (mlx_lm.benchmark) | 19.69 |
| Mistral Medium 3.5 128B | FP8, 8,192-token context | MLX (mlx_lm.benchmark) | 7.7 |
Apple Machine Learning Research, 15 Oct 2026. Vendor benchmark: decode speed over 128 generated tokens after an 8,192-token context, single user. Apple says M5 Ultra has 1.2 TB/s memory bandwidth vs 819 GB/s on M3 Ultra.
Source: https://machinelearning.apple.com/research/mlx-distributed-inference
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod
Quick answers: Can Apple M5 Ultra run Mistral Medium 3.5 128B? · Can Apple M5 Ultra run Qwen3.8 27B?