MacBook Pro M1 Max 32-core GPU, 64 GB
| GPU(s) | Apple M1 Max 32-core GPU |
|---|---|
| VRAM / unified memory (GB) | 64 |
| CPU | Apple M1 Max |
| Motherboard | |
| RAM | 64 GB unified |
| PSU | |
| Other | |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s |
|---|---|---|---|
| Llama 3 8B | Q4_K_M | llama.cpp | 34.49 |
Source: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod