Builds / Intel Arc Pro B60 24GB (USB4 eGPU enclosure)
Intel Arc Pro B60 24 GB in a USB4 enclosure on an M1 Max MacBook (aarch64 Linux): Llama 2 7B Q4_0 at 20.1 tok/s, 13.0 on a newer llama.cpp Vulkan build
Last updated:
- GPU(s)
- Intel Arc Pro B60 24GB (USB4 eGPU enclosure)
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 24
- CPU
- Apple M1 Max (16-inch MacBook Pro, aarch64 Linux host)
- Motherboard
- MacBook Pro 16-inch (M1 Max), USB4
Amazon · eBay (used) · Newegg - RAM
- not stated
Amazon · eBay (used) · Newegg - PSU
- not stated
- Other
- Omarchy (aarch64 Linux), kernel 7.1.12, Mesa ANV (vulkan-intel 26.2.5), KHR_coopmat; release Vulkan-only aarch64 builds; llama-bench -p 512 -n 128 -r 3 -ngl 99, builds run minutes apart; no resizable BAR
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Prompt processing (tok/s) | Details |
|---|---|---|---|---|---|
| Llama 2 7B legacy | Q4_0 | llama.cpp Vulkan 65840ed (Mesa ANV, aarch64) | 20.05 | 1,117 @ 512-token prompt est. TTFT @8k ≈ 7.3 s (calculated from measured prefill) | context: llama-bench tg128📏 tg128 20.05 ± 0.11, all layers on the card |
| Llama 2 7B legacy | Q4_0 | llama.cpp Vulkan 29c720e (Mesa ANV, aarch64) | 13.01 | 821 @ 512-token prompt est. TTFT @8k ≈ 10.0 s (calculated from measured prefill) | context: llama-bench tg128📏 Same host and flags ~614 commits later: tg128 13.01 ± 0.13 (-35%), pp512 -27%; not reproduced on a PCIe-slot B60 (see the Ubuntu PCIe build), so the cause is unresolved |
Prompt processing = prefill speed (how fast the prompt is read) as reported by the source, with the prompt length it was measured at; blank = the source does not report it. est. TTFT @8k is calculated from the measured prefill speed (8,192 ÷ prefill tok/s), shown only when prefill was measured on a prompt of 512+ tokens. It is not a measurement and ignores load time and caching. measured TTFT is the source's own time-to-first-token. Why prefill matters for coding assistants.
Reporter's own numbers in open llama.cpp issue #31557 (2 Nov 2026). The same B60 does about 61 tok/s in a normal PCIe slot on x86 (Intel's reply in the same issue), so this unsupported setup (eGPU over USB4 on an Arm host, no ReBAR) costs roughly two thirds of the speed even on the faster build. Intel notes it does not officially support Arc cards in eGPU enclosures or on aarch64 Linux.
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.