More
Submit build

Builds / Apple M3 Ultra (80-core GPU, unified)

Mac Studio M3 Ultra 512GB (oMLX, MTP off): Inkling 2 Mini at 40.3 tok/s at 1k context, 28.4 tok/s at 195k

Last updated:

Source: omlx.ai โ†—๐Ÿ“ How measured: reported by the original source; RigBase re-checked the numbers at that source
GPU(s)
Apple M3 Ultra (80-core GPU, unified)
VRAM / unified memory (GB)
512
CPU
Apple M3 Ultra (80-core GPU)
Motherboard
not stated
RAM
512 GB unified memory
PSU
not stated
Other
oMLX v0.8.1, macOS 27.2.1; model labelled Inkling-2-Mini; MTP off; turboquant KV off; benchmark context Code (Python); temperature 1
Reported total cost
not stated
Power
not stated

Measured speed (generation tokens/sec)

ModelQuantEnginetok/sPrompt processing (tok/s)Details
Inkling 2 MinioMLX Inkling-2-Mini (as labelled)oMLX v0.8.1, MTP off40.31,169 @ 1k-token prompt
est. TTFT @8k โ‰ˆ 7.0 s (calculated from measured prefill)
context: 1k tokens๐Ÿ“ Public oMLX session on an M3 Ultra (80-core) with 512 GB unified memory. Peak mem 20.9 GB. Retrieved 21 Nov 2026.
Inkling 2 MinioMLX Inkling-2-Mini (as labelled)oMLX v0.8.1, MTP off39.51,367 @ 4k-token prompt
est. TTFT @8k โ‰ˆ 6.0 s (calculated from measured prefill)
context: 4k tokens๐Ÿ“ Same oMLX session as the 1k row. Peak mem 22.7 GB. Retrieved 21 Nov 2026.
Inkling 2 MinioMLX Inkling-2-Mini (as labelled)oMLX v0.8.1, MTP off39.41,360 @ 8k-token prompt
est. TTFT @8k โ‰ˆ 6.0 s (calculated from measured prefill)
context: 8k tokens๐Ÿ“ Same oMLX session as the 1k row. Peak mem 23.4 GB. Retrieved 21 Nov 2026.
Inkling 2 MinioMLX Inkling-2-Mini (as labelled)oMLX v0.8.1, MTP off38.71,328 @ 16k-token prompt
est. TTFT @8k โ‰ˆ 6.2 s (calculated from measured prefill)
context: 16k tokens๐Ÿ“ Same oMLX session as the 1k row. Peak mem 24.9 GB. Retrieved 21 Nov 2026.
Inkling 2 MinioMLX Inkling-2-Mini (as labelled)oMLX v0.8.1, MTP off37.31,256 @ 32k-token prompt
est. TTFT @8k โ‰ˆ 6.5 s (calculated from measured prefill)
context: 32k tokens๐Ÿ“ Same oMLX session as the 1k row. Peak mem 27.9 GB. Retrieved 21 Nov 2026.
Inkling 2 MinioMLX Inkling-2-Mini (as labelled)oMLX v0.8.1, MTP off34.41,130 @ 64k-token prompt
est. TTFT @8k โ‰ˆ 7.2 s (calculated from measured prefill)
measured TTFT: 58.0 s @ 65,536-token prompt
context: 64k tokens๐Ÿ“ Same oMLX session as the 1k row. Peak mem 33.8 GB. TTFT 57,976 ms as published on the 64k result page. Retrieved 21 Nov 2026.
Inkling 2 MinioMLX Inkling-2-Mini (as labelled)oMLX v0.8.1, MTP off30.9941 @ 128k-token prompt
est. TTFT @8k โ‰ˆ 8.7 s (calculated from measured prefill)
context: 128k tokens๐Ÿ“ Same oMLX session as the 1k row. Peak mem 45.8 GB. Retrieved 21 Nov 2026.
Inkling 2 MinioMLX Inkling-2-Mini (as labelled)oMLX v0.8.1, MTP off28.4801 @ 195k-token prompt
est. TTFT @8k โ‰ˆ 10.2 s (calculated from measured prefill)
context: 195k tokens๐Ÿ“ Same oMLX session as the 1k row. Peak mem 58.5 GB. Retrieved 21 Nov 2026.

Prompt processing = prefill speed (how fast the prompt is read) as reported by the source, with the prompt length it was measured at; blank = the source does not report it. est. TTFT @8k is calculated from the measured prefill speed (8,192 รท prefill tok/s), shown only when prefill was measured on a prompt of 512+ tokens. It is not a measurement and ignores load time and caching. measured TTFT is the source's own time-to-first-token. Why prefill matters for coding assistants.

Public oMLX benchmark session, retrieved 21 Nov 2026. Hardware, software, settings and the context-length table are taken from the session page. MTP and turboquant KV were off. RigBase did not re-run it. Session resource panel: peak footprint 67.15 GB, total RAM 512.00 GB.

Source: https://omlx.ai/benchmarks/performance/z2wrhp3o

Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.

Embed this result

Copy into a README or blog. Links back to this build. See badge docs (CC BY 4.0 attribution). The SVG does not invent speeds โ€” numbers stay on the build page.

Markdown

[![Measured on RigBase](https://getrigbase.com/badge/omlx-m3-ultra-512gb-inkling-2-mini.svg)](https://getrigbase.com/builds/omlx-m3-ultra-512gb-inkling-2-mini/)

HTML

<a href="https://getrigbase.com/builds/omlx-m3-ultra-512gb-inkling-2-mini/" rel="noopener"><img src="https://getrigbase.com/badge/omlx-m3-ultra-512gb-inkling-2-mini.svg" alt="Measured on RigBase" height="20"/></a>

Preview: Measured on RigBase ยท How to use

Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)

Quick answers: Can Apple M3 Ultra run Inkling 2 Mini?