Builds / 4x Nvidia GB10 (unified, DGX Spark)
4x DGX Spark: GLM-5.3 Flash EXL3 4-bit on TensorFold Zig, 77.2 tok/s (Mia's AI Lab recipe)
Last updated:
- GPU(s)
- 4x Nvidia GB10 (unified, DGX Spark)
- VRAM / unified memory (GB)
- 512
- CPU
- Nvidia GB10 Grace (Arm) per node
Amazon · eBay (used) · Newegg - Motherboard
- not stated
- RAM
- 128 GB LPDDR5X unified per Spark (512 GB total)
- PSU
- not stated
- Other
- 4 NVIDIA DGX Sparks, multi-node
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Prompt processing (tok/s) | Details |
|---|---|---|---|---|---|
| GLM-5.3 Flash | EXL3 4-bit + DFlash2 | TensorFold Zig, 4 nodes, 1 stream | 77.2 | 1,880 @ 32k-token prompt est. TTFT @8k ≈ 4.4 s (calculated from measured prefill) | ⚡ spec-decode (DFlash)context: 1M📏 Single-stream decode as published on Mia's AI Lab recipe card (Decode speed, one stream (4 Sparks, experimental)). Peak throughput 172.7 tok/s ×8 streams. Experimental TP=4 on four Sparks cabled in a switchless ring (start-tp4-switchless.sh), measured 2026-11-11: prose at T=0.7 with thinking on, 8 streams at a 1M window. Same recipe with Z.AI's block FP8 checkpoint (FP8=1, four Sparks only) reads 52.2 tok/s at one stream and 119.0 total at eight (README). |
Prompt processing = prefill speed (how fast the prompt is read) as reported by the source, with the prompt length it was measured at; blank = the source does not report it. est. TTFT @8k is calculated from the measured prefill speed (8,192 ÷ prefill tok/s), shown only when prefill was measured on a prompt of 512+ tokens. It is not a measurement and ignores load time and caching. measured TTFT is the source's own time-to-first-token. Why prefill matters for coding assistants.
Recipe and numbers by Mia's AI Lab (mia-ai.net), recipe last updated 2026-11-11; RigBase read the recipe card on 2026-11-12 and checked the decode figure against the recipe page. RigBase did not re-run it. Prefill is prompt-processing speed on a 32k prompt where listed.
https://mia-ai.net/models
https://github.com/MiaAI-Lab/GLM-5.3-Flash-DGX-Sparks-1104
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Quick answers: Can 4x DGX Spark (GB10) run GLM-5.3 Flash?