More
Submit build

Models / Raon-1 mini Preview / VRAM

How much VRAM do you need for Raon-1 mini Preview?

Last updated:

Weight math from the model card, plus every measured RigBase result for Raon-1 mini Preview. Leave extra room for context (KV cache).

Quick answer: at Q4_K_M the weights are about 17.6 GB (28.8B params × 4.89 bits ÷ 8, llama.cpp quantize table). only about 4.3B parameters are active per token (MoE). the smallest-memory build with a measured result here is RTX 5070 Ti 16GB (16 GB) at 220 tok/s. Open the VRAM calculator →

Weight size by quant

QuantBits/weightWeights only
Q8_08.5030.6 GB
Q6_K6.5623.6 GB
Q5_K_M5.7020.5 GB
Q4_K_M4.8917.6 GB
Q3_K_M4.0014.4 GB
Q2_K3.1611.4 GB

Bits-per-weight for GGUF rows: llama.cpp quantize README. Parameter count: KRAFTON model card: 28.8B total / 4.3B activated MoE (6 of 128 routed experts + . We advise staying at Q4 or above for chat quality — see Is Q4 good enough?.

Measured speeds for Raon-1 mini Preview

HardwareQuantEnginetok/s
RTX 5070 Ti 16GB · 16 GBIQ3_KS experts / IQ4_KS_R16 down (13.85 GB, 3.86 bik_llama.cpp-raon fork (CUDA 12.8)220
RTX 5070 Ti 16GB · 16 GBIQ3_KS experts / IQ4_KS_R16 down (13.85 GB, 3.86 bik_llama.cpp-raon fork (CUDA 12.8)190
RX 7900 XTX 24GB · 24 GBIQ4_XS GGUFllama.cpp KRAFTON fork + PR #1 kernel pr75.46
RX 7900 XTX 24GB · 24 GBIQ4_XS GGUFllama.cpp KRAFTON fork + PR #1 kernel pr64.57
RTX 5060 Ti 16GB · 16 GBIQ4_XS GGUF (KRAFTON, 14.97 GiB) + DFlash2 Q8_0 drllama.cpp KRAFTON fork fb895662 (CUDA 1342.1 ⚡

⚡ = speculative decoding (MTP, DFlash…). Full list: best home rig for Raon-1 mini Preview.

Related

All Raon-1 mini Preview builds VRAM + KV calculator By VRAM size GGUF vs AWQ vs FP8 vs NVFP4 How much system RAM?

FAQ

How much VRAM do you need for Raon-1 mini Preview?

Weights alone are about 17.6 GB at Q4_K_M (28.8B × 4.89 bits ÷ 8). Add memory for the KV cache (context) and the runtime. The smallest-memory measured result in RigBase is 16 GB (RTX 5070 Ti 16GB) at 220 tok/s. Going below Q4 usually hurts quality for chat; see the Q4 guide.

What is the fastest measured speed for Raon-1 mini Preview?

RTX 5070 Ti 16GB: 220 tok/s plain decode (IQ3_KS experts / IQ4_KS_R16 down (13.85 GB, 3.86 bpw), q8_0 KV, ik_llama.cpp-raon fork (CUDA 12.8)).

Does system RAM replace VRAM?

Only for overflow. When the whole model fits in GPU or unified memory, system RAM barely matters for decode speed. See the system-RAM guide.

Not enough VRAM? Rent before you buy. Run Raon-1 mini Preview on a rented 24–96 GB cloud GPU by the hour and see the real speed before spending €1,000+. Try it on Runpod
Referral link: if you sign up with Google and add $10, Runpod gives you and RigBase bonus credit (terms). It never affects our data.