More
Submit build

Builds / RTX 5070 Ti 16GB

RTX 5070 Ti 16 GB: KRAFTON Raon-1 mini preview (28.8B-A4.3B) IQ3_KS at ~220-230 tok/s on an ik_llama.cpp fork, 128K context fits

Last updated:

Source: huggingface.co ↗More source: github.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
GPU(s)
RTX 5070 Ti 16GB
Amazon · eBay (used) · Newegg
VRAM / unified memory (GB)
16
CPU
not stated
Motherboard
not stated
RAM
not stated
PSU
not stated
Other
CUDA 12.8; desktop running on the same GPU; quant only loads on the Mcniiby/ik_llama.cpp-raon fork (ik_llama.cpp quant types + vocab-trimmed output head)
Reported total cost
not stated
Power
not stated

Measured speed (generation tokens/sec)

ModelQuantEnginetok/sPrompt processing (tok/s)Details
Raon-1 mini PreviewIQ3_KS experts / IQ4_KS_R16 down (13.85 GB, 3.86 bpw), q8_0 KVik_llama.cpp-raon fork (CUDA 12.8)2204,900 @ 4K-token prompt
est. TTFT @8k ≈ 1.7 s (calculated from measured prefill)
context: llama-bench tg128📏 Quant author's card (HF repo created 28 Oct 2026): llama-bench tg128 with -fa 1 -ctk q8_0 -ctv q8_0 '~220-230 tok/s' (lower end listed); a plain port of the model ran ~97
Raon-1 mini PreviewIQ3_KS experts / IQ4_KS_R16 down (13.85 GB, 3.86 bpw), q8_0 KVik_llama.cpp-raon fork (CUDA 12.8)190not statedcontext: decode at 16K context📏 Same card: '~190 tok/s' decode at 16K; 128K context fits in 16 GB with q8_0 KV and -ub 256 (~1.2 GB free)

Prompt processing = prefill speed (how fast the prompt is read) as reported by the source, with the prompt length it was measured at; blank = the source does not report it. est. TTFT @8k is calculated from the measured prefill speed (8,192 ÷ prefill tok/s), shown only when prefill was measured on a prompt of 512+ tokens. It is not a measurement and ignores load time and caching. measured TTFT is the source's own time-to-first-token. Why prefill matters for coding assistants.

Numbers from the quant and fork author (approximate values as published). Quality vs KRAFTON's Q4_K_M (19.7 GB) on 40 x 512 tokens: mean KLD 0.0931, same top token 86.97%. The fork's fastest MoE kernel needs an sm_90+ GPU (RTX 50-series); RTX 30/40 compile but were not tested. Raon-1 mini is a hybrid model (18 linear-attention + 7 MLA layers), so the KV cache stays small at long context.

Current GPU street price (estimate, not the builder's cost)Estimated GPU cost for this build today: ≈€1,245
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://huggingface.co/McNiiby/Raon-1-mini-preview-IQ3_KS-GGUF
https://github.com/Mcniiby/ik_llama.cpp-raon

Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.

Embed this result

Copy into a README or blog. Links back to this build. See badge docs (CC BY 4.0 attribution). The SVG does not invent speeds — numbers stay on the build page.

Markdown

[![Measured on RigBase](https://getrigbase.com/badge/rtx-5070-ti-16gb-raon-1-mini-preview-iq3ks-ik-llamacpp-fork-mcniiby.svg)](https://getrigbase.com/builds/rtx-5070-ti-16gb-raon-1-mini-preview-iq3ks-ik-llamacpp-fork-mcniiby/)

HTML

<a href="https://getrigbase.com/builds/rtx-5070-ti-16gb-raon-1-mini-preview-iq3ks-ik-llamacpp-fork-mcniiby/" rel="noopener"><img src="https://getrigbase.com/badge/rtx-5070-ti-16gb-raon-1-mini-preview-iq3ks-ik-llamacpp-fork-mcniiby.svg" alt="Measured on RigBase" height="20"/></a>

Preview: Measured on RigBase · How to use

Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)

Quick answers: Can RTX 5070 Ti run Raon-1 mini Preview?