Models / Ripple 65B Preview / VRAM
How much VRAM do you need for Ripple 65B Preview?
Last updated:
Weight math from the model card, plus every measured RigBase result for Ripple 65B Preview. Leave extra room for context (KV cache).
Weight size by quant
| Quant | Bits/weight | Weights only |
|---|---|---|
| Q8_0 | 8.50 | 69.1 GB |
| Q6_K | 6.56 | 53.3 GB |
| Q5_K_M | 5.70 | 46.3 GB |
| Q4_K_M | 4.89 | 39.8 GB |
| Q3_K_M | 4.00 | 32.5 GB |
| Q2_K | 3.16 | 25.7 GB |
Bits-per-weight for GGUF rows: llama.cpp quantize README. Parameter count: Ricursive model card: dense 65B, 80 layers (64 sliding-window + 16 global), Apac. We advise staying at Q4 or above for chat quality — see Is Q4 good enough?.
Measured speeds for Ripple 65B Preview
| Hardware | Quant | Engine | tok/s |
|---|---|---|---|
| RTX 3090 · 24 GB | AD-IQ2_XXS (AtomicChat GGUF, 20.0 GB) | llama.cpp b12167 llama-server (CUDA) | 25.9 |
| Apple M3 Ultra (unified, Mac Studio) · 96 GB | Q4_K_M (self-quantized, 38.8 GB) | llama.cpp (Metal) | 15.0 |
| RTX A6000 48 GB · 48 GB | Q4_K_M (AtomicChat GGUF, 38.8 GB) | llama.cpp b12167 llama-server (CUDA) | 14.4 |
| 4x Intel Arc Pro B70 32 GB · 128 GB | Q4_K_M (AtomicChat GGUF, 38.8 GB) | llama.cpp b12314 (SYCL), layer split acr | 13.0 |
⚡ = speculative decoding (MTP, DFlash…). Full list: best home rig for Ripple 65B Preview.
Related
All Ripple 65B Preview builds VRAM + KV calculator By VRAM size GGUF vs AWQ vs FP8 vs NVFP4 How much system RAM?
FAQ
How much VRAM do you need for Ripple 65B Preview?
Weights alone are about 39.8 GB at Q4_K_M (65B × 4.89 bits ÷ 8). Add memory for the KV cache (context) and the runtime. The smallest-memory measured result in RigBase is 24 GB (RTX 3090) at 25.9 tok/s. Going below Q4 usually hurts quality for chat; see the Q4 guide.
What is the fastest measured speed for Ripple 65B Preview?
RTX 3090: 25.9 tok/s plain decode (AD-IQ2_XXS (AtomicChat GGUF, 20.0 GB), llama.cpp b12167 llama-server (CUDA)).
Does system RAM replace VRAM?
Only for overflow. When the whole model fits in GPU or unified memory, system RAM barely matters for decode speed. See the system-RAM guide.
Referral link: if you sign up with Google and add $10, Runpod gives you and RigBase bonus credit (terms). It never affects our data.