Builds / RTX 4090

RTX 4090 (llm-speed signed runs, Oct 2026): Qwen3.6 35B-A3B 161 tok/s, Gemma 4 12B QAT 98 tok/s

Name: RTX 4090 (llm-speed signed runs, Oct 2026): Qwen3.6 35B-A3B 161 tok/s, Gemma 4 12B QAT 98 tok/s
Creator: RigBase
License: https://creativecommons.org/licenses/by/4.0/

Source: llm-speed.com ↗More source: llm-speed.com ↗More source: llm-speed.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source

GPU(s): RTX 4090
Amazon · eBay (used) · Newegg
VRAM / unified memory (GB): 24
CPU: AMD EPYC 7642 (GLM run: EPYC 75F3)
Amazon · eBay (used) · Newegg
Motherboard: not stated
RAM: not stated
PSU: not stated
Other: Server hosts; llm-speed suite-v1 chat-short workload (128-token prompt, 256 tokens out, batch 1)
Reported total cost: not stated
Power: not stated

Measured speed (generation tokens/sec)

Model	Quant	Engine	tok/s
Qwen3.6 35B-A3B	Q4_K_M	llama.cpp b8931	160.6
Gemma 4 12B	QAT Q4_0	llama.cpp b8931	97.7
GLM 4.7 Flash legacy	Q4_K_M (EPYC 75F3 host)	Ollama 0.31.1	164.9

Signed community runs on llm-speed.com, 16 Oct 2026. Decode tok/s from the chat-short workload; chat-long (4K prompt): 160.4 (Qwen3.6 35B-A3B), 86.3 (Gemma 4 12B), 146.1 (GLM 4.7 Flash).

Current GPU street price (estimate, not the builder's cost)

1× RTX 4090: ≈€3,955 each (≈$4,433), new, approx. price as of 2026-10-16, lowest listing on billiger.de (ASUS TUF Gaming RTX 4090 OG OC 24 GB)

Estimated GPU cost for this build today: ≈€3,955
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.

Source: https://llm-speed.com/r/r_m6j1zxwvp-f
https://llm-speed.com/r/r_jfh0qkngw76
https://llm-speed.com/r/r_ted0u8uyre0

Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.

Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)

Quick answers: Can RTX 4090 run GLM 4.7 Flash? · Can RTX 4090 run Gemma 4 12B? · Can RTX 4090 run Qwen3.6 35B-A3B?