Best home rig for LFM2.5 24B-A2B
Will it fit my GPU? Best value GPU per euro →
Real, measured generation speeds for LFM2.5 24B-A2B on home hardware, fastest first. Different quants/engines aren't directly comparable.
| Build | Quant | Engine | tok/s | Cost | |
|---|---|---|---|---|---|
| RTX 4090: 2026 models (llamabench community) | llama-bench tg128 (quant per result) | llama.cpp | 261-339 | source | |
| RTX 4060 Ti 16GB: 2026 models (llamabench community) | llama-bench tg128 (quant per result) | llama.cpp | 131-150 | source | |
| RTX 3060 12GB: 2026 models (llamabench community) | llama-bench tg128 (quant per result) | llama.cpp | 125 | source |
SPONSOR
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →
Your brand here. One sponsor slot on this page, shown to people choosing AI hardware. Sponsor RigBase →
Rent before you buy: try this model on a cloud GPU for a few dollars first: RunPod
FAQ
How much VRAM does LFM2.5 24B-A2B need?
The weights are about 14.7 GB at Q4_K_M (23.97B params × 4.89 bits ÷ 8, before context/KV cache). Add memory for context (KV cache) and the runtime. The smallest-memory setup with a measured result here, fully in memory, is RTX 4060 Ti 16GB (16 GB) at 131-150 tok/s.
What is the fastest measured hardware for LFM2.5 24B-A2B?
RTX 4090: 261-339 tok/s generation (llama.cpp, llama-bench tg128 (quant per result)), from https://llamabench.ai/browse/rtx4090.
Which GPUs have measured results for LFM2.5 24B-A2B?
RTX 3060 12GB, RTX 4060 Ti 16GB, RTX 4090.
Can it run on… RTX 3060 12GB · RTX 4060 Ti 16GB · RTX 4090
Related: what GPU do you need for 2026 models · all builds