Skip to content
RigCheck

Models / Gemma

Can an RTX 3060 12GB run Gemma 4 26B-A4B?

Gemma 4 MoE. 25.2B stored, 3.8B active per token.

Stored parameters
25.2B
Active parameters
3.8B
Q4 total (estimate)
16.0 GB
License
See model card

Model card. Google's card: 25.2B total parameters, 3.8B active, 256k context.

Compatibility

HardwareQ4Q8FP16
Ryzen AI Max+ 395 128GB
AMD · 128 GB unified
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
Ryzen AI Max+ 395 64GB
AMD · 64 GB unified
27.5 GB
Fits
estimate
No measured run
51.1 GB
Tight
estimate
No measured run
RTX 5090
NVIDIA · 32 GB VRAM
16.0 GB
Fits
estimate
Measured · 232 tok/s median
27.5 GB
Fits
estimate
No measured run
51.1 GB
Over
estimate
No measured run
RTX 4090
NVIDIA · 24 GB VRAM
16.0 GB
Fits
estimate
Measured · 161 tok/s median
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
TITAN RTX
NVIDIA · 24 GB VRAM
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
RTX 5070 Ti
NVIDIA · 16 GB VRAM
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
M3 Ultra 512GB
Apple · 512 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
2× NVIDIA GB10
NVIDIA · 256 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
M3 Ultra 256GB
Apple · 256 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
M5 Ultra 256GB
Apple · 256 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
M2 Ultra 192GB
Apple · 192 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
NVIDIA GB10
NVIDIA · 128 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
M1 Ultra 128GB
Apple · 128 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
M5 Max 128GB
Apple · 128 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
4× RTX 3090
NVIDIA · 96 GB VRAM
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
RTX Pro 6000 Blackwell
NVIDIA · 96 GB VRAM
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
M5 Ultra 96GB
Apple · 96 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Fits
estimate
No measured run
2× RTX 3090
NVIDIA · 48 GB VRAM
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Over
estimate
No measured run
M4 Pro 48GB
Apple · 48 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Over
estimate
No measured run
M4 Max 36GB
Apple · 36 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Tight
estimate
No measured run
51.1 GB
Over
estimate
No measured run
M5 Max 36GB
Apple · 36 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Tight
estimate
No measured run
51.1 GB
Over
estimate
No measured run
Radeon AI Pro R9700
AMD · 32 GB VRAM
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
No measured run
51.1 GB
Over
estimate
No measured run
Intel Arc Pro B70
Intel · 32 GB VRAM
16.0 GB
Fits
estimate
No measured run
27.5 GB
Fits
estimate
Measured · 122 tok/s median
51.1 GB
Over
estimate
No measured run
M4 32GB
Apple · 32 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Tight
estimate
No measured run
51.1 GB
Over
estimate
No measured run
M6 32GB
Apple · 32 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Tight
estimate
No measured run
51.1 GB
Over
estimate
No measured run
RTX 3090
NVIDIA · 24 GB VRAM
16.0 GB
Fits
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
Radeon RX 7900 XTX
AMD · 24 GB VRAM
16.0 GB
Fits
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
M4 Pro 24GB
Apple · 24 GB unified
16.0 GB
Fits
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
M3 Pro 18GB
Apple · 18 GB unified
16.0 GB
Tight
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
RTX 4060 Ti 16GB
NVIDIA · 16 GB VRAM
16.0 GB
Over
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
RTX 5060 Ti 16GB
NVIDIA · 16 GB VRAM
16.0 GB
Over
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
M4 16GB
Apple · 16 GB unified
16.0 GB
Over
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
RTX 3060 12GB
NVIDIA · 12 GB VRAM
16.0 GB
Over
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
RTX 3080 Ti
NVIDIA · 12 GB VRAM
16.0 GB
Over
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
RTX 4070 Ti
NVIDIA · 12 GB VRAM
16.0 GB
Over
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
RTX 2060 Super
NVIDIA · 8 GB VRAM
16.0 GB
Over
estimate
No measured run
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run

Measured runs

HardwareQuanttok/sRuntimeSource
RTX 5090llama-bench tg128 (quant per result)235llama.cppSource · checked
RTX 5090Q4_K_M (text-only build), f16 KV232.4llama-server b10448Source · checked · prefill 9719
M5 Max 128GB4-bit MLX (QAT)166 · speculativeRapid-MLX 0.16.1 + DFlashSource · checked
RTX 4090llama-bench tg128 (quant per result)164llama.cppSource · checked
RTX 4090UD-IQ4_XS (13.6 GB)161.4llama.cpp b11669 (CUDA)Source · checked · prefill 7257
Intel Arc Pro B70UD-Q8_K_XL122.16llama.cpp SYCL (pinned build, oneAPI 2026.0)Source · checked · prefill 1168
TITAN RTXUnsloth UD-IQ4_XS96.6llama.cpp b11222 (CUDA)Source · checked · prefill 2674
RTX 5070 TiUD-IQ4_XS (13.6 GB)59.4llama.cpp b11669 (CUDA), partial CPU offloadSource · checked · prefill 2199
NVIDIA GB10+ official MTP drafter (k=3)56.5 · speculativevLLM 0.31.0, 128K ctx, 1 userSource · checked
Ryzen AI Max+ 395 128GB4-bit51.8Ollama 0.34.0Source · checked
M6 32GBQAT (google/gemma-4-26b-a4b-qat)45.5LM StudioSource · checked
Ryzen AI Max+ 395 64GBUD-IQ4_XS (13.6 GB)43.3llama.cpp b11669 (Vulkan)Source · checked · prefill 271
NVIDIA GB10no speculative decoding30.8vLLM 0.31.0, 128K ctx, 1 userSource · checked