Skip to content
RigCheck

Local open-weight models

What can I run?

Pick a GPU or an Apple silicon Mac. RigCheck shows which catalog models fit at Q4, Q8, and FP16, and tokens per second only where a public benchmark measured them.

Choose a GPU or a Mac

24 GB VRAM on this model.

RTX 4090

24 GB VRAM. The fit rule treats 21.6 GB as usable (90%, after the driver). 24 GB GDDR6X. Single-card rows only; multi-GPU rigs are separate entries.

ModelQ4Q8FP16MXFP4
Qwen3.6 35B-A3B
Qwen · 35B stored · 3B active
22.1 GB
Tight
estimate · KV at 8k
Measured · 161 tok/s median
38.1 GB
Over
estimate · KV at 8k
No measured run
70.9 GB
Over
estimate · KV at 8k
No measured run
—
Qwen3.8 27B
Qwen · 27B stored
29.9 GB
Over
estimate · KV at 8k
No measured run
55.3 GB
Over
estimate · KV at 8k
No measured run
—
Gemma 4 26B-A4B
Gemma · 25.2B stored · 3.8B active
16.0 GB
Fits
estimate
Measured · 161 tok/s median
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
—
Gemma 4 12B
Gemma · 12B stored
13.4 GB
Fits
estimate
No measured run
24.6 GB
Over
estimate
No measured run
—
Llama 2 7B
Llama · 7B stored
9.0 GB
Fits
estimate · KV at 8k
Measured · 189 tok/s median
12.2 GB
Fits
estimate · KV at 8k
No measured run
18.8 GB
Fits
estimate · KV at 8k
No measured run
—
Gemma 4 31B
Gemma · 30.7B stored
19.4 GB
Fits
estimate
No measured run
33.4 GB
Over
estimate
No measured run
62.1 GB
Over
estimate
No measured run
—
Qwen3 30B-A3B
Qwen · 30B stored · 3B active
18.9 GB
Fits
estimate
No measured run
32.6 GB
Over
estimate
No measured run
60.8 GB
Over
estimate
No measured run
—
gpt-oss 20B
gpt-oss · 20.9B stored · 3.6B active
13.4 GB
Fits
estimate
No measured run
23.0 GB
Tight
estimate
No measured run
42.6 GB
Over
estimate
No measured run
13.6 GB
Fits
checkpoint
Measured · 239 tok/s median
Qwen3 14B
Qwen · 14B stored
9.2 GB
Fits
estimate
No measured run
15.6 GB
Fits
estimate
No measured run
28.8 GB
Over
estimate
No measured run
—
DeepSeek R1 Distill 14B
DeepSeek · 14B stored
9.2 GB
Fits
estimate
No measured run
15.6 GB
Fits
estimate
No measured run
28.8 GB
Over
estimate
No measured run
—
Gemma 3 12B
Gemma · 12B stored
8.0 GB
Fits
estimate
No measured run
13.5 GB
Fits
estimate
No measured run
24.8 GB
Over
estimate
No measured run
—
Llama 3 8B
Llama · 8B stored
6.6 GB
Fits
estimate · KV at 8k
No measured run
10.3 GB
Fits
estimate · KV at 8k
No measured run
17.8 GB
Fits
estimate · KV at 8k
No measured run
—
Llama 3.1 8B
Llama · 8B stored
6.6 GB
Fits
estimate · KV at 8k
No measured run
10.3 GB
Fits
estimate · KV at 8k
Measured · 53.0 tok/s median
17.8 GB
Fits
estimate · KV at 8k
No measured run
—
Qwen3 8B
Qwen · 8B stored
5.6 GB
Fits
estimate
No measured run
9.3 GB
Fits
estimate
No measured run
16.8 GB
Fits
estimate
No measured run
—
Gemma 4 E4B
Gemma · 8B stored
5.6 GB
Fits
estimate
No measured run
9.3 GB
Fits
estimate
No measured run
16.8 GB
Fits
estimate
No measured run
—
DeepSeek R1 Distill 8B
DeepSeek · 8B stored
6.6 GB
Fits
estimate · KV at 8k
No measured run
10.3 GB
Fits
estimate · KV at 8k
No measured run
17.8 GB
Fits
estimate · KV at 8k
No measured run
—
Llama 3.2 3B
Llama · 3B stored
3.4 GB
Fits
estimate · KV at 8k
No measured run
4.8 GB
Fits
estimate · KV at 8k
No measured run
7.6 GB
Fits
estimate · KV at 8k
No measured run
—
DeepSeek R1 671B
DeepSeek · 671B stored · 37B active
408 GB
Over
estimate
No measured run
714 GB
Over
estimate
No measured run
1343 GB
Over
estimate
No measured run
—
Llama 3.1 405B
Llama · 405B stored
250 GB
Over
estimate · KV at 8k
No measured run
435 GB
Over
estimate · KV at 8k
No measured run
815 GB
Over
estimate · KV at 8k
No measured run
—
Qwen3 235B-A22B
Qwen · 235B stored · 22B active
143 GB
Over
estimate
No measured run
250 GB
Over
estimate
No measured run
471 GB
Over
estimate
No measured run
—
gpt-oss 120B
gpt-oss · 117B stored · 5.1B active
71.6 GB
Over
estimate
No measured run
125 GB
Over
estimate
No measured run
234 GB
Over
estimate
No measured run
61.5 GB
Over
checkpoint
No measured run
Llama 3 70B
Llama · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—
Llama 3.1 70B
Llama · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—
Llama 3.3 70B
Llama · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—
DeepSeek R1 Distill 70B
DeepSeek · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—

Memory is an estimate unless the cell says checkpoint. Tokens/sec are medians of plain (non-speculative) public runs. A measured run can exist on hardware the estimate calls over. How the numbers are made.