Skip to content
RigCheck

Hardware / Apple

Can an M4 Max (36 GB) run gpt-oss 120B?

M4 Max 36GB has 36 GB unified memory. About 25.2 GB is treated as usable. M4 Max at 36 GB unified memory. The title asks about gpt-oss 120B because it is the largest catalog model still in range of this memory.

Manufacturer page for M4 Max 36GB

Compatibility

ModelQ4Q8FP16MXFP4
Qwen3.6 35B-A3B
Qwen · 35B stored · 3B active
22.1 GB
Fits
estimate · KV at 8k
No measured run
38.1 GB
Over
estimate · KV at 8k
No measured run
70.9 GB
Over
estimate · KV at 8k
No measured run
—
Gemma 4 31B
Gemma · 30.7B stored
19.4 GB
Fits
estimate
No measured run
33.4 GB
Tight
estimate
No measured run
62.1 GB
Over
estimate
No measured run
—
Qwen3 30B-A3B
Qwen · 30B stored · 3B active
18.9 GB
Fits
estimate
No measured run
32.6 GB
Tight
estimate
No measured run
60.8 GB
Over
estimate
No measured run
—
Qwen3.8 27B
Qwen · 27B stored
17.6 GB
Fits
estimate · KV at 8k
No measured run
29.9 GB
Tight
estimate · KV at 8k
No measured run
55.3 GB
Over
estimate · KV at 8k
No measured run
—
Gemma 4 26B-A4B
Gemma · 25.2B stored · 3.8B active
16.0 GB
Fits
estimate
No measured run
27.5 GB
Tight
estimate
No measured run
51.1 GB
Over
estimate
No measured run
—
gpt-oss 20B
gpt-oss · 20.9B stored · 3.6B active
13.4 GB
Fits
estimate
No measured run
23.0 GB
Fits
estimate
No measured run
42.6 GB
Over
estimate
No measured run
13.6 GB
Fits
checkpoint
Measured · 92.4 tok/s median
Qwen3 14B
Qwen · 14B stored
9.2 GB
Fits
estimate
No measured run
15.6 GB
Fits
estimate
No measured run
28.8 GB
Tight
estimate
No measured run
—
DeepSeek R1 Distill 14B
DeepSeek · 14B stored
9.2 GB
Fits
estimate
No measured run
15.6 GB
Fits
estimate
No measured run
28.8 GB
Tight
estimate
No measured run
—
Gemma 3 12B
Gemma · 12B stored
8.0 GB
Fits
estimate
No measured run
13.5 GB
Fits
estimate
No measured run
24.8 GB
Fits
estimate
No measured run
—
Gemma 4 12B
Gemma · 12B stored
8.0 GB
Fits
estimate
No measured run
13.4 GB
Fits
estimate
No measured run
24.6 GB
Fits
estimate
No measured run
—
Llama 3 8B
Llama · 8B stored
6.6 GB
Fits
estimate · KV at 8k
No measured run
10.3 GB
Fits
estimate · KV at 8k
No measured run
17.8 GB
Fits
estimate · KV at 8k
No measured run
—
Llama 3.1 8B
Llama · 8B stored
6.6 GB
Fits
estimate · KV at 8k
No measured run
10.3 GB
Fits
estimate · KV at 8k
No measured run
17.8 GB
Fits
estimate · KV at 8k
No measured run
—
Qwen3 8B
Qwen · 8B stored
5.6 GB
Fits
estimate
No measured run
9.3 GB
Fits
estimate
No measured run
16.8 GB
Fits
estimate
No measured run
—
Gemma 4 E4B
Gemma · 8B stored
5.6 GB
Fits
estimate
No measured run
9.3 GB
Fits
estimate
No measured run
16.8 GB
Fits
estimate
No measured run
—
DeepSeek R1 Distill 8B
DeepSeek · 8B stored
6.6 GB
Fits
estimate · KV at 8k
No measured run
10.3 GB
Fits
estimate · KV at 8k
No measured run
17.8 GB
Fits
estimate · KV at 8k
No measured run
—
Llama 2 7B
Llama · 7B stored
9.0 GB
Fits
estimate · KV at 8k
No measured run
12.2 GB
Fits
estimate · KV at 8k
No measured run
18.8 GB
Fits
estimate · KV at 8k
No measured run
—
Llama 3.2 3B
Llama · 3B stored
3.4 GB
Fits
estimate · KV at 8k
No measured run
4.8 GB
Fits
estimate · KV at 8k
No measured run
7.6 GB
Fits
estimate · KV at 8k
No measured run
—
DeepSeek R1 671B
DeepSeek · 671B stored · 37B active
408 GB
Over
estimate
No measured run
714 GB
Over
estimate
No measured run
1343 GB
Over
estimate
No measured run
—
Llama 3.1 405B
Llama · 405B stored
250 GB
Over
estimate · KV at 8k
No measured run
435 GB
Over
estimate · KV at 8k
No measured run
815 GB
Over
estimate · KV at 8k
No measured run
—
Qwen3 235B-A22B
Qwen · 235B stored · 22B active
143 GB
Over
estimate
No measured run
250 GB
Over
estimate
No measured run
471 GB
Over
estimate
No measured run
—
gpt-oss 120B
gpt-oss · 117B stored · 5.1B active
71.6 GB
Over
estimate
No measured run
125 GB
Over
estimate
No measured run
234 GB
Over
estimate
No measured run
61.5 GB
Over
checkpoint
No measured run
Llama 3 70B
Llama · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—
Llama 3.1 70B
Llama · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—
Llama 3.3 70B
Llama · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—
DeepSeek R1 Distill 70B
DeepSeek · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—

Measured runs on this device