Hardware / NVIDIA
Can an RTX 4070 Ti run Qwen3.6 35B-A3B?
RTX 4070 Ti has 12 GB VRAM. About 10.8 GB is treated as usable. 12 GB GDDR6X. The 4070 Ti Super (16 GB) is a different card and is not folded in. The title asks about Qwen3.6 35B-A3B because it is the largest catalog model still in range of this memory.
Manufacturer page for RTX 4070 Ti
Compatibility
| Model | Q4 | Q8 | FP16 | MXFP4 |
|---|---|---|---|---|
| Qwen3 14B Qwen · 14B stored | 9.2 GB Fits estimate No measured run | 15.6 GB Over estimate No measured run | 28.8 GB Over estimate No measured run | — |
| DeepSeek R1 Distill 14B DeepSeek · 14B stored | 9.2 GB Fits estimate No measured run | 15.6 GB Over estimate No measured run | 28.8 GB Over estimate No measured run | — |
| Gemma 3 12B Gemma · 12B stored | 8.0 GB Fits estimate No measured run | 13.5 GB Over estimate No measured run | 24.8 GB Over estimate No measured run | — |
| Gemma 4 12B Gemma · 12B stored | 8.0 GB Fits estimate No measured run | 13.4 GB Over estimate No measured run | 24.6 GB Over estimate No measured run | — |
| Llama 3 8B Llama · 8B stored | 6.6 GB Fits estimate · KV at 8k No measured run | 10.3 GB Fits estimate · KV at 8k No measured run | 17.8 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.1 8B Llama · 8B stored | 6.6 GB Fits estimate · KV at 8k No measured run | 10.3 GB Fits estimate · KV at 8k No measured run | 17.8 GB Over estimate · KV at 8k No measured run | — |
| Qwen3 8B Qwen · 8B stored | 5.6 GB Fits estimate No measured run | 9.3 GB Fits estimate No measured run | 16.8 GB Over estimate No measured run | — |
| Gemma 4 E4B Gemma · 8B stored | 5.6 GB Fits estimate No measured run | 9.3 GB Fits estimate No measured run | 16.8 GB Over estimate No measured run | — |
| DeepSeek R1 Distill 8B DeepSeek · 8B stored | 6.6 GB Fits estimate · KV at 8k No measured run | 10.3 GB Fits estimate · KV at 8k No measured run | 17.8 GB Over estimate · KV at 8k No measured run | — |
| Llama 2 7B Llama · 7B stored | 9.0 GB Fits estimate · KV at 8k No measured run | 12.2 GB Over estimate · KV at 8k No measured run | 18.8 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.2 3B Llama · 3B stored | 3.4 GB Fits estimate · KV at 8k No measured run | 4.8 GB Fits estimate · KV at 8k No measured run | 7.6 GB Fits estimate · KV at 8k No measured run | — |
| DeepSeek R1 671B DeepSeek · 671B stored · 37B active | 408 GB Over estimate No measured run | 714 GB Over estimate No measured run | 1343 GB Over estimate No measured run | — |
| Llama 3.1 405B Llama · 405B stored | 250 GB Over estimate · KV at 8k No measured run | 435 GB Over estimate · KV at 8k No measured run | 815 GB Over estimate · KV at 8k No measured run | — |
| Qwen3 235B-A22B Qwen · 235B stored · 22B active | 143 GB Over estimate No measured run | 250 GB Over estimate No measured run | 471 GB Over estimate No measured run | — |
| gpt-oss 120B gpt-oss · 117B stored · 5.1B active | 71.6 GB Over estimate No measured run | 125 GB Over estimate No measured run | 234 GB Over estimate No measured run | 61.5 GB Over checkpoint No measured run |
| Llama 3 70B Llama · 70B stored | 45.7 GB Over estimate · KV at 8k No measured run | 77.6 GB Over estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.1 70B Llama · 70B stored | 45.7 GB Over estimate · KV at 8k No measured run | 77.6 GB Over estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.3 70B Llama · 70B stored | 45.7 GB Over estimate · KV at 8k No measured run | 77.6 GB Over estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| DeepSeek R1 Distill 70B DeepSeek · 70B stored | 45.7 GB Over estimate · KV at 8k No measured run | 77.6 GB Over estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| Qwen3.6 35B-A3B Qwen · 35B stored · 3B active | 22.1 GB Over estimate · KV at 8k No measured run | 38.1 GB Over estimate · KV at 8k No measured run | 70.9 GB Over estimate · KV at 8k No measured run | — |
| Gemma 4 31B Gemma · 30.7B stored | 19.4 GB Over estimate No measured run | 33.4 GB Over estimate No measured run | 62.1 GB Over estimate No measured run | — |
| Qwen3 30B-A3B Qwen · 30B stored · 3B active | 18.9 GB Over estimate No measured run | 32.6 GB Over estimate No measured run | 60.8 GB Over estimate No measured run | — |
| Qwen3.8 27B Qwen · 27B stored | 17.6 GB Over estimate · KV at 8k No measured run | 29.9 GB Over estimate · KV at 8k No measured run | 55.3 GB Over estimate · KV at 8k No measured run | — |
| Gemma 4 26B-A4B Gemma · 25.2B stored · 3.8B active | 16.0 GB Over estimate No measured run | 27.5 GB Over estimate No measured run | 51.1 GB Over estimate No measured run | — |
| gpt-oss 20B gpt-oss · 20.9B stored · 3.6B active | 13.4 GB Over estimate No measured run | 23.0 GB Over estimate No measured run | 42.6 GB Over estimate No measured run | 13.6 GB Over checkpoint No measured run |
Measured runs on this device
- Llama 3.2 3B · not stated · 196.15 tok/s · llama.cpp source
- gpt-oss 20B · not stated · 163.14 tok/s · llama.cpp source
- DeepSeek R1 Distill 14B · not stated · 49.74 tok/s · llama.cpp source