Hardware / NVIDIA
Can an RTX 5070 Ti run Qwen3.6 35B-A3B?
RTX 5070 Ti has 16 GB VRAM. About 14.4 GB is treated as usable. 16 GB card in NVIDIA's 50-series. Single-card rows only. The title asks about Qwen3.6 35B-A3B because it is the largest catalog model still in range of this memory.
Manufacturer page for RTX 5070 Ti
Compatibility
| Model | Q4 | Q8 | FP16 | MXFP4 |
|---|---|---|---|---|
| Gemma 4 26B-A4B Gemma · 25.2B stored · 3.8B active | 27.5 GB Over estimate No measured run | 51.1 GB Over estimate No measured run | — | |
| Gemma 4 12B Gemma · 12B stored | 13.4 GB Fits estimate No measured run | 24.6 GB Over estimate No measured run | — | |
| Gemma 4 E4B Gemma · 8B stored | 9.3 GB Fits estimate No measured run | 16.8 GB Over estimate No measured run | — | |
| gpt-oss 20B gpt-oss · 20.9B stored · 3.6B active | 13.4 GB Fits estimate No measured run | 23.0 GB Over estimate No measured run | 42.6 GB Over estimate No measured run | |
| Qwen3 14B Qwen · 14B stored | 9.2 GB Fits estimate No measured run | 15.6 GB Tight estimate No measured run | 28.8 GB Over estimate No measured run | — |
| DeepSeek R1 Distill 14B DeepSeek · 14B stored | 9.2 GB Fits estimate No measured run | 15.6 GB Tight estimate No measured run | 28.8 GB Over estimate No measured run | — |
| Gemma 3 12B Gemma · 12B stored | 8.0 GB Fits estimate No measured run | 13.5 GB Fits estimate No measured run | 24.8 GB Over estimate No measured run | — |
| Llama 3 8B Llama · 8B stored | 6.6 GB Fits estimate · KV at 8k No measured run | 10.3 GB Fits estimate · KV at 8k No measured run | 17.8 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.1 8B Llama · 8B stored | 6.6 GB Fits estimate · KV at 8k No measured run | 10.3 GB Fits estimate · KV at 8k No measured run | 17.8 GB Over estimate · KV at 8k No measured run | — |
| Qwen3 8B Qwen · 8B stored | 5.6 GB Fits estimate No measured run | 9.3 GB Fits estimate No measured run | 16.8 GB Over estimate No measured run | — |
| DeepSeek R1 Distill 8B DeepSeek · 8B stored | 6.6 GB Fits estimate · KV at 8k No measured run | 10.3 GB Fits estimate · KV at 8k No measured run | 17.8 GB Over estimate · KV at 8k No measured run | — |
| Llama 2 7B Llama · 7B stored | 9.0 GB Fits estimate · KV at 8k No measured run | 12.2 GB Fits estimate · KV at 8k No measured run | 18.8 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.2 3B Llama · 3B stored | 3.4 GB Fits estimate · KV at 8k No measured run | 4.8 GB Fits estimate · KV at 8k No measured run | 7.6 GB Fits estimate · KV at 8k No measured run | — |
| DeepSeek R1 671B DeepSeek · 671B stored · 37B active | 408 GB Over estimate No measured run | 714 GB Over estimate No measured run | 1343 GB Over estimate No measured run | — |
| Llama 3.1 405B Llama · 405B stored | 250 GB Over estimate · KV at 8k No measured run | 435 GB Over estimate · KV at 8k No measured run | 815 GB Over estimate · KV at 8k No measured run | — |
| Qwen3 235B-A22B Qwen · 235B stored · 22B active | 143 GB Over estimate No measured run | 250 GB Over estimate No measured run | 471 GB Over estimate No measured run | — |
| gpt-oss 120B gpt-oss · 117B stored · 5.1B active | 71.6 GB Over estimate No measured run | 125 GB Over estimate No measured run | 234 GB Over estimate No measured run | 61.5 GB Over checkpoint No measured run |
| Llama 3 70B Llama · 70B stored | 45.7 GB Over estimate · KV at 8k No measured run | 77.6 GB Over estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.1 70B Llama · 70B stored | 45.7 GB Over estimate · KV at 8k No measured run | 77.6 GB Over estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.3 70B Llama · 70B stored | 45.7 GB Over estimate · KV at 8k No measured run | 77.6 GB Over estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| DeepSeek R1 Distill 70B DeepSeek · 70B stored | 45.7 GB Over estimate · KV at 8k No measured run | 77.6 GB Over estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| Qwen3.6 35B-A3B Qwen · 35B stored · 3B active | 22.1 GB Over estimate · KV at 8k No measured run | 38.1 GB Over estimate · KV at 8k No measured run | 70.9 GB Over estimate · KV at 8k No measured run | — |
| Gemma 4 31B Gemma · 30.7B stored | 19.4 GB Over estimate No measured run | 33.4 GB Over estimate No measured run | 62.1 GB Over estimate No measured run | — |
| Qwen3 30B-A3B Qwen · 30B stored · 3B active | 18.9 GB Over estimate No measured run | 32.6 GB Over estimate No measured run | 60.8 GB Over estimate No measured run | — |
| Qwen3.8 27B Qwen · 27B stored | 17.6 GB Over estimate · KV at 8k No measured run | 29.9 GB Over estimate · KV at 8k No measured run | 55.3 GB Over estimate · KV at 8k No measured run | — |
Measured runs on this device
- gpt-oss 20B · MXFP4 · 236.7 tok/s · llama.cpp b12128 (CUDA) source
- gpt-oss 20B · MXFP4 (12.1 GB GGUF), reasoning low · 213.2 tok/s · llama.cpp b11669 (CUDA) source
- gpt-oss 20B · MXFP4 · 189.45 tok/s · llama.cpp source
- Gemma 4 E4B · Q4_K_M · 178.6 tok/s · llama.cpp b12128 (CUDA) source
- Gemma 4 12B · QAT Q4_0 (7.0 GB, Google's file) · 92.5 tok/s · llama.cpp b11669 (CUDA) source
- Gemma 4 12B · llama-bench tg128 (quant per result) · 87.6 tok/s · llama.cpp source
- Gemma 4 26B-A4B · UD-IQ4_XS (13.6 GB) · 59.4 tok/s · llama.cpp b11669 (CUDA), partial CPU offload source