Hardware / NVIDIA
Can an RTX Pro 6000 Blackwell run Qwen3 235B-A22B?
RTX Pro 6000 Blackwell has 96 GB VRAM. About 86.4 GB is treated as usable. 96 GB workstation card. Rows that also include a second GPU are not matched here. The title asks about Qwen3 235B-A22B because it is the largest catalog model still in range of this memory.
Manufacturer page for RTX Pro 6000 Blackwell
Compatibility
| Model | Q4 | Q8 | FP16 | MXFP4 |
|---|---|---|---|---|
| gpt-oss 120B gpt-oss · 117B stored · 5.1B active | 71.6 GB Fits estimate No measured run | 125 GB Over estimate No measured run | 234 GB Over estimate No measured run | |
| Llama 3 70B Llama · 70B stored | 45.7 GB Fits estimate · KV at 8k No measured run | 77.6 GB Fits estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.1 70B Llama · 70B stored | 45.7 GB Fits estimate · KV at 8k No measured run | 77.6 GB Fits estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| Llama 3.3 70B Llama · 70B stored | 45.7 GB Fits estimate · KV at 8k No measured run | 77.6 GB Fits estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| DeepSeek R1 Distill 70B DeepSeek · 70B stored | 45.7 GB Fits estimate · KV at 8k No measured run | 77.6 GB Fits estimate · KV at 8k No measured run | 143 GB Over estimate · KV at 8k No measured run | — |
| Qwen3.6 35B-A3B Qwen · 35B stored · 3B active
| 22.1 GB Fits estimate · KV at 8k No measured run | 38.1 GB Fits estimate · KV at 8k No measured run | 70.9 GB Fits estimate · KV at 8k No measured run | — |
| Gemma 4 31B Gemma · 30.7B stored | 19.4 GB Fits estimate No measured run | 33.4 GB Fits estimate No measured run | 62.1 GB Fits estimate No measured run | — |
| Qwen3 30B-A3B Qwen · 30B stored · 3B active | 18.9 GB Fits estimate No measured run | 32.6 GB Fits estimate No measured run | 60.8 GB Fits estimate No measured run | — |
| Qwen3.8 27B Qwen · 27B stored | 17.6 GB Fits estimate · KV at 8k No measured run | 29.9 GB Fits estimate · KV at 8k No measured run | 55.3 GB Fits estimate · KV at 8k No measured run | — |
| Gemma 4 26B-A4B Gemma · 25.2B stored · 3.8B active | 16.0 GB Fits estimate No measured run | 27.5 GB Fits estimate No measured run | 51.1 GB Fits estimate No measured run | — |
| gpt-oss 20B gpt-oss · 20.9B stored · 3.6B active | 13.4 GB Fits estimate No measured run | 23.0 GB Fits estimate No measured run | 42.6 GB Fits estimate No measured run | |
| Qwen3 14B Qwen · 14B stored | 9.2 GB Fits estimate No measured run | 15.6 GB Fits estimate No measured run | 28.8 GB Fits estimate No measured run | — |
| DeepSeek R1 Distill 14B DeepSeek · 14B stored | 9.2 GB Fits estimate No measured run | 15.6 GB Fits estimate No measured run | 28.8 GB Fits estimate No measured run | — |
| Gemma 3 12B Gemma · 12B stored | 8.0 GB Fits estimate No measured run | 13.5 GB Fits estimate No measured run | 24.8 GB Fits estimate No measured run | — |
| Gemma 4 12B Gemma · 12B stored | 8.0 GB Fits estimate No measured run | 13.4 GB Fits estimate No measured run | 24.6 GB Fits estimate No measured run | — |
| Llama 3 8B Llama · 8B stored | 6.6 GB Fits estimate · KV at 8k No measured run | 10.3 GB Fits estimate · KV at 8k No measured run | 17.8 GB Fits estimate · KV at 8k No measured run | — |
| Llama 3.1 8B Llama · 8B stored | 6.6 GB Fits estimate · KV at 8k No measured run | 10.3 GB Fits estimate · KV at 8k No measured run | 17.8 GB Fits estimate · KV at 8k No measured run | — |
| Qwen3 8B Qwen · 8B stored | 5.6 GB Fits estimate No measured run | 9.3 GB Fits estimate No measured run | 16.8 GB Fits estimate No measured run | — |
| Gemma 4 E4B Gemma · 8B stored | 5.6 GB Fits estimate No measured run | 9.3 GB Fits estimate No measured run | 16.8 GB Fits estimate No measured run | — |
| DeepSeek R1 Distill 8B DeepSeek · 8B stored | 6.6 GB Fits estimate · KV at 8k No measured run | 10.3 GB Fits estimate · KV at 8k No measured run | 17.8 GB Fits estimate · KV at 8k No measured run | — |
| Llama 2 7B Llama · 7B stored | 9.0 GB Fits estimate · KV at 8k No measured run | 12.2 GB Fits estimate · KV at 8k No measured run | 18.8 GB Fits estimate · KV at 8k No measured run | — |
| Llama 3.2 3B Llama · 3B stored | 3.4 GB Fits estimate · KV at 8k No measured run | 4.8 GB Fits estimate · KV at 8k No measured run | 7.6 GB Fits estimate · KV at 8k No measured run | — |
| DeepSeek R1 671B DeepSeek · 671B stored · 37B active | 408 GB Over estimate No measured run | 714 GB Over estimate No measured run | 1343 GB Over estimate No measured run | — |
| Llama 3.1 405B Llama · 405B stored | 250 GB Over estimate · KV at 8k No measured run | 435 GB Over estimate · KV at 8k No measured run | 815 GB Over estimate · KV at 8k No measured run | — |
| Qwen3 235B-A22B Qwen · 235B stored · 22B active | 143 GB Over estimate No measured run | 250 GB Over estimate No measured run | 471 GB Over estimate No measured run | — |
Measured runs on this device
- gpt-oss 20B · MXFP4 · 286.91 tok/s · llama.cpp source
- Qwen3.6 35B-A3B · NVFP4 · 261 tok/s · vLLM, b12x FP4 MoE kernel source
- gpt-oss 120B · MXFP4 · 196.31 tok/s · llama.cpp source
- Qwen3.8 27B · NVFP4 (W4A16) + MTP (5 draft tokens), 256K context · 150 tok/s · speculative · vLLM 0.27.1 source
- Qwen3.8 27B · BF16 + MTP (5 draft tokens), 256K context · 85 tok/s · speculative · vLLM 0.20.1 source