Skip to content
RigCheck

Hardware / NVIDIA

Can a TITAN RTX run Llama 3.3 70B?

TITAN RTX has 24 GB VRAM. About 21.6 GB is treated as usable. 24 GB Turing card. Included because the benchmark set has single-card runs on it. The title asks about Llama 3.3 70B because it is the largest catalog model still in range of this memory.

Manufacturer page for TITAN RTX

Compatibility

ModelQ4Q8FP16MXFP4
Qwen3.6 35B-A3B
Qwen · 35B stored · 3B active
22.1 GB
Tight
estimate · KV at 8k
Measured · 113 tok/s median
38.1 GB
Over
estimate · KV at 8k
No measured run
70.9 GB
Over
estimate · KV at 8k
No measured run
—
Qwen3.8 27B
Qwen · 27B stored
17.6 GB
Fits
estimate · KV at 8k
Measured · 30.2 tok/s median
29.9 GB
Over
estimate · KV at 8k
No measured run
55.3 GB
Over
estimate · KV at 8k
No measured run
—
Gemma 4 26B-A4B
Gemma · 25.2B stored · 3.8B active
27.5 GB
Over
estimate
No measured run
51.1 GB
Over
estimate
No measured run
—
Gemma 4 31B
Gemma · 30.7B stored
19.4 GB
Fits
estimate
No measured run
33.4 GB
Over
estimate
No measured run
62.1 GB
Over
estimate
No measured run
—
Qwen3 30B-A3B
Qwen · 30B stored · 3B active
18.9 GB
Fits
estimate
No measured run
32.6 GB
Over
estimate
No measured run
60.8 GB
Over
estimate
No measured run
—
gpt-oss 20B
gpt-oss · 20.9B stored · 3.6B active
13.4 GB
Fits
estimate
No measured run
23.0 GB
Tight
estimate
No measured run
42.6 GB
Over
estimate
No measured run
13.6 GB
Fits
checkpoint
No measured run
Qwen3 14B
Qwen · 14B stored
9.2 GB
Fits
estimate
No measured run
15.6 GB
Fits
estimate
No measured run
28.8 GB
Over
estimate
No measured run
—
DeepSeek R1 Distill 14B
DeepSeek · 14B stored
9.2 GB
Fits
estimate
No measured run
15.6 GB
Fits
estimate
No measured run
28.8 GB
Over
estimate
No measured run
—
Gemma 3 12B
Gemma · 12B stored
8.0 GB
Fits
estimate
No measured run
13.5 GB
Fits
estimate
No measured run
24.8 GB
Over
estimate
No measured run
—
Gemma 4 12B
Gemma · 12B stored
8.0 GB
Fits
estimate
No measured run
13.4 GB
Fits
estimate
No measured run
24.6 GB
Over
estimate
No measured run
—
Llama 3 8B
Llama · 8B stored
6.6 GB
Fits
estimate · KV at 8k
No measured run
10.3 GB
Fits
estimate · KV at 8k
No measured run
17.8 GB
Fits
estimate · KV at 8k
No measured run
—
Llama 3.1 8B
Llama · 8B stored
6.6 GB
Fits
estimate · KV at 8k
No measured run
10.3 GB
Fits
estimate · KV at 8k
No measured run
17.8 GB
Fits
estimate · KV at 8k
No measured run
—
Qwen3 8B
Qwen · 8B stored
5.6 GB
Fits
estimate
No measured run
9.3 GB
Fits
estimate
No measured run
16.8 GB
Fits
estimate
No measured run
—
Gemma 4 E4B
Gemma · 8B stored
5.6 GB
Fits
estimate
No measured run
9.3 GB
Fits
estimate
No measured run
16.8 GB
Fits
estimate
No measured run
—
DeepSeek R1 Distill 8B
DeepSeek · 8B stored
6.6 GB
Fits
estimate · KV at 8k
No measured run
10.3 GB
Fits
estimate · KV at 8k
No measured run
17.8 GB
Fits
estimate · KV at 8k
No measured run
—
Llama 2 7B
Llama · 7B stored
9.0 GB
Fits
estimate · KV at 8k
No measured run
12.2 GB
Fits
estimate · KV at 8k
No measured run
18.8 GB
Fits
estimate · KV at 8k
No measured run
—
Llama 3.2 3B
Llama · 3B stored
3.4 GB
Fits
estimate · KV at 8k
No measured run
4.8 GB
Fits
estimate · KV at 8k
No measured run
7.6 GB
Fits
estimate · KV at 8k
No measured run
—
DeepSeek R1 671B
DeepSeek · 671B stored · 37B active
408 GB
Over
estimate
No measured run
714 GB
Over
estimate
No measured run
1343 GB
Over
estimate
No measured run
—
Llama 3.1 405B
Llama · 405B stored
250 GB
Over
estimate · KV at 8k
No measured run
435 GB
Over
estimate · KV at 8k
No measured run
815 GB
Over
estimate · KV at 8k
No measured run
—
Qwen3 235B-A22B
Qwen · 235B stored · 22B active
143 GB
Over
estimate
No measured run
250 GB
Over
estimate
No measured run
471 GB
Over
estimate
No measured run
—
gpt-oss 120B
gpt-oss · 117B stored · 5.1B active
71.6 GB
Over
estimate
No measured run
125 GB
Over
estimate
No measured run
234 GB
Over
estimate
No measured run
61.5 GB
Over
checkpoint
No measured run
Llama 3 70B
Llama · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—
Llama 3.1 70B
Llama · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—
Llama 3.3 70B
Llama · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—
DeepSeek R1 Distill 70B
DeepSeek · 70B stored
45.7 GB
Over
estimate · KV at 8k
No measured run
77.6 GB
Over
estimate · KV at 8k
No measured run
143 GB
Over
estimate · KV at 8k
No measured run
—

Measured runs on this device