NVIDIA
- RTX 2060 Super8 GB vram
8 GB card from the 20-series. Fine for small models at Q4.
- RTX 3060 12GB12 GB vram
12 GB GDDR6. The 12 GB model is the one matched from the benchmark set.
- RTX 3080 Ti12 GB vram
12 GB GDDR6X. Same memory class as the 12 GB 3060, with more bandwidth.
- RTX 4060 Ti 16GB16 GB vram
16 GB version of the 4060 Ti. Rows for the 8 GB card are not mixed in.
- RTX 4070 Ti12 GB vram
12 GB GDDR6X. The 4070 Ti Super (16 GB) is a different card and is not folded in.
- RTX 5060 Ti 16GB16 GB vram
16 GB Blackwell card. Mixed-GPU rows that pair it with another card are excluded.
- RTX 5070 Ti16 GB vram
16 GB card in NVIDIA's 50-series. Single-card rows only.
- RTX 309024 GB vram
24 GB GDDR6X. The usual used flagship in local-model builds.
- RTX 409024 GB vram
24 GB GDDR6X. Single-card rows only; multi-GPU rigs are separate entries.
- RTX 509032 GB vram
32 GB Blackwell flagship, from rows that report 32 GB on a single card.
- TITAN RTX24 GB vram
24 GB Turing card. Included because the benchmark set has single-card runs on it.
- 2× RTX 309048 GB vram
Two 24 GB cards, 48 GB combined. Tensor-parallel runs in the dataset are kept on this entry.
- 4× RTX 309096 GB vram
Four 24 GB cards, 96 GB combined, from rows that say 4× RTX 3090 and 96 GB.
- RTX Pro 6000 Blackwell96 GB vram
96 GB workstation card. Rows that also include a second GPU are not matched here.
- NVIDIA GB10128 GB unified
Grace Blackwell Superchip as reported with 128 GB unified memory. Multi-node rows are separate.
- 2× NVIDIA GB10256 GB unified
Two GB10 machines, 256 GB combined, from rows that say 2× Nvidia GB10.