Flagship
24–32 GB single cards. Dense models around 27–32B fit at Q4. A 70B Q4 does not.
- RTX 3090
24 GB GDDR6X. The usual used flagship in local-model builds.
Product page - RTX 4090
24 GB GDDR6X. Single-card rows only; multi-GPU rigs are separate entries.
Product page - RTX 5090
32 GB Blackwell flagship, from rows that report 32 GB on a single card.
Product page - TITAN RTX
24 GB Turing card. Included because the benchmark set has single-card runs on it.
Product page - Radeon RX 7900 XTX
24 GB RDNA 3 card. Runs in the dataset are mostly llama.cpp on ROCm or Vulkan.
Product page - Radeon AI Pro R9700
32 GB workstation Radeon. Only rows for a single card are matched.
Product page - Intel Arc Pro B70
32 GB Arc Pro card. Dual-B70 rows are not matched to this single-card entry.
Product page