Multi-GPU
Several 24 GB cards in one box. This is the usual way a 70B Q4 gets a measured run.
- 2× RTX 3090
Two 24 GB cards, 48 GB combined. Tensor-parallel runs in the dataset are kept on this entry.
Product page - 4× RTX 3090
Four 24 GB cards, 96 GB combined, from rows that say 4× RTX 3090 and 96 GB.
Product page