Gemma
- Gemma 3 12B12B
Dense 12B Gemma 3. A 16 GB card is the usual Q4 home.
- Gemma 4 E4B8B
Small Gemma 4. Google quotes 4.5B effective parameters and 8B once embeddings are included.
- Gemma 4 12B12B
Dense Gemma 4 at 11.95B parameters, with a 256k context on the model card.
- Gemma 4 26B-A4B25.2B
Gemma 4 MoE. 25.2B stored, 3.8B active per token.
- Gemma 4 31B30.7B
Dense Gemma 4, 30.7B parameters. Q4 is a 24 GB card; Q8 is not.