Question 1

What is ggerganov/gemma-4-31B-GGUF?

Accepted Answer

--- license: other tags: - gguf - quantized base_model: - google/gemma-4-31B --- # gemma-4-31B Source repos: - https://huggingface.co/google/gemma-4-31B TODO: add info

Question 2

What license applies to ggerganov/gemma-4-31B-GGUF?

Accepted Answer

License: other. Verify terms on Hugging Face before commercial use.

Question 3

How do I run ggerganov/gemma-4-31B-GGUF locally?

Accepted Answer

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Question 4

How much VRAM or disk space does ggerganov/gemma-4-31B-GGUF need?

Accepted Answer

Runs locally from ~30.39 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).

File	Type	Quantization	Size	Link
gemma-4-31B-BF16.gguf	GGUF	BF16	57.20 GB	Download
gemma-4-31B-Q8_0.gguf	GGUF	Q8_0	30.39 GB	Download

ggerganov/gemma-4-31B-GGUF overview

Repository Files & Downloads

Model Details

Model README

gemma-4-31B

Run ggerganov/gemma-4-31B-GGUF with guIDE

Model ID	ggerganov/gemma-4-31B-GGUF
Author	ggerganov
Pipeline	—
License	other
Base model	google/gemma-4-31B
Last modified	2026-07-15T15:44:53.000Z