What is mrutkows/granite-4.1-3b-GGUF?

mrutkows/granite-4.1-3b-GGUF is a GGUF-quantized model for local AI inference.

What license applies to mrutkows/granite-4.1-3b-GGUF?

License: See model card. Verify terms on Hugging Face before commercial use.

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Model Intelligence Sheet

mrutkows/granite-4.1-3b-GGUF GGUF downloads for local AI inference with guIDE.

ggufendpoints_compatibleregion:usconversational

Runs locally from ~1.96 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads

990

Likes

Pipeline

—

Author

4 GGUF files detected

Direct downloads for local inference

File	Type	Quantization	Size	Link
granite-4.1-3b-Q4_K_M.gguf	GGUF	Q4_K_M	1.96 GB	Download
granite-4.1-3b-Q5_K_M.gguf	GGUF	Q5_K_M	2.27 GB	Download
granite-4.1-3b-Q8_0.gguf	GGUF	Q8_0	3.37 GB	Download
granite-4.1-3b-bf16.gguf	GGUF	BF16	6.34 GB	Download

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.