Model Intelligence Sheet
mrutkows/granite-4.1-3b-GGUF overview
granite 4.1 3b GGUF NOTE This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.…
Runs locally from ~1.96 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
5 GGUF files detected
Direct downloads for local inference
Model Details
Model README
---
license: apache-2.0
library_name: llama.cpp
tags:
- language
- granite-4.1
- gguf
base_model:
- ibm-granite/granite-4.1-3b
---
granite-4.1-3b (GGUF)
> [!NOTE]
> This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.
>
> Please reference the base model's full model card here:
> https://huggingface.co/ibm-granite/granite-4.1-3b
<!-- #### Requirements
- llama.cpp build: $b9768$ -->
Run mrutkows/granite-4.1-3b-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models