Model Intelligence Sheet
FadedRedStar/gemma-4-12B-it-heretic-GGUF overview
FadedRedStar/gemma-4-12B-it-heretic-GGUF GGUF downloads for local AI inference with guIDE.
Runs locally from ~151.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
7 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| gemma-4-12B-it-heretic-Q4_K_M.gguf | GGUF | Q4_K_M | 6.87 GB | Download |
| gemma-4-12B-it-heretic-Q5_K_M.gguf | GGUF | Q5_K_M | 7.96 GB | Download |
| gemma-4-12B-it-heretic-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| mmproj-gemma-4-12B-it-heretic-BF16.gguf | GGUF | BF16 | 167.0 MB | Download |
| mmproj-gemma-4-12B-it-heretic-Q8_0.gguf | GGUF | Q8_0 | 151.6 MB | Download |
| mtp-gemma-4-12B-it-heretic-BF16.gguf | GGUF | BF16 | 821.6 MB | Download |
| mtp-gemma-4-12B-it-heretic-Q8_0.gguf | GGUF | Q8_0 | 443.6 MB | Download |
Model Details
| Model ID | FadedRedStar/gemma-4-12B-it-heretic-GGUF |
|---|---|
| Author | FadedRedStar |
| Pipeline | — |
| License | — |
| Base model | — |
| Last modified | 2026-07-11T16:53:52.000Z |
Run FadedRedStar/gemma-4-12B-it-heretic-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models