groxaxo/huihui-gemma-4-26b-a4b-it-abliterated-gguf - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
groxaxo/huihui-gemma-4-26b-a4b-it-abliterated-gguf overview
These are UD quantizations of huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated, packaged for llama.cpp / GGUF inference.
Downloads
17,101
Likes
8
Pipeline
image-text-to-text
Library
llama.cpp
Visibility
Public
Access
Open
Repository Files & Downloads
19 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| gemma-4-26B-A4B-it-UD-IQ2_M.gguf | GGUF | IQ2_M | 9.29 GB | Download |
| gemma-4-26B-A4B-it-UD-IQ2_XXS.gguf | GGUF | IQ2_XXS | 9.20 GB | Download |
| gemma-4-26B-A4B-it-UD-IQ3_S.gguf | GGUF | IQ3_S | 10.45 GB | Download |
| gemma-4-26B-A4B-it-UD-IQ3_XXS.gguf | GGUF | IQ3_XXS | 10.45 GB | Download |
| gemma-4-26B-A4B-it-UD-IQ4_NL.gguf | GGUF | IQ4_NL | 12.50 GB | Download |
| gemma-4-26B-A4B-it-UD-IQ4_XS.gguf | GGUF | IQ4_XS | 12.50 GB | Download |
| gemma-4-26B-A4B-it-UD-Q2_K_XL.gguf | GGUF | Q2_K_XL | 9.82 GB | Download |
| gemma-4-26B-A4B-it-UD-Q3_K_M.gguf | GGUF | Q3_K_M | 11.67 GB | Download |
| gemma-4-26B-A4B-it-UD-Q3_K_S.gguf | GGUF | Q3_K_S | 11.67 GB | Download |
| gemma-4-26B-A4B-it-UD-Q3_K_XL.gguf | GGUF | Q3_K_XL | 11.99 GB | Download |
| gemma-4-26B-A4B-it-UD-Q4_K_M.gguf | GGUF | Q4_K_M | 15.71 GB | Download |
| gemma-4-26B-A4B-it-UD-Q4_K_S.gguf | GGUF | Q4_K_S | 15.27 GB | Download |
| gemma-4-26B-A4B-it-UD-Q4_K_XL.gguf | GGUF | Q4_K_XL | 15.92 GB | Download |
| gemma-4-26B-A4B-it-UD-Q5_K_M.gguf | GGUF | Q5_K_M | 19.70 GB | Download |
| gemma-4-26B-A4B-it-UD-Q5_K_S.gguf | GGUF | Q5_K_S | 17.48 GB | Download |
| gemma-4-26B-A4B-it-UD-Q5_K_XL.gguf | GGUF | Q5_K_XL | 19.76 GB | Download |
| gemma-4-26B-A4B-it-UD-Q6_K.gguf | GGUF | Q6_K | 21.33 GB | Download |
| gemma-4-26B-A4B-it-UD-Q6_K_XL.gguf | GGUF | Q6_K_XL | 21.70 GB | Download |
| gemma-4-26B-A4B-it-UD-Q8_K_XL.gguf | GGUF | Q8_K_XL | 25.95 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"pipeline_tag": "image-text-to-text",
"base_model": "huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated",
"base_model_relation": "quantized",
"library_name": "llama.cpp",
"tags": [
"gguf",
"mxfp4",
"quantized",
"multimodal",
"abliterated",
"uncensored"
],
"frontmatter": {
"pipeline_tag": "image-text-to-text",
"base_model": "huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated",
"base_model_relation": "quantized",
"library_name": "llama.cpp",
"tags": [
"gguf",
"mxfp4",
"quantized",
"multimodal",
"abliterated",
"uncensored"
]
},
"hero_image_url": "",
"summary": "These are **UD quantizations** of huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated, packaged for **llama.cpp / GGUF** inference.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\npipeline_tag: image-text-to-text\nbase_model: huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated\nbase_model_relation: quantized\nlibrary_name: llama.cpp\ntags:\n - gguf\n - mxfp4\n - quantized\n - multimodal\n - abliterated\n - uncensored\n---\n\nThese are **UD quantizations** of [huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated](https://huggingface.co/huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated), packaged for **llama.cpp / GGUF** inference.\n\n## Quick Start\n1. Download the latest release of **llama.cpp**.\n2. Download your preferred model variant from the files below.\n3. Use the corresponding `mmproj` file for multimodal inference.\n\n## Which version should I choose?\nThese variants are built using a **Unsloths Amazing tensor distribution recipe** to preserve as much quality as possible while reducing memory usage.\n\n## Notes\n- This repo is a **quantized release**, of the finetuned version : \n- Base model: [huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated](https://huggingface.co/huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated)\n- Runtime: **llama.cpp**",
"related_quantizations": []
},
"tags": [
"llama.cpp",
"gguf",
"gemma4",
"mxfp4",
"quantized",
"multimodal",
"abliterated",
"uncensored",
"image-text-to-text",
"conversational",
"base_model:huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated",
"base_model:quantized:huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated",
"endpoints_compatible",
"region:us",
"imatrix"
],
"likes": 8,
"downloads": 17101,
"gated": false,
"private": false,
"last_modified": "2026-04-13T02:25:57.000Z",
"created_at": "2026-04-11T09:47:56.000Z",
"pipeline_tag": "image-text-to-text",
"library_name": "llama.cpp"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "69da18cc97388ce31f988924",
"id": "groxaxo/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF",
"modelId": "groxaxo/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF",
"sha": "da67ecc097dd336f0b66b7ad20f7f15b4f057562",
"createdAt": "2026-04-11T09:47:56.000Z",
"lastModified": "2026-04-13T02:25:57.000Z",
"author": "groxaxo",
"downloads": 17101,
"likes": 8,
"gated": false,
"private": false,
"pipeline_tag": "image-text-to-text",
"library_name": "llama.cpp",
"siblings_count": 29
}