GraySoft
Projects Models About FAQ Contact Download guIDE →

groxaxo/huihui-gemma-4-26b-a4b-it-abliterated-gguf - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

groxaxo/huihui-gemma-4-26b-a4b-it-abliterated-gguf overview

These are UD quantizations of huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated, packaged for llama.cpp / GGUF inference.

llama.cppggufgemma4mxfp4quantizedmultimodalabliterateduncensoredimage-text-to-textconversationalbase_model:huihui-ai/Huihui-gemma-4-26B-A4B-it-abliteratedbase_model:quantized:huihui-ai/Huihui-gemma-4-26B-A4B-it-abliteratedendpoints_compatibleregion:usimatrix
groxaxo/huihui-gemma-4-26b-a4b-it-abliterated-gguf visual
Downloads
17,101
Likes
8
Pipeline
image-text-to-text
Library
llama.cpp
Visibility
Public
Access
Open

Repository Files & Downloads

19 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
gemma-4-26B-A4B-it-UD-IQ2_M.gguf GGUF IQ2_M 9.29 GB Download
gemma-4-26B-A4B-it-UD-IQ2_XXS.gguf GGUF IQ2_XXS 9.20 GB Download
gemma-4-26B-A4B-it-UD-IQ3_S.gguf GGUF IQ3_S 10.45 GB Download
gemma-4-26B-A4B-it-UD-IQ3_XXS.gguf GGUF IQ3_XXS 10.45 GB Download
gemma-4-26B-A4B-it-UD-IQ4_NL.gguf GGUF IQ4_NL 12.50 GB Download
gemma-4-26B-A4B-it-UD-IQ4_XS.gguf GGUF IQ4_XS 12.50 GB Download
gemma-4-26B-A4B-it-UD-Q2_K_XL.gguf GGUF Q2_K_XL 9.82 GB Download
gemma-4-26B-A4B-it-UD-Q3_K_M.gguf GGUF Q3_K_M 11.67 GB Download
gemma-4-26B-A4B-it-UD-Q3_K_S.gguf GGUF Q3_K_S 11.67 GB Download
gemma-4-26B-A4B-it-UD-Q3_K_XL.gguf GGUF Q3_K_XL 11.99 GB Download
gemma-4-26B-A4B-it-UD-Q4_K_M.gguf GGUF Q4_K_M 15.71 GB Download
gemma-4-26B-A4B-it-UD-Q4_K_S.gguf GGUF Q4_K_S 15.27 GB Download
gemma-4-26B-A4B-it-UD-Q4_K_XL.gguf GGUF Q4_K_XL 15.92 GB Download
gemma-4-26B-A4B-it-UD-Q5_K_M.gguf GGUF Q5_K_M 19.70 GB Download
gemma-4-26B-A4B-it-UD-Q5_K_S.gguf GGUF Q5_K_S 17.48 GB Download
gemma-4-26B-A4B-it-UD-Q5_K_XL.gguf GGUF Q5_K_XL 19.76 GB Download
gemma-4-26B-A4B-it-UD-Q6_K.gguf GGUF Q6_K 21.33 GB Download
gemma-4-26B-A4B-it-UD-Q6_K_XL.gguf GGUF Q6_K_XL 21.70 GB Download
gemma-4-26B-A4B-it-UD-Q8_K_XL.gguf GGUF Q8_K_XL 25.95 GB Download

Model Details Live

Model Slug
groxaxo/huihui-gemma-4-26b-a4b-it-abliterated-gguf
Author
groxaxo
Pipeline Task
image-text-to-text
Library
llama.cpp
Created
2026-04-11
Last Modified
2026-04-13
Gated
No
Private
No
HF SHA
da67ecc097dd336f0b66b7ad20f7f15b4f057562
License
Unknown
Language
Unknown
Base Model
huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "pipeline_tag": "image-text-to-text",
    "base_model": "huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated",
    "base_model_relation": "quantized",
    "library_name": "llama.cpp",
    "tags": [
      "gguf",
      "mxfp4",
      "quantized",
      "multimodal",
      "abliterated",
      "uncensored"
    ],
    "frontmatter": {
      "pipeline_tag": "image-text-to-text",
      "base_model": "huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated",
      "base_model_relation": "quantized",
      "library_name": "llama.cpp",
      "tags": [
        "gguf",
        "mxfp4",
        "quantized",
        "multimodal",
        "abliterated",
        "uncensored"
      ]
    },
    "hero_image_url": "",
    "summary": "These are **UD quantizations** of huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated, packaged for **llama.cpp / GGUF** inference.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\npipeline_tag: image-text-to-text\nbase_model: huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated\nbase_model_relation: quantized\nlibrary_name: llama.cpp\ntags:\n  - gguf\n  - mxfp4\n  - quantized\n  - multimodal\n  - abliterated\n  - uncensored\n---\n\nThese are **UD quantizations** of [huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated](https://huggingface.co/huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated), packaged for **llama.cpp / GGUF** inference.\n\n## Quick Start\n1. Download the latest release of **llama.cpp**.\n2. Download your preferred model variant from the files below.\n3. Use the corresponding `mmproj` file for multimodal inference.\n\n## Which version should I choose?\nThese variants are built using a **Unsloths Amazing tensor distribution recipe** to preserve as much quality as possible while reducing memory usage.\n\n## Notes\n- This repo is a **quantized release**, of the finetuned version : \n- Base model: [huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated](https://huggingface.co/huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated)\n- Runtime: **llama.cpp**",
    "related_quantizations": []
  },
  "tags": [
    "llama.cpp",
    "gguf",
    "gemma4",
    "mxfp4",
    "quantized",
    "multimodal",
    "abliterated",
    "uncensored",
    "image-text-to-text",
    "conversational",
    "base_model:huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated",
    "base_model:quantized:huihui-ai/Huihui-gemma-4-26B-A4B-it-abliterated",
    "endpoints_compatible",
    "region:us",
    "imatrix"
  ],
  "likes": 8,
  "downloads": 17101,
  "gated": false,
  "private": false,
  "last_modified": "2026-04-13T02:25:57.000Z",
  "created_at": "2026-04-11T09:47:56.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": "llama.cpp"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "69da18cc97388ce31f988924",
  "id": "groxaxo/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF",
  "modelId": "groxaxo/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF",
  "sha": "da67ecc097dd336f0b66b7ad20f7f15b4f057562",
  "createdAt": "2026-04-11T09:47:56.000Z",
  "lastModified": "2026-04-13T02:25:57.000Z",
  "author": "groxaxo",
  "downloads": 17101,
  "likes": 8,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "llama.cpp",
  "siblings_count": 29
}