GraySoft
Projects Models About FAQ Contact Download guIDE →

groxaxo/huihui-gemma-4-31b-it-abliterated-v2-gguf Q6_K_XL GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

groxaxo/huihui-gemma-4-31b-it-abliterated-v2-gguf overview

GGUF quantizations of huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2, built with llama.cpp from the included imatrix_unsloth.gguf and the tensor distributions in the downloaded recipe bundle. Included files: ### Usage warnings

transformersggufimatrixabliterateduncensoredany-to-anyimage-text-to-textbase_model:huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2base_model:quantized:huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2license:apache-2.0endpoints_compatibleregion:usconversational
groxaxo/huihui-gemma-4-31b-it-abliterated-v2-gguf visual
Downloads
3,445
Likes
2
Pipeline
any-to-any
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

9 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Huihui-gemma-4-31B-it-abliterated-v2-UD-IQ2_XXS.gguf GGUF IQ2_XXS 8.00 GB Download
Huihui-gemma-4-31B-it-abliterated-v2-UD-Q2_K_XL.gguf GGUF Q2_K_XL 10.97 GB Download
Huihui-gemma-4-31B-it-abliterated-v2-UD-Q3_K_XL.gguf GGUF Q3_K_XL 14.27 GB Download
Huihui-gemma-4-31B-it-abliterated-v2-UD-Q4_K_XL.gguf GGUF Q4_K_XL 17.87 GB Download
Huihui-gemma-4-31B-it-abliterated-v2-UD-Q5_K_XL.gguf GGUF Q5_K_XL 20.63 GB Download
Huihui-gemma-4-31B-it-abliterated-v2-UD-Q6_K_XL.gguf GGUF Q6_K_XL 25.63 GB Download
Huihui-gemma-4-31B-it-abliterated-v2-UD-Q8_K_XL.gguf GGUF Q8_K_XL 32.61 GB Download
imatrix_unsloth.gguf GGUF 13.12 MB Download
mmproj-BF16.gguf GGUF BF16 1.12 GB Download

Model Details Live

Model Slug
groxaxo/huihui-gemma-4-31b-it-abliterated-v2-gguf
Author
groxaxo
Pipeline Task
any-to-any
Library
transformers
Created
2026-04-12
Last Modified
2026-04-13
Gated
No
Private
No
HF SHA
23f18d2666a8ea9a3cc5f2332e0dc145c843e10e
License
apache-2.0
Language
Unknown
Base Model
huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "library_name": "transformers",
    "license": "apache-2.0",
    "license_link": "https://ai.google.dev/gemma/docs/gemma_4_license",
    "pipeline_tag": "any-to-any",
    "base_model": [
      "huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2"
    ],
    "tags": [
      "gguf",
      "imatrix",
      "abliterated",
      "uncensored",
      "any-to-any",
      "image-text-to-text"
    ],
    "frontmatter": {
      "library_name": "transformers",
      "license": "apache-2.0",
      "license_link": "https://ai.google.dev/gemma/docs/gemma_4_license",
      "pipeline_tag": "any-to-any",
      "base_model": [
        "huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2"
      ],
      "tags": [
        "gguf",
        "imatrix",
        "abliterated",
        "uncensored",
        "any-to-any",
        "image-text-to-text"
      ]
    },
    "hero_image_url": "",
    "summary": "GGUF quantizations of huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2, built with llama.cpp from the included imatrix_unsloth.gguf and the tensor distributions in the downloaded recipe bundle. Included files: ### Usage warnings",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlibrary_name: transformers\nlicense: apache-2.0\nlicense_link: https://ai.google.dev/gemma/docs/gemma_4_license\npipeline_tag: any-to-any\nbase_model:\n- huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2\ntags:\n- gguf\n- imatrix\n- abliterated\n- uncensored\n- any-to-any\n- image-text-to-text\n---\n\n# groxaxo/Huihui-gemma-4-31B-it-abliterated-v2-GGUF\n\nGGUF quantizations of [huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2](https://huggingface.co/huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2), built with `llama.cpp` from the included `imatrix_unsloth.gguf` and the tensor distributions in the downloaded recipe bundle.\n\nIncluded files:\n- `mmproj-BF16.gguf`\n- `imatrix_unsloth.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-IQ2_M.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-IQ2_XXS.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-IQ3_XXS.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q2_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q3_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q4_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q5_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q6_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q8_K_XL.gguf`\n\n### Usage warnings\n\n- **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.\n- **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.\n- **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal and ethical risks, and users are solely responsible for any consequences.\n- **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.\n- **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.\n- **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization.\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "imatrix",
    "abliterated",
    "uncensored",
    "any-to-any",
    "image-text-to-text",
    "base_model:huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2",
    "base_model:quantized:huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 2,
  "downloads": 3445,
  "gated": false,
  "private": false,
  "last_modified": "2026-04-13T14:33:15.000Z",
  "created_at": "2026-04-12T06:54:25.000Z",
  "pipeline_tag": "any-to-any",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "69db41a1a28fd8dc86a7a888",
  "id": "groxaxo/Huihui-gemma-4-31B-it-abliterated-v2-GGUF",
  "modelId": "groxaxo/Huihui-gemma-4-31B-it-abliterated-v2-GGUF",
  "sha": "23f18d2666a8ea9a3cc5f2332e0dc145c843e10e",
  "createdAt": "2026-04-12T06:54:25.000Z",
  "lastModified": "2026-04-13T14:33:15.000Z",
  "author": "groxaxo",
  "downloads": 3445,
  "likes": 2,
  "gated": false,
  "private": false,
  "pipeline_tag": "any-to-any",
  "library_name": "transformers",
  "siblings_count": 11
}