groxaxo/huihui-gemma-4-31b-it-abliterated-v2-gguf Q6_K_XL GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
groxaxo/huihui-gemma-4-31b-it-abliterated-v2-gguf overview
GGUF quantizations of huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2, built with llama.cpp from the included imatrix_unsloth.gguf and the tensor distributions in the downloaded recipe bundle. Included files: ### Usage warnings
Downloads
3,445
Likes
2
Pipeline
any-to-any
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
9 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Huihui-gemma-4-31B-it-abliterated-v2-UD-IQ2_XXS.gguf | GGUF | IQ2_XXS | 8.00 GB | Download |
| Huihui-gemma-4-31B-it-abliterated-v2-UD-Q2_K_XL.gguf | GGUF | Q2_K_XL | 10.97 GB | Download |
| Huihui-gemma-4-31B-it-abliterated-v2-UD-Q3_K_XL.gguf | GGUF | Q3_K_XL | 14.27 GB | Download |
| Huihui-gemma-4-31B-it-abliterated-v2-UD-Q4_K_XL.gguf | GGUF | Q4_K_XL | 17.87 GB | Download |
| Huihui-gemma-4-31B-it-abliterated-v2-UD-Q5_K_XL.gguf | GGUF | Q5_K_XL | 20.63 GB | Download |
| Huihui-gemma-4-31B-it-abliterated-v2-UD-Q6_K_XL.gguf | GGUF | Q6_K_XL | 25.63 GB | Download |
| Huihui-gemma-4-31B-it-abliterated-v2-UD-Q8_K_XL.gguf | GGUF | Q8_K_XL | 32.61 GB | Download |
| imatrix_unsloth.gguf | GGUF | — | 13.12 MB | Download |
| mmproj-BF16.gguf | GGUF | BF16 | 1.12 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"library_name": "transformers",
"license": "apache-2.0",
"license_link": "https://ai.google.dev/gemma/docs/gemma_4_license",
"pipeline_tag": "any-to-any",
"base_model": [
"huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2"
],
"tags": [
"gguf",
"imatrix",
"abliterated",
"uncensored",
"any-to-any",
"image-text-to-text"
],
"frontmatter": {
"library_name": "transformers",
"license": "apache-2.0",
"license_link": "https://ai.google.dev/gemma/docs/gemma_4_license",
"pipeline_tag": "any-to-any",
"base_model": [
"huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2"
],
"tags": [
"gguf",
"imatrix",
"abliterated",
"uncensored",
"any-to-any",
"image-text-to-text"
]
},
"hero_image_url": "",
"summary": "GGUF quantizations of huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2, built with llama.cpp from the included imatrix_unsloth.gguf and the tensor distributions in the downloaded recipe bundle. Included files: ### Usage warnings",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlibrary_name: transformers\nlicense: apache-2.0\nlicense_link: https://ai.google.dev/gemma/docs/gemma_4_license\npipeline_tag: any-to-any\nbase_model:\n- huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2\ntags:\n- gguf\n- imatrix\n- abliterated\n- uncensored\n- any-to-any\n- image-text-to-text\n---\n\n# groxaxo/Huihui-gemma-4-31B-it-abliterated-v2-GGUF\n\nGGUF quantizations of [huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2](https://huggingface.co/huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2), built with `llama.cpp` from the included `imatrix_unsloth.gguf` and the tensor distributions in the downloaded recipe bundle.\n\nIncluded files:\n- `mmproj-BF16.gguf`\n- `imatrix_unsloth.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-IQ2_M.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-IQ2_XXS.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-IQ3_XXS.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q2_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q3_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q4_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q5_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q6_K_XL.gguf`\n- `Huihui-gemma-4-31B-it-abliterated-v2-UD-Q8_K_XL.gguf`\n\n### Usage warnings\n\n- **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.\n- **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.\n- **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal and ethical risks, and users are solely responsible for any consequences.\n- **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.\n- **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.\n- **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization.\n",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"imatrix",
"abliterated",
"uncensored",
"any-to-any",
"image-text-to-text",
"base_model:huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2",
"base_model:quantized:huihui-ai/Huihui-gemma-4-31B-it-abliterated-v2",
"license:apache-2.0",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 2,
"downloads": 3445,
"gated": false,
"private": false,
"last_modified": "2026-04-13T14:33:15.000Z",
"created_at": "2026-04-12T06:54:25.000Z",
"pipeline_tag": "any-to-any",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "69db41a1a28fd8dc86a7a888",
"id": "groxaxo/Huihui-gemma-4-31B-it-abliterated-v2-GGUF",
"modelId": "groxaxo/Huihui-gemma-4-31B-it-abliterated-v2-GGUF",
"sha": "23f18d2666a8ea9a3cc5f2332e0dc145c843e10e",
"createdAt": "2026-04-12T06:54:25.000Z",
"lastModified": "2026-04-13T14:33:15.000Z",
"author": "groxaxo",
"downloads": 3445,
"likes": 2,
"gated": false,
"private": false,
"pipeline_tag": "any-to-any",
"library_name": "transformers",
"siblings_count": 11
}