bullerwins/huihui-gemma-4-26b-a4b-it-abliterated-gguf Q3_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
bullerwins/huihui-gemma-4-26b-a4b-it-abliterated-gguf overview
This is an uncensored version of google/gemma-4-26B-A4B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. Note For this model, both the thinking mode and the non-thinking mode have been completely abliterated. the first 5 layers have not been abliterated, may contain warning information, but no refusal will be made.. No ablation was performed on the 256 experts per layer. ### Usage Warnings ### Donation ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it.
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Huihui-gemma-4-26B-A4B-it-abliterated-IQ3_M.gguf | GGUF | IQ3_M | 11.54 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-IQ3_S.gguf | GGUF | IQ3_S | 11.38 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-IQ4_NL.gguf | GGUF | IQ4_NL | 13.58 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-IQ4_XS.gguf | GGUF | IQ4_XS | 13.10 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-MXFP4_MOE.gguf | GGUF | — | 13.72 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q2_K.gguf | GGUF | Q2_K | 9.86 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q3_K_L.gguf | GGUF | Q3_K_L | 12.88 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q3_K_M.gguf | GGUF | Q3_K_M | 12.37 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q3_K_S.gguf | GGUF | Q3_K_S | 11.38 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q4_0.gguf | GGUF | — | 13.45 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q4_1.gguf | GGUF | — | 14.87 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q4_K_M.gguf | GGUF | Q4_K_M | 15.64 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q4_K_S.gguf | GGUF | Q4_K_S | 14.40 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q5_0.gguf | GGUF | — | 16.30 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q5_1.gguf | GGUF | — | 17.72 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q5_K_M.gguf | GGUF | Q5_K_M | 17.82 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q5_K_S.gguf | GGUF | Q5_K_S | 16.75 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q6_K.gguf | GGUF | Q6_K | 21.08 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-Q8_0.gguf | GGUF | — | 25.02 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-TQ1_0.gguf | GGUF | — | 7.98 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-TQ2_0.gguf | GGUF | — | 8.71 GB | Download |
| Huihui-gemma-4-26B-A4B-it-abliterated-bf16.gguf | GGUF | BF16 | 47.04 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"library_name": "transformers",
"license": "apache-2.0",
"license_link": "https://ai.google.dev/gemma/docs/gemma_4_license",
"pipeline_tag": "any-to-any",
"base_model": [
"google/gemma-4-26B-A4B"
],
"tags": [
"abliterated",
"uncensored"
],
"frontmatter": {
"library_name": "transformers",
"license": "apache-2.0",
"license_link": "https://ai.google.dev/gemma/docs/gemma_4_license",
"pipeline_tag": "any-to-any",
"base_model": [
"google/gemma-4-26B-A4B"
],
"tags": [
"abliterated",
"uncensored"
]
},
"hero_image_url": "",
"summary": "This is an uncensored version of google/gemma-4-26B-A4B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. **Note** For this model, both the thinking mode and the non-thinking mode have been completely abliterated. the first 5 layers have not been abliterated, may contain warning information, but no refusal will be made.. No ablation was performed on the 256 experts per layer. ### Usage Warnings ### Donation ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it. `` bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge ``",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlibrary_name: transformers\nlicense: apache-2.0\nlicense_link: https://ai.google.dev/gemma/docs/gemma_4_license\npipeline_tag: any-to-any\nbase_model:\n- google/gemma-4-26B-A4B\ntags:\n- abliterated\n- uncensored\n---\n\n# huihui-ai/Huihui-gemma-4-26B-A4B-abliterated\n\n\nThis is an uncensored version of [google/gemma-4-26B-A4B](https://huggingface.co/google/gemma-4-26B-A4B) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).\nThis is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.\n\n**Note** For this model, both the thinking mode and the non-thinking mode have been completely abliterated. the first 5 layers have not been abliterated, may contain warning information, but no refusal will be made..\n\nNo ablation was performed on the 256 experts per layer.\n\n\n### Usage Warnings\n\n\n - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.\n\n - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.\n\n - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.\n\n - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.\n\n - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.\n\n - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.\n\n\n### Donation\n##### Your donation helps us continue our further development and improvement, a cup of coffee can do it.\n- bitcoin:\n```\n bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge\n```\n- Support our work on [Ko-fi](https://ko-fi.com/huihuiai)!\n\n",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"abliterated",
"uncensored",
"any-to-any",
"base_model:google/gemma-4-26B-A4B",
"base_model:quantized:google/gemma-4-26B-A4B",
"license:apache-2.0",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 0,
"downloads": 5751,
"gated": false,
"private": false,
"last_modified": "2026-04-11T11:08:59.000Z",
"created_at": "2026-04-11T11:00:59.000Z",
"pipeline_tag": "any-to-any",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "69da29ebcf8e40febe304863",
"id": "bullerwins/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF",
"modelId": "bullerwins/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF",
"sha": "60f5df7ccfde03291d895e3b689072073cfe9e6a",
"createdAt": "2026-04-11T11:00:59.000Z",
"lastModified": "2026-04-11T11:08:59.000Z",
"author": "bullerwins",
"downloads": 5751,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "any-to-any",
"library_name": "transformers",
"siblings_count": 24
}