GraySoft
Projects Models About FAQ Contact Download guIDE →

bullerwins/huihui-gemma-4-26b-a4b-it-abliterated-gguf IQ3_S GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

bullerwins/huihui-gemma-4-26b-a4b-it-abliterated-gguf overview

This is an uncensored version of google/gemma-4-26B-A4B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. Note For this model, both the thinking mode and the non-thinking mode have been completely abliterated. the first 5 layers have not been abliterated, may contain warning information, but no refusal will be made.. No ablation was performed on the 256 experts per layer. ### Usage Warnings ### Donation ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it.

transformersggufabliterateduncensoredany-to-anybase_model:google/gemma-4-26B-A4Bbase_model:quantized:google/gemma-4-26B-A4Blicense:apache-2.0endpoints_compatibleregion:usconversational
bullerwins/huihui-gemma-4-26b-a4b-it-abliterated-gguf visual
Downloads
5,751
Likes
0
Pipeline
any-to-any
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

22 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Huihui-gemma-4-26B-A4B-it-abliterated-IQ3_M.gguf GGUF IQ3_M 11.54 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-IQ3_S.gguf GGUF IQ3_S 11.38 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-IQ4_NL.gguf GGUF IQ4_NL 13.58 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-IQ4_XS.gguf GGUF IQ4_XS 13.10 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-MXFP4_MOE.gguf GGUF 13.72 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q2_K.gguf GGUF Q2_K 9.86 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q3_K_L.gguf GGUF Q3_K_L 12.88 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q3_K_M.gguf GGUF Q3_K_M 12.37 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q3_K_S.gguf GGUF Q3_K_S 11.38 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q4_0.gguf GGUF 13.45 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q4_1.gguf GGUF 14.87 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q4_K_M.gguf GGUF Q4_K_M 15.64 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q4_K_S.gguf GGUF Q4_K_S 14.40 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q5_0.gguf GGUF 16.30 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q5_1.gguf GGUF 17.72 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q5_K_M.gguf GGUF Q5_K_M 17.82 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q5_K_S.gguf GGUF Q5_K_S 16.75 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q6_K.gguf GGUF Q6_K 21.08 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-Q8_0.gguf GGUF 25.02 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-TQ1_0.gguf GGUF 7.98 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-TQ2_0.gguf GGUF 8.71 GB Download
Huihui-gemma-4-26B-A4B-it-abliterated-bf16.gguf GGUF BF16 47.04 GB Download

Model Details Live

Model Slug
bullerwins/huihui-gemma-4-26b-a4b-it-abliterated-gguf
Author
bullerwins
Pipeline Task
any-to-any
Library
transformers
Created
2026-04-11
Last Modified
2026-04-11
Gated
No
Private
No
HF SHA
60f5df7ccfde03291d895e3b689072073cfe9e6a
License
apache-2.0
Language
Unknown
Base Model
google/gemma-4-26B-A4B

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "library_name": "transformers",
    "license": "apache-2.0",
    "license_link": "https://ai.google.dev/gemma/docs/gemma_4_license",
    "pipeline_tag": "any-to-any",
    "base_model": [
      "google/gemma-4-26B-A4B"
    ],
    "tags": [
      "abliterated",
      "uncensored"
    ],
    "frontmatter": {
      "library_name": "transformers",
      "license": "apache-2.0",
      "license_link": "https://ai.google.dev/gemma/docs/gemma_4_license",
      "pipeline_tag": "any-to-any",
      "base_model": [
        "google/gemma-4-26B-A4B"
      ],
      "tags": [
        "abliterated",
        "uncensored"
      ]
    },
    "hero_image_url": "",
    "summary": "This is an uncensored version of google/gemma-4-26B-A4B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. **Note** For this model, both the thinking mode and the non-thinking mode have been completely abliterated. the first 5 layers have not been abliterated, may contain warning information, but no refusal will be made.. No ablation was performed on the 256 experts per layer. ### Usage Warnings ### Donation ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it. `` bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge ``",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlibrary_name: transformers\nlicense: apache-2.0\nlicense_link: https://ai.google.dev/gemma/docs/gemma_4_license\npipeline_tag: any-to-any\nbase_model:\n- google/gemma-4-26B-A4B\ntags:\n- abliterated\n- uncensored\n---\n\n# huihui-ai/Huihui-gemma-4-26B-A4B-abliterated\n\n\nThis is an uncensored version of [google/gemma-4-26B-A4B](https://huggingface.co/google/gemma-4-26B-A4B) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).\nThis is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.\n\n**Note** For this model, both the thinking mode and the non-thinking mode have been completely abliterated. the first 5 layers have not been abliterated, may contain warning information, but no refusal will be made..\n\nNo ablation was performed on the 256 experts per layer.\n\n\n### Usage Warnings\n\n\n - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.\n\n - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.\n\n - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.\n\n - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.\n\n - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.\n\n - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.\n\n\n### Donation\n##### Your donation helps us continue our further development and improvement, a cup of coffee can do it.\n- bitcoin:\n```\n  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge\n```\n- Support our work on [Ko-fi](https://ko-fi.com/huihuiai)!\n\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "abliterated",
    "uncensored",
    "any-to-any",
    "base_model:google/gemma-4-26B-A4B",
    "base_model:quantized:google/gemma-4-26B-A4B",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 5751,
  "gated": false,
  "private": false,
  "last_modified": "2026-04-11T11:08:59.000Z",
  "created_at": "2026-04-11T11:00:59.000Z",
  "pipeline_tag": "any-to-any",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "69da29ebcf8e40febe304863",
  "id": "bullerwins/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF",
  "modelId": "bullerwins/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF",
  "sha": "60f5df7ccfde03291d895e3b689072073cfe9e6a",
  "createdAt": "2026-04-11T11:00:59.000Z",
  "lastModified": "2026-04-11T11:08:59.000Z",
  "author": "bullerwins",
  "downloads": 5751,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "any-to-any",
  "library_name": "transformers",
  "siblings_count": 24
}