nicolasmatta1/huihui-qwen3.5-397b-a17b-abliterated-gguf overview

{
  "metadata": {},
  "card_data": {
    "library_name": "transformers",
    "license": "apache-2.0",
    "license_link": "https://huggingface.co/Qwen/Qwen3.5-397B-A17B/blob/main/LICENSE",
    "pipeline_tag": "image-text-to-text",
    "base_model": [
      "Qwen/Qwen3.5-397B-A17B"
    ],
    "tags": [
      "abliterated",
      "uncensored",
      "GGUF"
    ],
    "extra_gated_prompt": "**Usage Warnings**\n\n“**Risk of Sensitive or Controversial Outputs**“: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.\n“**Not Suitable for All Audiences**:“ Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.\n“**Legal and Ethical Responsibilities**“: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.\n“**Research and Experimental Use**“: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.\n“**Monitoring and Review Recommendations**“: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.\n“**No Default Safety Guarantees**“: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.",
    "frontmatter": {
      "library_name": "transformers",
      "license": "apache-2.0",
      "license_link": "https://huggingface.co/Qwen/Qwen3.5-397B-A17B/blob/main/LICENSE",
      "pipeline_tag": "image-text-to-text",
      "base_model": [
        "Qwen/Qwen3.5-397B-A17B"
      ],
      "tags": [
        "abliterated",
        "uncensored",
        "GGUF"
      ],
      "extra_gated_prompt": ">-"
    },
    "hero_image_url": "",
    "summary": "This is an uncensored version of Qwen/Qwen3.5-397B-A17B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlibrary_name: transformers\nlicense: apache-2.0\nlicense_link: https://huggingface.co/Qwen/Qwen3.5-397B-A17B/blob/main/LICENSE\npipeline_tag: image-text-to-text\nbase_model:\n- Qwen/Qwen3.5-397B-A17B\ntags:\n- abliterated\n- uncensored\n- GGUF\n\nextra_gated_prompt: >-\n    **Usage Warnings**\n\n\n    “**Risk of Sensitive or Controversial Outputs**“: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.\n\n    “**Not Suitable for All Audiences**:“ Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.\n\n    “**Legal and Ethical Responsibilities**“: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.\n\n    “**Research and Experimental Use**“: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.\n\n    “**Monitoring and Review Recommendations**“: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.\n\n    “**No Default Safety Guarantees**“: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.\n\n\n---\n\n# huihui-ai/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF\n\n\nThis is an uncensored version of [Qwen/Qwen3.5-397B-A17B](https://huggingface.co/Qwen/Qwen3.5-397B-A17B) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).\nThis is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. \n\n## Download and merge \n\n\nUse the [llama.cpp](https://github.com/ggml-org/llama.cpp) split program to merge model (llama-gguf-split needs to be compiled.),\n\n```\nhuggingface-cli download huihui-ai/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF --local-dir ./huihui-ai/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF --token xxx\n\n\nllama-gguf-split --merge huihui-ai/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF/Q3_K-GGUF/Q3_K-GGUF-00001-of-00021.gguf huihui-ai/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF/ggml-model-Q3_K.gguf\n\n```\n\n## chat_template-vl-think.jinja\n\nWe have added a new file named [chat_template-vl-think.jinja](https://huggingface.co/huihui-ai/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF/blob/main/chat_template-vl-think.jinja), which comes from the path `huihui-ai/Huihui-Qwen3-VL-30B-A3B-Thinking-abliterated`. This template file supports the think mode.\n\nThe new file chat_template-vl.jinja is more compatible with using Tool Calling in [llama-server](https://github.com/ggml-org/llama.cpp/releases), \nespecially when [opencode](https://github.com/anomalyco/opencode/releases) and [oh-my-opencode](https://github.com/code-yeongyu/oh-my-opencode/releases)is involved.\n\nThis will help prevent 500 error messages from occurring in the llama-server.\n\n```\nllama-server -m huihui-ai/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF/ggml-model-Q3_K.gguf --port 8080 --host 0.0.0.0 -c 262144 --chat-template-file huihui-ai/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF/chat_template-vl-think.jinja\n```\nThe following are the relevant configurations for openconde.json used in a Docker environment.\n\n```\n{\n  \"$schema\": \"https://opencode.ai/config.json\",\n  \"provider\": {\n    \"llama-server\": {\n      \"npm\": \"@ai-sdk/openai-compatible\",\n      \"name\": \"llama-server\",\n      \"options\": {\n        \"baseURL\": \"http://host.docker.internal:8080/v1\"\n      },\n      \"models\": {\n         \"Huihui-Qwen3.5-397B-A17B-abliterated-Q3_K\": {\n          \"name\": \"Huihui-Qwen3.5-397B-A17B-abliterated-Q3_K\",\n          \"tools\": true,\n          \"reasoning\": true,\n          \"options\": {\n            \"num_ctx\": 262144\n          }\n        }\n      }\n    }\n  }\n}\n```\n\n\n### Usage Warnings\n\n\n - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.\n\n - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.\n\n - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.\n\n - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.\n\n - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.\n\n - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.\n\n\n### Donation\n\nIf you like it, please click 'like' and follow us for more updates.  \nYou can follow [x.com/support_huihui](https://x.com/support_huihui) to get the latest model information from huihui.ai.\n\n##### Your donation helps us continue our further development and improvement, a cup of coffee can do it.\n- bitcoin（BTC):\n```\n  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge\n```\n- Support our work on Ko-fi (https://ko-fi.com/huihuiai)!\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "abliterated",
    "uncensored",
    "GGUF",
    "image-text-to-text",
    "base_model:Qwen/Qwen3.5-397B-A17B",
    "base_model:quantized:Qwen/Qwen3.5-397B-A17B",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 522,
  "gated": false,
  "private": false,
  "last_modified": "2026-03-26T18:43:06.000Z",
  "created_at": "2026-03-26T18:43:06.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": "transformers"
}

{
  "_id": "69c57e3ae23041c4c615802f",
  "id": "nicolasmatta1/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF",
  "modelId": "nicolasmatta1/Huihui-Qwen3.5-397B-A17B-abliterated-GGUF",
  "sha": "4f45ad5f166e946adb4077377fb6d204871851cc",
  "createdAt": "2026-03-26T18:43:06.000Z",
  "lastModified": "2026-03-26T18:43:06.000Z",
  "author": "nicolasmatta1",
  "downloads": 522,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "transformers",
  "siblings_count": 25
}