cesarsal1nas/huihui-qwen3.5-35b-a3b-claude-4.6-opus-abliterated-q4_k_m-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "apache-2.0",
    "base_model": "huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated",
    "tags": [
      "gguf",
      "abliterated",
      "uncensored",
      "conversational",
      "qwen3_5_moe",
      "llama-cpp",
      "vision",
      "multimodal",
      "claude-style"
    ],
    "library_name": "gguf",
    "pipeline_tag": "image-text-to-text",
    "frontmatter": {
      "license": "apache-2.0",
      "base_model": "huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated",
      "tags": [
        "gguf",
        "abliterated",
        "uncensored",
        "conversational",
        "qwen3_5_moe",
        "llama-cpp",
        "vision",
        "multimodal",
        "claude-style"
      ],
      "library_name": "gguf",
      "pipeline_tag": "image-text-to-text"
    },
    "hero_image_url": "",
    "summary": "This is a Q4_K_M GGUF quantization of huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated. Refer to the original model card for full details, usage warnings, and licensing information. This is a Qwen3.5-35B-A3B MoE model that has been:",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: apache-2.0\nbase_model: huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated\ntags:\n  - gguf\n  - abliterated\n  - uncensored\n  - conversational\n  - qwen3_5_moe\n  - llama-cpp\n  - vision\n  - multimodal\n  - claude-style\nlibrary_name: gguf\npipeline_tag: image-text-to-text\n---\n\n# Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated — Q4_K_M GGUF\n\n- **This model has been tested by myself in Hermes Agent, it does everything it is supposed to, text, coding, vision, thinking, tools usage, everything works perfectly well so far there. I have also found that this very specific Opus 4.6 Distillation does not use as many emojis as the non-Opus one, which is wave:great.**\n\nThis is a Q4_K_M GGUF quantization of [huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated](https://huggingface.co/huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated).\n\nRefer to the [original model card](https://huggingface.co/huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated) for full details, usage warnings, and licensing information.\n\nThis is a Qwen3.5-35B-A3B MoE model that has been:\n- **Fine-tuned in Claude 4.6 Opus style** — targets Claude Opus-level instruction following, reasoning depth, and structured output quality\n- **Abliterated** — refusal mechanisms removed; no alignment restrictions\n- **Vision-capable** — the original weights include a full vision encoder (`preprocessor_config.json`, `video_preprocessor_config.json`); an mmproj file can be generated from the source safetensors for multimodal use\n \n## Files\n\n| File | Size | Description |\n|---|---|---|\n| `Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf` | ~20 GB | Main text model (Q4_K_M) |\n| `Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mmproj-F16.gguf` | ~858 MB | Vision projector for image input |\n\n## Details\n\n| | |\n|---|---|\n| Source model | [huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated](https://huggingface.co/huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated) |\n| Architecture | qwen35moe (35B total params, ~3B active; 256 experts, 8 active per token) |\n| Quantization | Q4_K_M (~4.88 BPW) |\n| File size | ~20 GB + 858 MB mmproj |\n| Quantized with | llama.cpp b8352 |\n| Context length | 262,144 tokens (trained) |\n\n## Usage with llama.cpp\n\n```bash\nllama-cli \\\n  --hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF \\\n  --hf-file Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \\\n  -p \"Tell me about the universe\"\n```\n\n```bash\nllama-server \\\n  --hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF \\\n  --hf-file Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \\\n  -c 131072\n```\n\n### With vision (image input)\n\n```bash\nllama-server \\\n  --hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF \\\n  --hf-file Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \\\n  --mmproj Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mmproj-F16.gguf \\\n  -c 131072\n```\n\n## Usage with Ollama\n\n```bash\nollama run hf.co/cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF\n```\n\n## Credits\n\n- Fine-tune + abliteration by [huihui-ai](https://huggingface.co/huihui-ai) — [Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated](https://huggingface.co/huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated)\n- Base model by [Qwen](https://huggingface.co/Qwen) — [Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B)\n- [Hermes Agent](https://github.com/NousResearch/hermes-agent) (as mentioned in the model card) by [NousResearch](https://github.com/NousResearch)",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "abliterated",
    "uncensored",
    "conversational",
    "qwen3_5_moe",
    "llama-cpp",
    "vision",
    "multimodal",
    "claude-style",
    "image-text-to-text",
    "base_model:huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated",
    "base_model:quantized:huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 6,
  "downloads": 4975,
  "gated": false,
  "private": false,
  "last_modified": "2026-03-17T22:31:56.000Z",
  "created_at": "2026-03-17T08:00:34.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": "gguf"
}

{
  "_id": "69b90a2288bd4bd1a093cd6d",
  "id": "cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF",
  "modelId": "cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF",
  "sha": "e1cd368e7064c20756a6ce838f06df15950b2851",
  "createdAt": "2026-03-17T08:00:34.000Z",
  "lastModified": "2026-03-17T22:31:56.000Z",
  "author": "cesarsal1nas",
  "downloads": 4975,
  "likes": 6,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "gguf",
  "siblings_count": 4
}