noctrex/huihui-qwen3-vl-8b-instruct-abliterated-i1-gguf overview

{
  "metadata": {},
  "card_data": {
    "pipeline_tag": "image-text-to-text",
    "base_model": [
      "huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated"
    ],
    "frontmatter": {
      "pipeline_tag": "image-text-to-text",
      "base_model": [
        "huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated"
      ]
    },
    "hero_image_url": "",
    "summary": "These are quantizations of the model Huihui-Qwen3-VL-8B-Instruct-abliterated. These quantizations were created using an imatrix merged from combined\\_all\\_large and harmful.txt to leverage the abliterated nature of the model. For higher precision versions (which are not in an need for an imatrix), please refer to the main repository: noctrex/Huihui-Qwen3-VL-8B-Instruct-abliterated-GGUF **Usage Notes:**",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\npipeline_tag: image-text-to-text\nbase_model:\n- huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated\n---\nThese are quantizations of the model [Huihui-Qwen3-VL-8B-Instruct-abliterated](https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated).\n\nThese quantizations were created using an imatrix merged from [combined\\_all\\_large](https://huggingface.co/datasets/eaddario/imatrix-calibration/blob/main/combined_all_large.parquet) and [harmful.txt](https://github.com/Sumandora/remove-refusals-with-transformers) to leverage the abliterated nature of the model.\n\nFor higher precision versions (which are not in an need for an imatrix), please refer to the main repository:\n[noctrex/Huihui-Qwen3-VL-8B-Instruct-abliterated-GGUF](https://huggingface.co/noctrex/Huihui-Qwen3-VL-8B-Instruct-abliterated-GGUF)\n\n**Usage Notes:**\n- Download the latest [llama.cpp](https://github.com/ggml-org/llama.cpp) to use these quantizations.\n- Try to use the best quality you can run.\n- For the `mmproj` file, the F32 version is recommended for best results (F32 > BF16 > F16).\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "image-text-to-text",
    "base_model:huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated",
    "base_model:quantized:huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated",
    "endpoints_compatible",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 0,
  "downloads": 506,
  "gated": false,
  "private": false,
  "last_modified": "2025-11-09T10:19:05.000Z",
  "created_at": "2025-11-09T09:17:57.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": ""
}

{
  "_id": "69105c45e53ceecc2f111699",
  "id": "noctrex/Huihui-Qwen3-VL-8B-Instruct-abliterated-i1-GGUF",
  "modelId": "noctrex/Huihui-Qwen3-VL-8B-Instruct-abliterated-i1-GGUF",
  "sha": "2a3bb454d9e12e9051b9837abd431e7132f966f9",
  "createdAt": "2025-11-09T09:17:57.000Z",
  "lastModified": "2025-11-09T10:19:05.000Z",
  "author": "noctrex",
  "downloads": 506,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "",
  "siblings_count": 17
}