GraySoft
Projects Models About FAQ Contact Download guIDE →
Model Intelligence Sheet

noctrex/huihui-qwen3-vl-2b-thinking-abliterated-gguf overview

These are quantizations of the model Huihui-Qwen3-VL-2B-Thinking-abliterated. These quantizations were created using an imatrix merged from combined\all\large and harmful.txt to leverage the abliterated nature of the model. Usage Notes:

ggufimage-text-to-textbase_model:huihui-ai/Huihui-Qwen3-VL-2B-Thinking-abliteratedbase_model:quantized:huihui-ai/Huihui-Qwen3-VL-2B-Thinking-abliteratedendpoints_compatibleregion:usconversational
noctrex/huihui-qwen3-vl-2b-thinking-abliterated-gguf visual
Downloads
172
Likes
1
Pipeline
image-text-to-text
Library
Visibility
Public
Access
Open

Repository Files & Downloads

19 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Huihui-Qwen3-VL-2B-Thinking-abliterated-BF16.gguf GGUF BF16 3.21 GB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-F16.gguf GGUF F16 3.21 GB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-F32.gguf GGUF F32 6.42 GB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-IQ3_M.gguf GGUF IQ3_M 854.17 MB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-IQ3_S.gguf GGUF IQ3_S 827.08 MB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-IQ3_XS.gguf GGUF IQ3_XS 795.58 MB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-IQ3_XXS.gguf GGUF IQ3_XXS 719.42 MB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-IQ4_NL.gguf GGUF IQ4_NL 1005.58 MB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-IQ4_XS.gguf GGUF IQ4_XS 963.58 MB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-Q4_K_M.gguf GGUF Q4_K_M 1.03 GB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-Q4_K_S.gguf GGUF Q4_K_S 1011.08 MB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-Q5_K_M.gguf GGUF Q5_K_M 1.17 GB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-Q5_K_S.gguf GGUF Q5_K_S 1.15 GB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-Q6_K.gguf GGUF Q6_K 1.32 GB Download
Huihui-Qwen3-VL-2B-Thinking-abliterated-Q8_0.gguf GGUF 1.71 GB Download
imatrix.gguf GGUF 2.00 MB Download
mmproj-BF16.gguf GGUF BF16 784.44 MB Download
mmproj-F16.gguf GGUF F16 781.44 MB Download
mmproj-F32.gguf GGUF F32 1.52 GB Download

Model Details Live

Model Slug
noctrex/huihui-qwen3-vl-2b-thinking-abliterated-gguf
Author
noctrex
Pipeline Task
image-text-to-text
Library
Created
2025-11-02
Last Modified
2025-11-08
Gated
No
Private
No
HF SHA
4005d3b080aec8e88426daae6c52718eedf34707
License
Unknown
Language
Unknown
Base Model
huihui-ai/Huihui-Qwen3-VL-2B-Thinking-abliterated

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "frontmatter": {
      "pipeline_tag": "image-text-to-text",
      "base_model": [
        "huihui-ai/Huihui-Qwen3-VL-2B-Thinking-abliterated"
      ]
    },
    "hero_image_url": "",
    "summary": "These are quantizations of the model Huihui-Qwen3-VL-2B-Thinking-abliterated. These quantizations were created using an imatrix merged from combined\\_all\\_large and harmful.txt to leverage the abliterated nature of the model. **Usage Notes:**",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\npipeline_tag: image-text-to-text\nbase_model:\n- huihui-ai/Huihui-Qwen3-VL-2B-Thinking-abliterated\n---\nThese are quantizations of the model [Huihui-Qwen3-VL-2B-Thinking-abliterated](https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-2B-Thinking-abliterated).\n\nThese quantizations were created using an imatrix merged from [combined\\_all\\_large](https://huggingface.co/datasets/eaddario/imatrix-calibration/blob/main/combined_all_large.parquet) and [harmful.txt](https://github.com/Sumandora/remove-refusals-with-transformers) to leverage the abliterated nature of the model.\n\n**Usage Notes:**\n- Download the latest [llama.cpp](https://github.com/ggml-org/llama.cpp) to use these quantizations.\n- Try to use the best quality you can run.\n- For the `mmproj` file, the F32 version is recommended for best results (F32 > BF16 > F16).\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "image-text-to-text",
    "base_model:huihui-ai/Huihui-Qwen3-VL-2B-Thinking-abliterated",
    "base_model:quantized:huihui-ai/Huihui-Qwen3-VL-2B-Thinking-abliterated",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 1,
  "downloads": 172,
  "gated": false,
  "private": false,
  "last_modified": "2025-11-08T23:33:32.000Z",
  "created_at": "2025-11-02T00:48:32.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "6906aa607c02bc91135be8b5",
  "id": "noctrex/Huihui-Qwen3-VL-2B-Thinking-abliterated-GGUF",
  "modelId": "noctrex/Huihui-Qwen3-VL-2B-Thinking-abliterated-GGUF",
  "sha": "4005d3b080aec8e88426daae6c52718eedf34707",
  "createdAt": "2025-11-02T00:48:32.000Z",
  "lastModified": "2025-11-08T23:33:32.000Z",
  "author": "noctrex",
  "downloads": 172,
  "likes": 1,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "",
  "siblings_count": 21
}