prithivmlmods/qwen3-vl-4b-instruct-abliterated-v1-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "apache-2.0",
    "language": [
      "en"
    ],
    "base_model": [
      "prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1"
    ],
    "pipeline_tag": "image-text-to-text",
    "library_name": "transformers",
    "tags": [
      "text-generation-inference",
      "abliterated",
      "llama.cpp"
    ],
    "frontmatter": {
      "license": "apache-2.0",
      "language": [
        "en"
      ],
      "base_model": [
        "prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1"
      ],
      "pipeline_tag": "image-text-to-text",
      "library_name": "transformers",
      "tags": [
        "text-generation-inference",
        "abliterated",
        "llama.cpp"
      ]
    },
    "hero_image_url": "https://www.nethype.de/huggingface_embed/quantpplgraph.png",
    "summary": "> The Qwen3-VL-4B-Instruct-abliterated-v1 from prithivMLmods is a 4B-parameter vision-language model variant of Alibaba's Qwen3-VL-4B-Instruct, modified through abliteration (v1.0) to remove safety refusals and content filters, enabling uncensored, detailed captioning, reasoning, and instruction-following across complex, sensitive, artistic, technical, or abstract visual content while preserving the base model's advanced multimodal capabilities like 32-language OCR, long-context (up to 256K tokens), video understanding, and robust handling of diverse resolutions/aspect ratios. Tailored for high-fidelity descriptions with variational detail control—from concise summaries to intricate analyses—it excels in UI parsing, document extraction, chart interpretation, and agentic tasks without conventional guardrails, primarily in English with multilingual prompt adaptability for research, red-teaming, and creative applications. This abliterated version delivers factual, descriptive outputs on consumer GPUs (10-12GB VRAM BF16, faster quantized), supporting vLLM/Transformers inference for unrestricted visual reasoning.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: apache-2.0\nlanguage:\n- en\nbase_model:\n- prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1\npipeline_tag: image-text-to-text\nlibrary_name: transformers\ntags:\n- text-generation-inference\n- abliterated\n- llama.cpp\n---\n\n# **Qwen3-VL-4B-Instruct-abliterated-v1-GGUF**\n\n> The Qwen3-VL-4B-Instruct-abliterated-v1 from prithivMLmods is a 4B-parameter vision-language model variant of Alibaba's Qwen3-VL-4B-Instruct, modified through abliteration (v1.0) to remove safety refusals and content filters, enabling uncensored, detailed captioning, reasoning, and instruction-following across complex, sensitive, artistic, technical, or abstract visual content while preserving the base model's advanced multimodal capabilities like 32-language OCR, long-context (up to 256K tokens), video understanding, and robust handling of diverse resolutions/aspect ratios. Tailored for high-fidelity descriptions with variational detail control—from concise summaries to intricate analyses—it excels in UI parsing, document extraction, chart interpretation, and agentic tasks without conventional guardrails, primarily in English with multilingual prompt adaptability for research, red-teaming, and creative applications. This abliterated version delivers factual, descriptive outputs on consumer GPUs (10-12GB VRAM BF16, faster quantized), supporting vLLM/Transformers inference for unrestricted visual reasoning.\n\n## Qwen3-VL-4B-Instruct-abliterated-v1 [GGUF]\n\n| File Name | Quant Type | File Size | File Link |\n| - | - | - | - |\n| Qwen3-VL-4B-Instruct-abliterated-v1.IQ4_XS.gguf | IQ4_XS | 2.29 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.IQ4_XS.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q2_K.gguf | Q2_K | 1.67 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q2_K.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q3_K_L.gguf | Q3_K_L | 2.24 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q3_K_L.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q3_K_M.gguf | Q3_K_M | 2.08 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q3_K_M.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q3_K_S.gguf | Q3_K_S | 1.89 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q3_K_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q4_K_M.gguf | Q4_K_M | 2.5 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q4_K_M.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q4_K_S.gguf | Q4_K_S | 2.38 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q4_K_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q5_K_M.gguf | Q5_K_M | 2.89 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q5_K_M.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q5_K_S.gguf | Q5_K_S | 2.82 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q5_K_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q6_K.gguf | Q6_K | 3.31 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q6_K.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.Q8_0.gguf | Q8_0 | 4.28 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.Q8_0.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.f16.gguf | F16 | 8.05 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.f16.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ1_M.gguf | i1-IQ1_M | 1.13 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ1_M.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ1_S.gguf | i1-IQ1_S | 1.06 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ1_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_M.gguf | i1-IQ2_M | 1.51 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_M.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_S.gguf | i1-IQ2_S | 1.42 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_XS.gguf | i1-IQ2_XS | 1.35 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_XS.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf | i1-IQ2_XXS | 1.25 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_M.gguf | i1-IQ3_M | 1.96 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_M.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_S.gguf | i1-IQ3_S | 1.9 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_XS.gguf | i1-IQ3_XS | 1.81 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_XS.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf | i1-IQ3_XXS | 1.67 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ4_NL.gguf | i1-IQ4_NL | 2.38 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ4_NL.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ4_XS.gguf | i1-IQ4_XS | 2.27 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-IQ4_XS.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q2_K.gguf | i1-Q2_K | 1.67 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q2_K.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q2_K_S.gguf | i1-Q2_K_S | 1.56 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q2_K_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q3_K_L.gguf | i1-Q3_K_L | 2.24 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q3_K_L.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q3_K_M.gguf | i1-Q3_K_M | 2.08 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q3_K_M.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q3_K_S.gguf | i1-Q3_K_S | 1.89 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q3_K_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_0.gguf | i1-Q4_0 | 2.38 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_0.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_1.gguf | i1-Q4_1 | 2.6 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_1.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_K_M.gguf | i1-Q4_K_M | 2.5 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_K_M.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_K_S.gguf | i1-Q4_K_S | 2.38 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q4_K_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q5_K_M.gguf | i1-Q5_K_M | 2.89 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q5_K_M.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q5_K_S.gguf | i1-Q5_K_S | 2.82 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q5_K_S.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q6_K.gguf | i1-Q6_K | 3.31 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.i1-Q6_K.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.imatrix.gguf | imatrix | 3.87 MB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.imatrix.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.mmproj-Q8_0.gguf | mmproj-Q8_0 | 454 MB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.mmproj-Q8_0.gguf) |\n| Qwen3-VL-4B-Instruct-abliterated-v1.mmproj-f16.gguf | mmproj-f16 | 836 MB | [Download](https://huggingface.co/prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF/blob/main/Qwen3-VL-4B-Instruct-abliterated-v1.mmproj-f16.gguf) |\n\n## Quants Usage \n\n(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)\n\nHere is a handy graph by ikawrakow comparing some lower-quality quant\ntypes (lower is better):\n\n![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "qwen3_vl",
    "text-generation-inference",
    "abliterated",
    "llama.cpp",
    "image-text-to-text",
    "en",
    "base_model:prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1",
    "base_model:quantized:prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 3,
  "downloads": 1455,
  "gated": false,
  "private": false,
  "last_modified": "2025-12-15T17:14:01.000Z",
  "created_at": "2025-12-15T16:21:53.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": "transformers"
}

{
  "_id": "694035a1c9d7af74f73bc259",
  "id": "prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF",
  "modelId": "prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF",
  "sha": "01ebef1bdb1e526de60b2a992a53c5a80f1e7e85",
  "createdAt": "2025-12-15T16:21:53.000Z",
  "lastModified": "2025-12-15T17:14:01.000Z",
  "author": "prithivMLmods",
  "downloads": 1455,
  "likes": 3,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "transformers",
  "siblings_count": 42
}