GraySoft
Projects Models About FAQ Contact Download guIDE →

beinsezii/llmfan46-qwen3.5-27b-heretic-v3-gguf-6.14bpw F16 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

beinsezii/llmfan46-qwen3.5-27b-heretic-v3-gguf-6.14bpw overview

Implmements https://github.com/p-e-w/heretic/pull/211 6.14 bpw, a mixture of Q6K and Q5K_M Fits ~32k CTX + MMPROJ on a 24GiB GPU

ggufbase_model:llmfan46/Qwen3.5-27B-heretic-v3base_model:quantized:llmfan46/Qwen3.5-27B-heretic-v3license:mitendpoints_compatibleregion:usimatrixconversational
beinsezii/llmfan46-qwen3.5-27b-heretic-v3-gguf-6.14bpw visual
Downloads
353
Likes
0
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

3 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
imatrix.gguf GGUF 13.01 MB Download
llmfan46-qwen35-27b-heretic-v3-q6k-q5km_ffn.gguf GGUF 19.22 GB Download
mmproj-F16.gguf GGUF F16 884.64 MB Download

Model Details Live

Model Slug
beinsezii/llmfan46-qwen3.5-27b-heretic-v3-gguf-6.14bpw
Author
Beinsezii
Pipeline Task
Library
Created
2026-03-24
Last Modified
2026-03-24
Gated
No
Private
No
HF SHA
1a36e3efba0b99789f702edbebc9576836d5f076
License
mit
Language
Unknown
Base Model
llmfan46/Qwen3.5-27B-heretic-v3

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "mit",
    "base_model": [
      "llmfan46/Qwen3.5-27B-heretic-v3"
    ],
    "frontmatter": {
      "license": "mit",
      "base_model": [
        "llmfan46/Qwen3.5-27B-heretic-v3"
      ]
    },
    "hero_image_url": "",
    "summary": "Implmements https://github.com/p-e-w/heretic/pull/211 6.14 bpw, a mixture of Q6_K and Q5_K_M Fits ~32k CTX + MMPROJ on a 24GiB GPU",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: mit\nbase_model:\n- llmfan46/Qwen3.5-27B-heretic-v3\n---\n\nImplmements https://github.com/p-e-w/heretic/pull/211\n\n6.14 bpw, a mixture of Q6_K and Q5_K_M\n\nFits ~32k CTX + MMPROJ on a 24GiB GPU\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "base_model:llmfan46/Qwen3.5-27B-heretic-v3",
    "base_model:quantized:llmfan46/Qwen3.5-27B-heretic-v3",
    "license:mit",
    "endpoints_compatible",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 0,
  "downloads": 353,
  "gated": false,
  "private": false,
  "last_modified": "2026-03-24T22:56:54.000Z",
  "created_at": "2026-03-24T21:42:24.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "69c3054071a23dbfc2955a3c",
  "id": "Beinsezii/llmfan46-Qwen3.5-27B-heretic-v3-GGUF-6.14BPW",
  "modelId": "Beinsezii/llmfan46-Qwen3.5-27B-heretic-v3-GGUF-6.14BPW",
  "sha": "1a36e3efba0b99789f702edbebc9576836d5f076",
  "createdAt": "2026-03-24T21:42:24.000Z",
  "lastModified": "2026-03-24T22:56:54.000Z",
  "author": "Beinsezii",
  "downloads": 353,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 7
}