lainlives/qwen3.5-9b-claude-4.6-highiq-instruct-heretic-uncensored-gguf Q4_K_S GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
lainlives/qwen3.5-9b-claude-4.6-highiq-instruct-heretic-uncensored-gguf overview
This model contains GGUF format model files for DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED. ### Available Quants The following files were generated and uploaded to this repo: Q40, Q4KS, Q4KM, Q50, Q5KS, Q5KM, Q6K, Q80, f16, bf16 ### Use with llama.cpp CLI: Server:
Downloads
502
Likes
1
Pipeline
image-text-to-text
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
10 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q4_0.gguf | GGUF | — | 4.95 GB | Download |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q4_K_M.gguf | GGUF | Q4_K_M | 5.24 GB | Download |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q4_K_S.gguf | GGUF | Q4_K_S | 4.97 GB | Download |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q5_0.gguf | GGUF | — | 5.87 GB | Download |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q5_K_M.gguf | GGUF | Q5_K_M | 6.07 GB | Download |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q5_K_S.gguf | GGUF | Q5_K_S | 5.87 GB | Download |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q6_K.gguf | GGUF | Q6_K | 6.85 GB | Download |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q8_0.gguf | GGUF | — | 8.87 GB | Download |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-bf16.gguf | GGUF | BF16 | 16.69 GB | Download |
| Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-f16.gguf | GGUF | F16 | 16.69 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"language": [
"en",
"zh"
],
"license": "apache-2.0",
"tags": [
"fine tune",
"creative",
"creative writing",
"fiction writing",
"plot generation",
"sub-plot generation",
"story generation",
"scene continue",
"storytelling",
"fiction story",
"science fiction",
"romance",
"all genres",
"story",
"writing",
"vivid prosing",
"vivid writing",
"fiction",
"roleplaying",
"bfloat16",
"all use cases",
"unsloth",
"heretic",
"uncensored",
"abliterated",
"llama-cpp",
"gguf-my-repo"
],
"library_name": "transformers",
"pipeline_tag": "image-text-to-text",
"base_model": "DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED",
"frontmatter": {
"language": [
"en",
"zh"
],
"license": "apache-2.0",
"tags": [
"fine tune",
"creative",
"creative writing",
"fiction writing",
"plot generation",
"sub-plot generation",
"story generation",
"scene continue",
"storytelling",
"fiction story",
"science fiction",
"romance",
"all genres",
"story",
"writing",
"vivid prosing",
"vivid writing",
"fiction",
"roleplaying",
"bfloat16",
"all use cases",
"unsloth",
"heretic",
"uncensored",
"abliterated",
"llama-cpp",
"gguf-my-repo"
],
"library_name": "transformers",
"pipeline_tag": "image-text-to-text",
"base_model": "DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED"
},
"hero_image_url": "",
"summary": "This model contains GGUF format model files for DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED. ### Available Quants The following files were generated and uploaded to this repo: Q4_0, Q4_K_S, Q4_K_M, Q5_0, Q5_K_S, Q5_K_M, Q6_K, Q8_0, f16, bf16 ### Use with llama.cpp ``bash brew install llama.cpp ` CLI: `bash llama-cli --hf-repo lainlives/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-GGUF --hf-file Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q4_K_M.gguf -p \"The meaning to life and the universe is\" ` Server: `bash llama-server --hf-repo lainlives/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-GGUF --hf-file Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q4_K_M.gguf -c 2048 ``",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlanguage:\n- en\n- zh\nlicense: apache-2.0\ntags:\n- fine tune\n- creative\n- creative writing\n- fiction writing\n- plot generation\n- sub-plot generation\n- story generation\n- scene continue\n- storytelling\n- fiction story\n- science fiction\n- romance\n- all genres\n- story\n- writing\n- vivid prosing\n- vivid writing\n- fiction\n- roleplaying\n- bfloat16\n- all use cases\n- unsloth\n- heretic\n- uncensored\n- abliterated\n- llama-cpp\n- gguf-my-repo\nlibrary_name: transformers\npipeline_tag: image-text-to-text\nbase_model: DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED\n---\n\n# lainlives/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-GGUF\nThis model contains GGUF format model files for [`DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED`](https://huggingface.co/DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED).\n\n### Available Quants\nThe following files were generated and uploaded to this repo:\n`Q4_0`, `Q4_K_S`, `Q4_K_M`, `Q5_0`, `Q5_K_S`, `Q5_K_M`, `Q6_K`, `Q8_0`, `f16`, `bf16`\n\n### Use with llama.cpp\n```bash\nbrew install llama.cpp\n```\n\nCLI:\n```bash\nllama-cli --hf-repo lainlives/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-GGUF --hf-file Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q4_K_M.gguf -p \"The meaning to life and the universe is\"\n```\n\nServer:\n```bash\nllama-server --hf-repo lainlives/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-GGUF --hf-file Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-Q4_K_M.gguf -c 2048\n```\n",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"fine tune",
"creative",
"creative writing",
"fiction writing",
"plot generation",
"sub-plot generation",
"story generation",
"scene continue",
"storytelling",
"fiction story",
"science fiction",
"romance",
"all genres",
"story",
"writing",
"vivid prosing",
"vivid writing",
"fiction",
"roleplaying",
"bfloat16",
"all use cases",
"unsloth",
"heretic",
"uncensored",
"abliterated",
"llama-cpp",
"gguf-my-repo",
"image-text-to-text",
"en",
"zh",
"base_model:DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED",
"base_model:quantized:DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED",
"license:apache-2.0",
"endpoints_compatible",
"region:us"
],
"likes": 1,
"downloads": 502,
"gated": false,
"private": false,
"last_modified": "2026-03-08T06:05:04.000Z",
"created_at": "2026-03-08T04:43:55.000Z",
"pipeline_tag": "image-text-to-text",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "69acfe8b983183fd6744400e",
"id": "lainlives/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-GGUF",
"modelId": "lainlives/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-GGUF",
"sha": "9c53b30b0e935c68af0e13e74f0001b9d4c7c6f0",
"createdAt": "2026-03-08T04:43:55.000Z",
"lastModified": "2026-03-08T06:05:04.000Z",
"author": "lainlives",
"downloads": 502,
"likes": 1,
"gated": false,
"private": false,
"pipeline_tag": "image-text-to-text",
"library_name": "transformers",
"siblings_count": 12
}