GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

DarkKitsune/qwen3.5-9b-qworus-Q5-imat-GGUF overview

language: en base model: DarkKitsune/qwen3.5 9b qworus base model relation: quantized library name: llama.cpp pipeline tag: text generation tags: gguf quantize…

llama.cppsafetensorsggufqwen3_5quantizedqwen3.5uncensoredagentcodingcodeornithqwythosreasoninglong-contexttool-usetext-generationenbase_model:DarkKitsune/qwen3.5-9b-qworusbase_model:quantized:DarkKitsune/qwen3.5-9b-qworusendpoints_compatibleregion:usimatrix

Runs locally from ~4.9 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
424
Likes
0
Pipeline
text-generation

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
imatrix.ggufGGUFGGUF4.9 MBDownload
qwen3.5-9b-qworus-Q5_K_L-imat-GGUF.ggufGGUFQ5_K_L6.76 GBDownload
qwen3.5-9b-qworus-Q5_K_M-imat-GGUF.ggufGGUFQ5_K_M6.17 GBDownload

Model Details

Model IDDarkKitsune/qwen3.5-9b-qworus-Q5-imat-GGUF
AuthorDarkKitsune
Pipelinetext-generation
License
Base modelDarkKitsune/qwen3.5-9b-qworus
Last modified2026-07-21T17:37:19.000Z

Model README

---

language:

  • en

base_model:

  • DarkKitsune/qwen3.5-9b-qworus

base_model_relation: quantized

library_name: llama.cpp

pipeline_tag: text-generation

tags:

  • gguf
  • quantized
  • qwen3.5
  • uncensored
  • agent
  • coding
  • code
  • ornith
  • qwythos
  • reasoning
  • long-context
  • tool-use

---

qwen3.5-9b-qworus-Q5-imat-GGUF

GGUF quantization of my merge qwen3.5-9b coding model DarkKitsune/qwen3.5-9b-qworus to Q5_K_M and Q5_K_L with importance matrices.

Q5_K_M: The best option for 8 GB GPUs. Configured with BF16 for ssm_alpha and ssm_beta weights, Q8_0 for ssm_out weights, and the default llama.cpp Q5_K_M config for all other weights.

This provides high precision for coding agentic work while having a smaller memory footprint.

Q5_K_L: The best option for 12+ GB GPUs. Configured with Q8_0 for token embedding and output weights, BF16 for ssm_alpha and ssm_beta weights, Q8_0 for ssm_out weights, and the default llama.cpp Q5_K_M config for all other weights.

This trades a higher memory footprint for higher precision in tensors that may be sensitive to quantization when working with very long contexts.

This model is also decensored, due to the fact that both source models in the merge were already decensored.

---

Original Model Card Below:

---

qwen3.5-9b-qworus

60/40 DARE-TIES of empero-ai/Qwythos-9B-v2 and PeppX/Ornith-1.0-9B-Uncensored. This merge exists because I find Qwythos to be excellent for its genuine stability and its ability to bug fix based on stderr output, but Ornith is better in its ability to set up a well-organized project with scalability in mind. So my goal is to cleanly combine the abilities of both.

Both source models are decensored, so this merge is decensored by default as well. It may inherit Qwythos' 1M context support due to using it as the base model, but I don't have the resources to actually test 1M tokens. The MTP head is also most likely not retained.

This model is for testing, and not intended to be used for any serious projects.

---

Mergekit

The following YAML configuration was used to produce this model:

merge_method: dare_ties
base_model: empero-ai/Qwythos-9B-v2

models:
  - model: empero-ai/Qwythos-9B-v2
    parameters:
      weight: 0.6
      density: 0.53

  - model: PeppX/Ornith-1.0-9B-Uncensored
    parameters:
      weight: 0.4
      density: 0.53

parameters:
  normalize: true
  int8_mask: true

dtype: bfloat16

Run DarkKitsune/qwen3.5-9b-qworus-Q5-imat-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models