novelaide/Qwen3.5-9B-Q4_K_M-GGUF overview
Qwen3.5 9B Q4 K M GGUF This repository contains the exact immutable local model asset used by NovelAide. Provenance Base model: Qwen/Qwen3.5 9B https://hugging…
Runs locally from ~5.24 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | novelaide/Qwen3.5-9B-Q4_K_M-GGUF |
|---|---|
| Author | novelaide |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | Qwen/Qwen3.5-9B |
| Last modified | 2026-07-26T13:53:11.000Z |
Model README
---
license: apache-2.0
base_model: Qwen/Qwen3.5-9B
pipeline_tag: text-generation
tags:
- gguf
- text-generation
- quantized
- multilingual
---
Qwen3.5 9B Q4_K_M GGUF
This repository contains the exact immutable local-model asset used by
NovelAide.
Provenance
- Base model:
Qwen/Qwen3.5-9B - Asset source:
lmstudio-community/Qwen3.5-9B-GGUF - Pinned source revision:
1379f25c6b505a3fc737bd7818cb09389cf807c1 - Runtime:
llama-cpp - NovelAide asset ID:
qwen3.5-9b-q4-k-m - NovelAide CDN prefix:
qwen3.5-9b-gguf
The base model is Qwen/Qwen3.5-9B; NovelAide consumes the LM Studio community
GGUF quantization lmstudio-community/Qwen3.5-9B-GGUF.
Files
The NovelAide local package includes an upstream README.md. Hugging Face reserves that path for this model card, so the original bytes are published as UPSTREAM_README.md; its size and SHA-256 below remain unchanged.
| File | Size | SHA-256 |
| --- | ---: | --- |
| UPSTREAM_README.md | 0.00 MiB | 96c83488a77028fe35234a401cb6166102701e3ae4593d692e7ec5f53eb5a6a9 |
| Qwen3.5-9B-Q4_K_M.gguf | 5366.37 MiB | cd76ec205963b3b33350093e6904d9de16c4e666fd104e1f632d25c7f15f2a13 |
Usage
Use the GGUF files with a compatible llama.cpp runtime and the ONNX files with
a compatible ONNX / Transformers.js runtime. NovelAide pins the exact files and
checksums shown above; do not substitute similarly named quantizations.
License and attribution
The model asset follows the upstream apache-2.0 license.
Review the linked base model and asset source model cards for their complete
terms, limitations, and attribution requirements. NovelAide is not affiliated
with or endorsed by the upstream model authors.
Run novelaide/Qwen3.5-9B-Q4_K_M-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models