GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

novelaide/Qwen3.5-4B-Q4_K_M-GGUF overview

Qwen3.5 4B Q4 K M GGUF This repository contains the exact immutable local model asset used by NovelAide. Provenance Base model: Qwen/Qwen3.5 4B https://hugging…

gguftext-generationquantizedmultilingualbase_model:Qwen/Qwen3.5-4Bbase_model:quantized:Qwen/Qwen3.5-4Blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~2.52 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.5-4B-Q4_K_M.ggufGGUFQ4_K_M2.52 GBDownload
assets/Qwen3.5-4B-Q4_K_M.ggufGGUFQ4_K_M2.52 GBDownload

Model Details

Model IDnovelaide/Qwen3.5-4B-Q4_K_M-GGUF
Authornovelaide
Pipelinetext-generation
Licenseapache-2.0
Base modelQwen/Qwen3.5-4B
Last modified2026-07-26T13:52:50.000Z

Model README

---

license: apache-2.0

base_model: Qwen/Qwen3.5-4B

pipeline_tag: text-generation

tags:

  • gguf
  • text-generation
  • quantized
  • multilingual

---

Qwen3.5 4B Q4_K_M GGUF

This repository contains the exact immutable local-model asset used by

NovelAide.

Provenance

The base model is Qwen/Qwen3.5-4B; NovelAide consumes the LM Studio community

GGUF quantization lmstudio-community/Qwen3.5-4B-GGUF.

Files

The NovelAide local package includes an upstream README.md. Hugging Face reserves that path for this model card, so the original bytes are published as UPSTREAM_README.md; its size and SHA-256 below remain unchanged.

| File | Size | SHA-256 |

| --- | ---: | --- |

| UPSTREAM_README.md | 0.00 MiB | e1b3ca9c804ec81f9d0f8e51eab46d4e0e1b18521e7436bcb95736fb3d0414ae |

| Qwen3.5-4B-Q4_K_M.gguf | 2582.09 MiB | 25082a7dd3776cc3c741c6347d3bd04523f05796607b3fbc32fa3a25dfa1418c |

Usage

Use the GGUF files with a compatible llama.cpp runtime and the ONNX files with

a compatible ONNX / Transformers.js runtime. NovelAide pins the exact files and

checksums shown above; do not substitute similarly named quantizations.

License and attribution

The model asset follows the upstream apache-2.0 license.

Review the linked base model and asset source model cards for their complete

terms, limitations, and attribution requirements. NovelAide is not affiliated

with or endorsed by the upstream model authors.

Run novelaide/Qwen3.5-4B-Q4_K_M-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models