twoody/Qwen3.5-4B-GGUF overview
Qwen3.5 4B — GGUF Q4 K M, for Twoody Qwen/Qwen3.5 4B https://huggingface.co/Qwen/Qwen3.5 4B , converted to GGUF and quantised to Q4 K M by Osmove https://www.o…
Runs locally from ~641.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | twoody/Qwen3.5-4B-GGUF |
|---|---|
| Author | twoody |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | Qwen/Qwen3.5-4B |
| Last modified | 2026-10-01T22:23:25.000Z |
Model README
---
license: apache-2.0
base_model: Qwen/Qwen3.5-4B
base_model_relation: quantized
pipeline_tag: text-generation
library_name: gguf
tags:
- gguf
- llama.cpp
- twoody
---
Qwen3.5-4B — GGUF Q4_K_M, for Twoody
Qwen/Qwen3.5-4B, converted to GGUF and quantised to
Q4_K_M by Osmove for
Twoody, the free AI that runs on your own computer.
It is the file Twoody installs in one click, and it runs with any app built
on llama.cpp.
| File | Size | SHA-256 |
|---|---|---|
| Qwen3.5-4B-Q4_K_M.gguf | 2783446880 bytes | b7508d8b4a652bc020a439aafdd4ce1527d49774865ce3334a43b16dbeaa90ca |
How it was made
- Weights: Qwen/Qwen3.5-4B at revision
851bf6e806efd8d0a36b00ddf55e13ccb7b8cd0a, the publisher's own.
- Tools: llama.cpp
b11146, the release Twoody ships. The weights were
converted to BF16 (convert_hf_to_gguf.py --remote Qwen/Qwen3.5-4B --outtype bf16),
then quantised (llama-quantize … Q4_K_M), with no importance matrix.
The converter's defaults were kept.
- Anyone can make it again with the same weights and the same llama.cpp
release, and compare the SHA-256.
Nothing was changed in the model beyond this conversion: its behaviour, its
limits and its licence are the original's.
Licence
apache-2.0, as the original model — see LICENSE, copied from
Vision
mmproj-F16.gguf (672423488 bytes, SHA-256 d293cd66fd524937c9bd5f37e802d5cdab553eae3d53979a1c02eb6d9e81b6ea) is the model's vision part, so that
it reads images: converted by Osmove from Qwen/Qwen3.5-4B
at revision 851bf6e806efd8d0a36b00ddf55e13ccb7b8cd0a with llama.cpp b11146 (convert_hf_to_gguf.py --remote Qwen/Qwen3.5-4B --mmproj --outtype f16).
Give it to llama.cpp with --mmproj.
Run twoody/Qwen3.5-4B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models