Atomic-Germ/Qwen3.8-Distilled-9B-NPU2-GGUF overview
Qwen3.8 Distilled 9B NPU2 FastFlowLM Q4NX conversion of Qwen3.8 9B Distill/ for AMD XDNA NPU inference. This repository contains a quantized Q4NX port of the m…
Runs locally from ~8.87 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| model.gguf | GGUF | GGUF | 8.87 GB | Download |
Model Details
| Model ID | Atomic-Germ/Qwen3.8-Distilled-9B-NPU2-GGUF |
|---|---|
| Author | Atomic-Germ |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | empero-ai/Qwen3.8-9B-Distill |
| Last modified | 2026-10-12T14:02:17.000Z |
Model README
---
license: apache-2.0
base_model:
- empero-ai/Qwen3.8-9B-Distill
base_model_relation: quantized
quantized_by: Atomic-Germ
library_name: transformers
pipeline_tag: image-text-to-text
tags:
- empero-ai
- qwen3.5
- qwen3.8
- distillation
- reasoning
- function-calling
- vision
- qwen3.8-froggeric-v22.4
- npu2
- fastflowlm
- flm
- q4nx
- v1.0.1
---
Qwen3.8-Distilled-9B-NPU2
FastFlowLM Q4NX conversion of Qwen3.8-9B-Distill/ for AMD XDNA NPU inference.
This repository contains a quantized Q4NX port of the model, compiled for the FastFlowLM (FLM) runtime. It is not a GGUF file.
| Item | Value |
|------|-------|
| Source model | empero-ai/Qwen3.8-9B-Distill |
| Weights | model.q4nx (7.11 GB) |
| Modality | language / vision |
| FLM version | 1.0.1 |
| Converted | 2026-08-26 |
Install and run
This repository works with flm-add, a small installer that copies the model
into the FastFlowLM user directory and registers the tag. It never
modifies the system FastFlowLM install.
pip install flm-add or uv tool install flm-add
uv tool install flm-add
flm-add Atomic-Germ/Qwen3.8-Distilled-9B-NPU2 --family qwen3.5
FLM_CONFIG_PATH="$HOME/.config/flm/model_list.json" FLM_XCLBIN_PATH="$HOME/.config/flm" flm run qwen3.8-distilled:9b
Files
| File | Description |
|------|-------------|
| model.q4nx | Quantized weights (Q8_0 / Q4_1 / BF16) |
| config.json | FLM runtime configuration |
| tokenizer.json | Tokenizer vocabulary |
| tokenizer_config.json | Tokenizer configuration |
| chat_template.jinja | Chat template |
| vision_weight.q4nx | Vision model |
| results/ | FLM-Test results |
---
Source model card
See the original model card: Qwen3.8-9B-Distill/ on Hugging Face
Run Atomic-Germ/Qwen3.8-Distilled-9B-NPU2-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models