GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

Atomic-Germ/Qwen3.8-Distilled-9B-NPU2-GGUF overview

Qwen3.8 Distilled 9B NPU2 FastFlowLM Q4NX conversion of Qwen3.8 9B Distill/ for AMD XDNA NPU inference. This repository contains a quantized Q4NX port of the m…

transformersggufqwen3_5image-text-to-textempero-aiqwen3.5qwen3.8distillationreasoningfunction-callingvisionqwen3.8-froggeric-v22.4npu2fastflowlmflmq4nxv1.0.1conversationalbase_model:empero-ai/Qwen3.8-9B-Distillbase_model:quantized:empero-ai/Qwen3.8-9B-Distilllicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~8.87 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
1
Pipeline
image-text-to-text

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
model.ggufGGUFGGUF8.87 GBDownload

Model Details

Model IDAtomic-Germ/Qwen3.8-Distilled-9B-NPU2-GGUF
AuthorAtomic-Germ
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelempero-ai/Qwen3.8-9B-Distill
Last modified2026-10-12T14:02:17.000Z

Model README

---

license: apache-2.0

base_model:

  • empero-ai/Qwen3.8-9B-Distill

base_model_relation: quantized

quantized_by: Atomic-Germ

library_name: transformers

pipeline_tag: image-text-to-text

tags:

- empero-ai

- qwen3.5

- qwen3.8

- distillation

- reasoning

- function-calling

- vision

- qwen3.8-froggeric-v22.4

- npu2

- fastflowlm

- flm

- q4nx

- v1.0.1

---

Qwen3.8-Distilled-9B-NPU2

FastFlowLM Q4NX conversion of Qwen3.8-9B-Distill/ for AMD XDNA NPU inference.

This repository contains a quantized Q4NX port of the model, compiled for the FastFlowLM (FLM) runtime. It is not a GGUF file.

| Item | Value |

|------|-------|

| Source model | empero-ai/Qwen3.8-9B-Distill |

| Weights | model.q4nx (7.11 GB) |

| Modality | language / vision |

| FLM version | 1.0.1 |

| Converted | 2026-08-26 |

Install and run

This repository works with flm-add, a small installer that copies the model

into the FastFlowLM user directory and registers the tag. It never

modifies the system FastFlowLM install.

pip install flm-add or uv tool install flm-add

uv tool install flm-add
flm-add Atomic-Germ/Qwen3.8-Distilled-9B-NPU2 --family qwen3.5
FLM_CONFIG_PATH="$HOME/.config/flm/model_list.json" FLM_XCLBIN_PATH="$HOME/.config/flm" flm run qwen3.8-distilled:9b

Files

| File | Description |

|------|-------------|

| model.q4nx | Quantized weights (Q8_0 / Q4_1 / BF16) |

| config.json | FLM runtime configuration |

| tokenizer.json | Tokenizer vocabulary |

| tokenizer_config.json | Tokenizer configuration |

| chat_template.jinja | Chat template |

| vision_weight.q4nx | Vision model |

| results/ | FLM-Test results |

---

Source model card

See the original model card: Qwen3.8-9B-Distill/ on Hugging Face

Run Atomic-Germ/Qwen3.8-Distilled-9B-NPU2-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models