nuofang/Qwen3.5-9B-The-Deckard-V8-Pro-Writer-Uncensored-Heretic-GGUF overview
Auto Quantized GGUF Model This repository contains automated GGUF quantization files for DavidAU/Qwen3.5 9B The Deckard V8 Pro Writer Uncensored Heretic https:…
Runs locally from ~4.9 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
Model README
---
base_model: DavidAU/Qwen3.5-9B-The-Deckard-V8-Pro-Writer-Uncensored-Heretic
tags:
- llama.cpp
- quantized
- imatrix
---
Auto-Quantized GGUF Model
This repository contains automated GGUF quantization files for DavidAU/Qwen3.5-9B-The-Deckard-V8-Pro-Writer-Uncensored-Heretic.
The calibration data for the imatrix is targeted at Chinese novels and role-playing (RP), while preserving logic and common sense.
imatrix 的校准数据以中文的小说、角色扮演为目标，同时保留逻辑和常识。
If the perplexity drops after quantization compared to the original precision, it might not actually be an improvement. Instead, it could be caused by differences in how llama.cpp quantization and perplexity tools handle special tokens. I will update the README generation code in the future.
如果困惑度在量化之后与原精度相比变低，可能并不是真的提升，而是llamacpp量化工具和困惑度计算工具处理特殊token行为不同导致的，我将在未来修改生成readme的代码。
📊 Perplexity Evaluation
(Tested against the provided calibration dataset)
- Base (F16/BF16): PPL = 18.6391 +/- 0.16209
- IQ4_XS: PPL = 15.5788 +/- 0.13191
Run nuofang/Qwen3.5-9B-The-Deckard-V8-Pro-Writer-Uncensored-Heretic-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models