Soulfate24/Ornith-1.5-9B-ASHQ1-Remix-GGUF overview
Ornith 1.5 9B ASHQ1 Remix This is a GGUF quantized version of the original model. 📈 Release Benchmarks wiki.test.raw, symmetric FA auto reference | Tier | Siz…
Runs locally from ~4.9 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| imatrix.gguf | GGUF | GGUF | 4.9 MB | Download |
| mmproj-ASHQ1-Balanced-72pc.gguf | GGUF | GGUF | 631.2 MB | Download |
| model-ASHQ1-Compact-33pc.gguf | GGUF | GGUF | 5.67 GB | Download |
| model-ASHQ1-Fidelity-48pc.gguf | GGUF | GGUF | 9.24 GB | Download |
| model-ASHQ1-Mini-30pc.gguf | GGUF | GGUF | 5.26 GB | Download |
| model-ASHQ1-Nano-27pc.gguf | GGUF | GGUF | 4.64 GB | Download |
| model-ASHQ1-Pico-24pc.gguf | GGUF | GGUF | 4.29 GB | Download |
| model-ASHQ1-Precision-42pc.gguf | GGUF | GGUF | 8.22 GB | Download |
| model-ASHQ1-Quality-36pc.gguf | GGUF | GGUF | 6.18 GB | Download |
Model Details
| Model ID | Soulfate24/Ornith-1.5-9B-ASHQ1-Remix-GGUF |
|---|---|
| Author | Soulfate24 |
| Pipeline | text-generation |
| License | mit |
| Base model | ornith-ai/Ornith-1.5-9B |
| Last modified | 2026-08-30T16:26:21.000Z |
Model README
---
library_name: transformers
license: mit
license_link: https://huggingface.co/ornith-ai/Ornith-1.5-9B/blob/main/LICENSE
pipeline_tag: text-generation
base_model:
- ornith-ai/Ornith-1.5-9B
tags:
- quantization
- gguf
- ashq1
- imatrix
---
Ornith-1.5-9B - ASHQ1-Remix
This is a GGUF quantized version of the original model.
📈 Release Benchmarks (wiki.test.raw, symmetric FA-auto reference)
| Tier | Size | PPL | KLD | RMS Δp | top-p |
| :--- | ---: | ---: | ---: | ---: | ---: |
| Fidelity-48pc | 9464 MiB | 9.5239 | 0.0081 | 2.43% | 97.6% |
| Precision-42pc | 8414 MiB | 9.4347 | 0.0132 | 3.04% | 96.6% |
| Quality-36pc | 6330 MiB | 9.3692 | 0.0366 | 5.00% | 93.3% |
| Compact-33pc 🥈 Second Choice | 5803 MiB | 9.6043 | 0.0517 | 5.91% | 91.6% |
| Mini-30pc ⭐ Recommended | 5385 MiB | 9.8564 | 0.0649 | 6.67% | 90.3% |
| Nano-27pc | 4750 MiB | 10.1061 | 0.0907 | 7.90% | 87.8% |
| Pico-24pc | 4389 MiB | 10.1078 | 0.1309 | 9.63% | 85.0% |
ℹ️ About ASHQ1-Remix Suite
Activation-aware GGUF quantization whose every ratio, floor, and cap traces to a measured experiment. Plain-BF16-native first; AutoRound lineage supported with explicit saturation bounds. Full seven-tier ladder validated across six model families.
🔗 Link: https://huggingface.co/Soulfate24/AutoRound-ASHQ1-Remix_Double-Quantization_Suite
Run Soulfate24/Ornith-1.5-9B-ASHQ1-Remix-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models