Soulfate24/PaddleOCR-VL-1.6-ASHQ1-Remix-GGUF overview
PaddleOCR VL 1.6 ASHQ1 Remix This is a GGUF quantized version of the original model. ๐ Release Benchmarks wiki.test.raw, symmetric FA auto reference | Tier | โฆ
Runs locally from ~323.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| mmproj-ASHQ1-Balanced-72pc.gguf | GGUF | GGUF | 593.1 MB | Download |
| model-ASHQ1-Compact-33pc.gguf | GGUF | GGUF | 403.5 MB | Download |
| model-ASHQ1-Fidelity-48pc.gguf | GGUF | GGUF | 537.3 MB | Download |
| model-ASHQ1-Mini-30pc.gguf | GGUF | GGUF | 377.6 MB | Download |
| model-ASHQ1-Nano-27pc.gguf | GGUF | GGUF | 350.6 MB | Download |
| model-ASHQ1-Pico-24pc.gguf | GGUF | GGUF | 323.6 MB | Download |
| model-ASHQ1-Precision-42pc.gguf | GGUF | GGUF | 484.3 MB | Download |
| model-ASHQ1-Quality-36pc.gguf | GGUF | GGUF | 430.4 MB | Download |
Model Details
| Model ID | Soulfate24/PaddleOCR-VL-1.6-ASHQ1-Remix-GGUF |
|---|---|
| Author | Soulfate24 |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | PaddlePaddle/PaddleOCR-VL-1.6 |
| Last modified | 2026-08-30T13:10:29.000Z |
Model README
---
license: apache-2.0
pipeline_tag: image-text-to-text
language:
- en
- zh
- multilingual
library_name: PaddleOCR
base_model:
- PaddlePaddle/PaddleOCR-VL-1.6
tags:
- ERNIE4.5
- PaddleOCR
- PaddlePaddle
- image-to-text
- ocr
- document-parse
- layout
- table
- formula
- chart
- seal
- spotting
- quantization
- gguf
- ashq1
- imatrix
---
PaddleOCR-VL-1.6 - ASHQ1-Remix
This is a GGUF quantized version of the original model.
๐ Release Benchmarks (wiki.test.raw, symmetric FA-auto reference)
| Tier | Size | PPL | KLD | RMS ฮp | top-p |
| :--- | ---: | ---: | ---: | ---: | ---: |
| Fidelity-48pc | 537 MiB | 365.8789 | 0.0366 | 2.99% | 91.1% |
| Precision-42pc โญ Recommended | 484 MiB | 362.9912 | 0.0337 | 2.57% | 91.5% |
| Quality-36pc | 430 MiB | 400.7598 | 0.1747 | 5.72% | 80.7% |
| Compact-33pc | 404 MiB | 351.6550 | 0.2320 | 6.82% | 77.3% |
| Mini-30pc | 378 MiB | 333.6259 | 0.2712 | 7.33% | 74.7% |
| Nano-27pc | 351 MiB | 385.6355 | 0.2612 | 7.73% | 72.5% |
| Pico-24pc | 324 MiB | 509.1721 | 0.5632 | 11.01% | 63.5% |
โน๏ธ About ASHQ1-Remix Suite
Activation-aware GGUF quantization whose every ratio, floor, and cap traces to a measured experiment. Plain-BF16-native first; AutoRound lineage supported with explicit saturation bounds. Full seven-tier ladder validated across six model families.
๐ Link: https://huggingface.co/Soulfate24/AutoRound-ASHQ1-Remix_Double-Quantization_Suite
Run Soulfate24/PaddleOCR-VL-1.6-ASHQ1-Remix-GGUF with guIDE
Download guIDE โ the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face ยท Compare models