Soulfate24/TwIL-LM3-ASHQ1-Remix-GGUF overview
TwIL LM3 ASHQ1 Remix This is a GGUF quantized version of the original model. ๐ Release Benchmarks wiki.test.raw, symmetric FA auto reference | Model | Size | โฆ
Runs locally from ~3.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| imatrix.gguf | GGUF | GGUF | 3.2 MB | Download |
| model-ASHQ1-Compact-33pc.gguf | GGUF | GGUF | 1.90 GB | Download |
| model-ASHQ1-Fidelity-48pc.gguf | GGUF | GGUF | 2.76 GB | Download |
| model-ASHQ1-Mini-30pc.gguf | GGUF | GGUF | 1.73 GB | Download |
| model-ASHQ1-Nano-27pc.gguf | GGUF | GGUF | 1.56 GB | Download |
| model-ASHQ1-Pico-24pc.gguf | GGUF | GGUF | 1.41 GB | Download |
| model-ASHQ1-Precision-42pc.gguf | GGUF | GGUF | 2.42 GB | Download |
| model-ASHQ1-Quality-36pc.gguf | GGUF | GGUF | 2.06 GB | Download |
Model Details
| Model ID | Soulfate24/TwIL-LM3-ASHQ1-Remix-GGUF |
|---|---|
| Author | Soulfate24 |
| Pipeline | text-generation |
| License | other |
| Base model | webAI-Official/TwIL-LM3 |
| Last modified | 2026-09-10T11:23:58.000Z |
Model README
---
language:
- en
library_name: transformers
pipeline_tag: text-generation
license: other
license_name: webai-non-commercial-license-ver.-1.0
license_link: https://huggingface.co/webAI-Official/webAI-ColVec1-4b/blob/main/LICENSE.md
base_model:
- webAI-Official/TwIL-LM3
tags:
- formal-logic
- reasoning
- lora
- model-merging
- wise-ft
- reinforcement-learning
- grpo
- smollm3
- twil-lm
- quantization
- gguf
- ashq1
- imatrix
---
TwIL-LM3 - ASHQ1-Remix
This is a GGUF quantized version of the original model.
๐ Release Benchmarks (wiki.test.raw, symmetric FA-auto reference)
| Model | Size | PPL | KLD | RMS ฮp | top-p | Speed |
| :--- | ---: | ---: | ---: | ---: | ---: | ---: |
| Q8_0 (stock) | 3124 MiB | 9.8138 | 0.0017 | 1.06% | 97.4% | 2560 t/s |
| Fidelity-48pc | 2826 MiB | 9.8173 | 0.0024 | 1.23% | 97.0% | 2560 t/s |
| Precision-42pc | 2474 MiB | 9.8206 | 0.0037 | 1.50% | 96.4% | 2226 t/s |
| Q6_K-imx (stock) | 2414 MiB | 9.8629 | 0.0088 | 2.54% | 93.9% | 2695 t/s |
| Quality-36pc ๐ฅ | 2111 MiB | 9.9407 | 0.0144 | 3.20% | 92.5% | 3012 t/s |
| Q5_K_M-imx (stock) | 2111 MiB | 9.9407 | 0.0144 | 3.20% | 92.5% | 3012 t/s |
| Compact-33pc โญ | 1945 MiB | 9.9726 | 0.0242 | 3.93% | 91.2% | 2560 t/s |
| Mini-30pc | 1769 MiB | 10.0104 | 0.0327 | 4.56% | 89.9% | 2695 t/s |
| IQ4_XS-imx (stock) | 1644 MiB | 10.1153 | 0.0381 | 4.92% | 89.4% | 2844 t/s |
| Nano-27pc | 1593 MiB | 10.2711 | 0.0500 | 5.71% | 88.0% | 2844 t/s |
| Pico-24pc | 1445 MiB | 10.7211 | 0.0974 | 7.78% | 84.7% | 2695 t/s |
| IQ3_M-imx (stock) | 1401 MiB | 11.0072 | 0.1064 | 8.69% | 83.4% | 2695 t/s |
โน๏ธ About ASHQ1-Remix Suite
Activation-aware GGUF quantization whose every ratio, floor, and cap traces to a measured experiment. Plain-BF16-native first; AutoRound lineage supported with explicit saturation bounds. Full seven-tier ladder validated across six model families.
๐ Link: https://huggingface.co/Soulfate24/AutoRound-ASHQ1-Remix_Double-Quantization_Suite
Run Soulfate24/TwIL-LM3-ASHQ1-Remix-GGUF with guIDE
Download guIDE โ the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face ยท Compare models