---

license: apache-2.0

base_model: InternScience/Agents-A1

library_name: llama.cpp

tags:

• gguf
• llama.cpp
• imatrix
• fable5-calibrated
• agents-a1

---

Agents-A1-Q3_K_M-imatrix-gguf-fable5-calibrated

Fable-5 trace calibrated imatrix GGUF quant of InternScience/Agents-A1.

File

| File | Size | SHA-256 |

|---|---:|---|

| Agents-A1-Q3_K_M-imatrix-gguf-fable5-calibrated.gguf | 15.61 GiB | ec40a523a23df7a4241875ec4c6039242617d46ad6395825f1d33361abf4a665 |

Quick Start

llama-cli -hf Chungulus/Agents-A1-Q3_K_M-imatrix-gguf-fable5-calibrated:Agents-A1-Q3_K_M-imatrix-gguf-fable5-calibrated.gguf -p "Write a Python sorting function" -n 160

Ollama

ollama create agents-a1-q3_k_m-imatrix -f Modelfile
ollama run agents-a1-q3_k_m-imatrix

Which File Should I Download?

| Use case | Recommendation |

|---|---|

| Recommended hardware | 12-16 GB RAM |

| Best for | low-memory balance |

Quality Snapshot

F16 baseline mini accuracy: 89.58%.

F16 baseline PPL on KL holdout: 13.0194.

| Metric | Value |

|---|---:|

| Mini accuracy | 89.58% |

| Retention vs F16 | 100.00% |

| Mean KLD vs F16 | 0.046980 |

| Same top p | 88.09% |

Notes

• Calibration source: Glint-Research/Fable-5-traces
• Calibration source revision: e05c417852fc59fd8da758e68b352732423ca0cb
• GGUF quantization method: llama.cpp with imatrix calibration.
• Static imatrix GGUF; not Unsloth Dynamic 2.0 / UD2.
• MTP is not included because the downloaded checkpoint did not contain MTP tensors.
• This repo contains local quantization artifacts only.