FadedRedStar/LFM2.5-350M-heretic-imatrix-GGUF overview
LFM2.5 350M heretic imatrix — GGUF NOTE This card is a work in progress. Full architecture details, abliteration parameters, and inference instructions will be…
Runs locally from ~209.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | FadedRedStar/LFM2.5-350M-heretic-imatrix-GGUF |
|---|---|
| Author | FadedRedStar |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | coder3101/LFM2.5-350M-heretic |
| Last modified | 2026-07-05T12:42:26.000Z |
Model README
---
base_model: coder3101/LFM2.5-350M-heretic
base_model_relation: quantized
library_name: gguf
license: apache-2.0
language:
- multilingual
pipeline_tag: text-generation
tags:
- gguf
- text-generation
- reasoning
- thinking
- agentic
- tool-use
- abliterated
- uncensored
- lfm2
- imatrix
- conversational
---
LFM2.5-350M-heretic-imatrix — GGUF
> [!NOTE]
> This card is a work in progress. Full architecture details, abliteration parameters, and inference instructions will be added shortly.
This repository hosts importance-matrix (imatrix) calibrated GGUF weights for LFM2.5-350M-heretic, quantized from the source floating-point tensors provided by coder3101/LFM2.5-350M-heretic.
Repository Files
| Filename | Format | Size | llama.cpp Build | Description |
|---|---|---|---|---|
| LFM2.5-350M-heretic-IQ4_NL-imatrix.gguf | IQ4_NL | 219 MB | b9860 | Main model weights, imatrix-calibrated, smaller non-linear 4-bit quant |
| LFM2.5-350M-heretic-Q4_K_M-imatrix.gguf | Q4_K_M | 229 MB | b9860 | Main model weights, imatrix-calibrated |
| LFM2.5-350M-heretic-Q5_K_M-imatrix.gguf | Q5_K_M | 260 MB | b9860 | Main model weights, imatrix-calibrated, higher fidelity |
Run FadedRedStar/LFM2.5-350M-heretic-imatrix-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models