FadedRedStar/LFM2.5-350M-heretic-GGUF overview
LFM2.5 350M heretic — GGUF NOTE This card is a work in progress. Full architecture details, abliteration parameters, and inference instructions will be added s…
Runs locally from ~218.7 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | FadedRedStar/LFM2.5-350M-heretic-GGUF |
|---|---|
| Author | FadedRedStar |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | coder3101/LFM2.5-350M-heretic |
| Last modified | 2026-07-05T12:41:50.000Z |
Model README
---
base_model: coder3101/LFM2.5-350M-heretic
base_model_relation: quantized
library_name: gguf
license: apache-2.0
language:
- multilingual
pipeline_tag: text-generation
tags:
- gguf
- text-generation
- reasoning
- thinking
- agentic
- tool-use
- abliterated
- uncensored
- lfm2
- conversational
---
LFM2.5-350M-heretic — GGUF
> [!NOTE]
> This card is a work in progress. Full architecture details, abliteration parameters, and inference instructions will be added shortly.
This repository hosts GGUF weights for LFM2.5-350M-heretic, quantized from the source floating-point tensors provided by coder3101/LFM2.5-350M-heretic.
Repository Files
| Filename | Format | Size | llama.cpp Build | Description |
|---|---|---|---|---|
| LFM2.5-350M-heretic-Q4_K_M.gguf | Q4_K_M | 229 MB | b9860 | Main model weights |
| LFM2.5-350M-heretic-Q5_K_M.gguf | Q5_K_M | 260 MB | b9860 | Main model weights, higher fidelity |
| LFM2.5-350M-heretic-Q8_0.gguf | Q8_0 | 379 MB | b9860 | Main model weights, near-lossless |
Run FadedRedStar/LFM2.5-350M-heretic-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models