FadedRedStar/LFM2.5-VL-450M-heretic-imatrix-GGUF overview
LFM2.5 VL 450M heretic imatrix — GGUF NOTE This card is a work in progress. Full architecture details, abliteration parameters, and inference instructions will…
Runs locally from ~98.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| LFM2.5-VL-450M-heretic-IQ4_NL-imatrix.gguf | GGUF | IQ4_NL | 209.2 MB | Download |
| LFM2.5-VL-450M-heretic-Q4_K_M-imatrix.gguf | GGUF | Q4_K_M | 218.7 MB | Download |
| LFM2.5-VL-450M-heretic-Q5_K_M-imatrix.gguf | GGUF | Q5_K_M | 248.3 MB | Download |
| mmproj-LFM2.5-VL-450M-heretic-BF16.gguf | GGUF | BF16 | 181.5 MB | Download |
| mmproj-LFM2.5-VL-450M-heretic-Q8_0.gguf | GGUF | Q8_0 | 98.1 MB | Download |
Model Details
| Model ID | FadedRedStar/LFM2.5-VL-450M-heretic-imatrix-GGUF |
|---|---|
| Author | FadedRedStar |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | coder3101/LFM2.5-VL-450M-heretic |
| Last modified | 2026-07-05T12:46:00.000Z |
Model README
---
base_model: coder3101/LFM2.5-VL-450M-heretic
base_model_relation: quantized
library_name: gguf
license: apache-2.0
language:
- multilingual
pipeline_tag: image-text-to-text
tags:
- gguf
- text-generation
- multimodal
- vision
- reasoning
- thinking
- agentic
- tool-use
- abliterated
- uncensored
- lfm2
- imatrix
- conversational
---
LFM2.5-VL-450M-heretic-imatrix — GGUF
> [!NOTE]
> This card is a work in progress. Full architecture details, abliteration parameters, and inference instructions will be added shortly.
This repository hosts importance-matrix (imatrix) calibrated GGUF weights and the associated vision projection matrix for LFM2.5-VL-450M-heretic, quantized from the source floating-point tensors provided by coder3101/LFM2.5-VL-450M-heretic.
Repository Files
| Filename | Format | Size | llama.cpp Build | Description |
|---|---|---|---|---|
| LFM2.5-VL-450M-heretic-IQ4_NL-imatrix.gguf | IQ4_NL | 219 MB | b9860 | Main model weights, imatrix-calibrated, smaller non-linear 4-bit quant |
| LFM2.5-VL-450M-heretic-Q4_K_M-imatrix.gguf | Q4_K_M | 229 MB | b9860 | Main model weights, imatrix-calibrated |
| LFM2.5-VL-450M-heretic-Q5_K_M-imatrix.gguf | Q5_K_M | 260 MB | b9860 | Main model weights, imatrix-calibrated, higher fidelity |
| mmproj-LFM2.5-VL-450M-heretic-BF16.gguf | BF16 | 190 MB | b9860 | Vision projector (full precision) |
| mmproj-LFM2.5-VL-450M-heretic-Q8_0.gguf | Q8_0 | 103 MB | b9870 | Vision projector (compact) |
Run FadedRedStar/LFM2.5-VL-450M-heretic-imatrix-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models