naimulislam999/LFM2.5-350M-Uncensored-GGUF overview
LFM 2.5 350M Uncensored GGUF This repository contains the GGUF conversions of the uncensored version of LiquidAI/LFM2.5 350M . The original model weights were …
Runs locally from ~172.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| model-IQ3_M.gguf | GGUF | IQ3_M | 175.2 MB | Download |
| model-IQ3_S.gguf | GGUF | IQ3_S | 172.8 MB | Download |
| model-IQ4_NL.gguf | GGUF | IQ4_NL | 210.3 MB | Download |
| model-IQ4_XS.gguf | GGUF | IQ4_XS | 202.0 MB | Download |
| model-Q3_K_L.gguf | GGUF | Q3_K_L | 193.6 MB | Download |
| model-Q3_K_M.gguf | GGUF | Q3_K_M | 184.2 MB | Download |
| model-Q3_K_S.gguf | GGUF | Q3_K_S | 172.8 MB | Download |
| model-Q4_0.gguf | GGUF | Q4_0 | 209.2 MB | Download |
| model-Q4_1.gguf | GGUF | Q4_1 | 226.3 MB | Download |
| model-Q4_K_M.gguf | GGUF | Q4_K_M | 218.7 MB | Download |
| model-Q4_K_S.gguf | GGUF | Q4_K_S | 210.5 MB | Download |
| model-Q5_0.gguf | GGUF | Q5_0 | 243.4 MB | Download |
| model-Q5_1.gguf | GGUF | Q5_1 | 260.5 MB | Download |
| model-Q5_K_M.gguf | GGUF | Q5_K_M | 248.3 MB | Download |
| model-Q5_K_S.gguf | GGUF | Q5_K_S | 243.4 MB | Download |
| model-Q6_K.gguf | GGUF | Q6_K | 279.8 MB | Download |
| model-Q8_0.gguf | GGUF | Q8_0 | 361.7 MB | Download |
| model-f16.gguf | GGUF | F16 | 678.5 MB | Download |
Model Details
| Model ID | naimulislam999/LFM2.5-350M-Uncensored-GGUF |
|---|---|
| Author | naimulislam999 |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | LiquidAI/LFM2.5-350M |
| Last modified | 2026-08-29T07:50:55.000Z |
Model README
---
base_model: LiquidAI/LFM2.5-350M
library_name: gguf
license: apache-2.0
tags:
- text-generation
- gguf
- uncensored
- lfm
---
LFM 2.5 350M Uncensored (GGUF)
This repository contains the GGUF conversions of the uncensored version of LiquidAI/LFM2.5-350M.
The original model weights were processed to remove alignment restrictions and then converted to .gguf format for efficient inference on CPU and Apple Silicon using llama.cpp and compatible frontends (e.g., LM Studio, Ollama, GPT4All).
Available Quants
This repository includes a comprehensive set of quantizations from extreme 1-bit compression up to full 16-bit precision.
| Quantization | Bits | Recommended Use Case |
|---|---|---|
| IQ1_S / IQ1_M | ~1.5 - 2 | Maximum memory savings. High perplexity loss expected on this small parameter size. |
| IQ2_XXS - IQ2_M | ~2 | Extreme compression. Usable, but degradation is noticeable. |
| IQ3_XXS - Q3_K_L | ~3 | High compression. Good for strictly limited memory environments. |
| IQ4_XS - Q4_K_M | ~4 | Recommended sweet spot. Great balance of memory usage and quality. |
| Q5_0 - Q5_K_M | ~5 | Near-lossless performance with modest memory savings. |
| Q6_K | ~6 | Effectively lossless. |
| Q8_0 | 8 | Fully lossless integer quantization. |
| F16 | 16 | Unquantized baseline. Highest quality, highest memory footprint. |
Usage with llama.cpp
You can run this model via the llama.cpp CLI. Replace <quant_type> with your desired precision (e.g., Q4_K_M).
./llama-cli -m model-<quant_type>.gguf -p "Your prompt here" -n 256Run naimulislam999/LFM2.5-350M-Uncensored-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models