What is yrrhall/LFM2.5-230M-GGUF?

--- library_name: gguf license: other license_name: lfm1.0 license_link: LICENSE language: - en - ar - zh - fr - de - ja - ko - es - pt - it pipeline_tag: text-generation base_model: LiquidAI/LFM2.5-230M tags: - liquid - lfm2.5 - gguf - llama.cpp --- Try LFM • Docs • LEAP • Discord</stro…

What license applies to yrrhall/LFM2.5-230M-GGUF?

License: other. Verify terms on Hugging Face before commercial use.

How do I run yrrhall/LFM2.5-230M-GGUF locally?

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Model Intelligence Sheet

yrrhall/LFM2.5-230M-GGUF overview

Q: What license applies to yrrhall/LFM2.5-230M-GGUF?

License: other. Verify terms on Hugging Face before commercial use.

Q: How do I run yrrhall/LFM2.5-230M-GGUF locally?

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Q: How much VRAM or disk space does yrrhall/LFM2.5-230M-GGUF need?

Runs locally from ~142.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

<div align="center" <img src="https://cdn uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png" alt="Liquid AI" style="…

ggufliquidlfm2.5llama.cpptext-generationenarzhfrdejakoesptitbase_model:LiquidAI/LFM2.5-230Mbase_model:quantized:LiquidAI/LFM2.5-230Mlicense:otherendpoints_compatibleregion:usconversational

Runs locally from ~142.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads

Likes

Pipeline

text-generation

Author

yrrhall

Repository Files & Downloads

7 GGUF files detected

Direct downloads for local inference

File	Type	Quantization	Size	Link
LFM2.5-230M-BF16.gguf	GGUF	BF16	440.5 MB	Download
LFM2.5-230M-F16.gguf	GGUF	F16	440.5 MB	Download
LFM2.5-230M-Q4_0.gguf	GGUF	Q4_0	142.2 MB	Download
LFM2.5-230M-Q4_K_M.gguf	GGUF	Q4_K_M	146.3 MB	Download
LFM2.5-230M-Q5_K_M.gguf	GGUF	Q5_K_M	163.7 MB	Download
LFM2.5-230M-Q6_K.gguf	GGUF	Q6_K	182.1 MB	Download
LFM2.5-230M-Q8_0.gguf	GGUF	Q8_0	235.2 MB	Download

Model Details

Model ID	yrrhall/LFM2.5-230M-GGUF
Author	yrrhall
Pipeline	text-generation
License	other
Base model	LiquidAI/LFM2.5-230M
Last modified	2026-07-06T14:30:47.000Z

Model README

---

library_name: gguf

license: other

license_name: lfm1.0

license_link: LICENSE

language:

pipeline_tag: text-generation

base_model: LiquidAI/LFM2.5-230M

tags:

liquid
lfm2.5
gguf
llama.cpp

---

<img

src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png"

alt="Liquid AI"

style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"

<a href="https://playground.liquid.ai/"><strong>Try LFM</strong></a> •

<a href="https://docs.liquid.ai/lfm/getting-started/welcome"><strong>Docs</strong></a> •

<a href="https://leap.liquid.ai/"><strong>LEAP</strong></a> •

<a href="https://discord.com/invite/liquid-ai"><strong>Discord</strong></a>

</div>

LFM2.5-230M-GGUF

LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-230M

🏃 How to run LFM2

Example usage with llama.cpp:

llama-cli -hf LiquidAI/LFM2.5-230M-GGUF

Run yrrhall/LFM2.5-230M-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models