LiquidAI/LFM2.5-1.2B-Instruct-GGUF overview
<div align="center" <img src="https://cdn uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png" alt="Liquid AI" style="…
Runs locally from ~663.5 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| LFM2.5-1.2B-Instruct-BF16.gguf | GGUF | BF16 | 2.18 GB | Download |
| LFM2.5-1.2B-Instruct-F16.gguf | GGUF | F16 | 2.18 GB | Download |
| LFM2.5-1.2B-Instruct-Q4_0.gguf | GGUF | Q4_0 | 663.5 MB | Download |
| LFM2.5-1.2B-Instruct-Q4_K_M.gguf | GGUF | Q4_K_M | 697.0 MB | Download |
| LFM2.5-1.2B-Instruct-Q5_K_M.gguf | GGUF | Q5_K_M | 804.3 MB | Download |
| LFM2.5-1.2B-Instruct-Q6_K.gguf | GGUF | Q6_K | 918.2 MB | Download |
| LFM2.5-1.2B-Instruct-Q8_0.gguf | GGUF | Q8_0 | 1.16 GB | Download |
| LFM2.5-1.2B-Instruct-QAD-Q4_0.gguf | GGUF | Q4_0 | 663.5 MB | Download |
Model Details
| Model ID | LiquidAI/LFM2.5-1.2B-Instruct-GGUF |
|---|---|
| Author | LiquidAI |
| Pipeline | text-generation |
| License | other |
| Base model | LiquidAI/LFM2.5-1.2B-Instruct |
| Last modified | 2026-08-24T19:38:18.000Z |
Model README
---
license: other
license_name: lfm1.0
license_link: LICENSE
language:
- en
- ar
- zh
- fr
- de
- ja
- ko
- es
pipeline_tag: text-generation
tags:
- liquid
- lfm2.5
- edge
- llama.cpp
- gguf
base_model:
- LiquidAI/LFM2.5-1.2B-Instruct
---
<div align="center">
<img
src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png"
alt="Liquid AI"
style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"
/>
<div style="display: flex; justify-content: center; gap: 0.5em;">
<a href="https://playground.liquid.ai/"><strong>Try LFM</strong></a> • <a href="https://docs.liquid.ai/lfm/getting-started/welcome"><strong>Docs</strong></a> • <a href="https://leap.liquid.ai/"><strong>LEAP</strong></a> • <a href="https://discord.com/invite/liquid-ai"><strong>Discord</strong></a>
</div>
</div>
<br>
LFM2.5-1.2B-Instruct
LFM2.5 is a new family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.
Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct
🏃 How to run LFM2.5
Example usage with llama.cpp:
llama-cli -hf LiquidAI/LFM2.5-1.2B-Instruct-GGUF --conversation \
--temp 0.1 --top-k 50 --repeat-penalty 1.05
QAD Q4_0 GGUF
The Quantization-Aware Distillation (QAD) checkpoint is available as
LFM2.5-1.2B-Instruct-QAD-Q4_0.gguf.
This is distinct from the post-training-quantized LFM2.5-1.2B-Instruct-Q4_0.gguf;
both use the GGUF Q4_0 format.
Example usage with llama.cpp:
llama-cli -hf LiquidAI/LFM2.5-1.2B-Instruct-GGUF \
--hf-file LFM2.5-1.2B-Instruct-QAD-Q4_0.gguf \
-p "What is C. elegans?"
📬 Contact
- Got questions or want to connect? Join our Discord community
- If you are interested in custom solutions with edge deployment, please contact our sales team.
Run LiquidAI/LFM2.5-1.2B-Instruct-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models