GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ggml-org/LFM2.5-24B-A2B-GGUF overview

LFM2.5 24B A2B Run with https://llama.app bash llama serve hf ggml org/LFM2.5 24B A2B GGUF Source models https://huggingface.co/LiquidAI/LFM2.5 24B A2B Notes Q…

ggufquantizedtext-generationbase_model:LiquidAI/LFM2.5-24B-A2Bbase_model:quantized:LiquidAI/LFM2.5-24B-A2Blicense:otherendpoints_compatibleregion:usconversational

Runs locally from ~13.53 GB disk (16 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
1
Pipeline
text-generation
Author

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
LFM2.5-24B-A2B-BF16.ggufGGUFBF1644.67 GBDownload
LFM2.5-24B-A2B-Q4_K_M.ggufGGUFQ4_K_M13.53 GBDownload
LFM2.5-24B-A2B-Q8_0.ggufGGUFQ8_023.74 GBDownload

Model Details

Model IDggml-org/LFM2.5-24B-A2B-GGUF
Authorggml-org
Pipelinetext-generation
Licenseother
Base modelLiquidAI/LFM2.5-24B-A2B
Last modified2026-10-15T14:18:45.000Z

Model README

---

license: other

license_name: lfm1.0

license_link: https://huggingface.co/LiquidAI/LFM2.5-24B-A2B/blob/main/LICENSE

pipeline_tag: text-generation

tags:

  • gguf
  • quantized

base_model:

  • LiquidAI/LFM2.5-24B-A2B

---

LFM2.5-24B-A2B

Run with https://llama.app

llama serve -hf ggml-org/LFM2.5-24B-A2B-GGUF

Source models

  • https://huggingface.co/LiquidAI/LFM2.5-24B-A2B

Notes

  • Q8_0 and Q4_K_M use the same quantization as LiquidAI's own GGUFs: https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-GGUF
  • For a smaller build, LiquidAI also publishes a Quantization-Aware Distillation (QAD) Q4_0, trained to recover the accuracy lost to Q4_0 quantization.

TODOs

  • add info

> [!IMPORTANT]

> This model is automatically converted using https://github.com/ggml-org/convert

Run ggml-org/LFM2.5-24B-A2B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models