liquidai/lfm2-8b-a1b-gguf Q4_0 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
liquidai/lfm2-8b-a1b-gguf overview
LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. We're releasing the weights of our first MoE based on LFM2, with 8.3B total parameters and 1.5B active parameters. Find more information about LFM2-8B-A1B in our blog post.
Downloads
6,829
Likes
97
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
6 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| LFM2-8B-A1B-F16.gguf | GGUF | F16 | 15.54 GB | Download |
| LFM2-8B-A1B-Q4_0.gguf | GGUF | — | 4.41 GB | Download |
| LFM2-8B-A1B-Q4_K_M.gguf | GGUF | Q4_K_M | 4.70 GB | Download |
| LFM2-8B-A1B-Q5_K_M.gguf | GGUF | Q5_K_M | 5.51 GB | Download |
| LFM2-8B-A1B-Q6_K.gguf | GGUF | Q6_K | 6.38 GB | Download |
| LFM2-8B-A1B-Q8_0.gguf | GGUF | — | 8.26 GB | Download |
Related Quantizations
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"library_name": "transformers",
"license": "other",
"license_name": "lfm1.0",
"license_link": "LICENSE",
"language": [
"en",
"ar",
"zh",
"fr",
"de",
"ja",
"ko",
"es"
],
"pipeline_tag": "text-generation",
"tags": [
"liquid",
"lfm2",
"edge",
"moe",
"llama.cpp",
"gguf"
],
"base_model": [
"LiquidAI/LFM2-8B-A1B"
],
"frontmatter": {
"library_name": "transformers",
"license": "other",
"license_name": "lfm1.0",
"license_link": "LICENSE",
"language": [
"en",
"ar",
"zh",
"fr",
"de",
"ja",
"ko",
"es"
],
"pipeline_tag": "text-generation",
"tags": [
"liquid",
"lfm2",
"edge",
"moe",
"llama.cpp",
"gguf"
],
"base_model": [
"LiquidAI/LFM2-8B-A1B"
]
},
"hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png",
"summary": "LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. We're releasing the weights of our first MoE based on LFM2, with 8.3B total parameters and 1.5B active parameters. Find more information about LFM2-8B-A1B in our blog post.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlibrary_name: transformers\nlicense: other\nlicense_name: lfm1.0\nlicense_link: LICENSE\nlanguage:\n- en\n- ar\n- zh\n- fr\n- de\n- ja\n- ko\n- es\npipeline_tag: text-generation\ntags:\n- liquid\n- lfm2\n- edge\n- moe\n- llama.cpp\n- gguf\nbase_model:\n- LiquidAI/LFM2-8B-A1B\n---\n\n<center>\n<div style=\"text-align: center;\">\n <img \n src=\"https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png\" \n alt=\"Liquid AI\"\n style=\"width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;\"\n />\n</div>\n<div style=\"display: flex; justify-content: center; gap: 0.5em;\">\n<a href=\"https://playground.liquid.ai/\"><strong>Try LFM</strong></a> • <a href=\"https://docs.liquid.ai/lfm/getting-started/welcome\"><strong>Docs</strong></a> • <a href=\"https://leap.liquid.ai/\"><strong>LEAP</strong></a> • <a href=\"https://discord.com/invite/liquid-ai\"><strong>Discord</strong></a>\n</div>\n</center>\n\n<br>\n\n# LFM2-8B-A1B-GGUF\n\nLFM2 is a new generation of hybrid models developed by [Liquid AI](https://www.liquid.ai/), specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. \n\nWe're releasing the weights of our first MoE based on LFM2, with 8.3B total parameters and 1.5B active parameters.\n\n- LFM2-8B-A1B is the best on-device MoE in terms of both **quality** (comparable to 3-4B dense models) and **speed** (faster than Qwen3-1.7B).\n- **Code and knowledge** capabilities are significantly improved compared to LFM2-2.6B.\n- Quantized variants fit comfortably on high-end **phones, tablets, and laptops**.\n\nFind more information about LFM2-8B-A1B in our [blog post](https://www.liquid.ai/blog/).\n\n## 🏃 How to run LFM2\n\nExample usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):\n\n```\nllama-cli -hf LiquidAI/LFM2-8B-A1B-GGUF\n```",
"related_quantizations": [
{
"id": "Sadiah/ollama-q4_k_m-LFM2-8B-A1B-GGUF",
"author": "Sadiah",
"downloads": null,
"likes": null,
"pipeline_tag": "",
"library_name": "",
"tags": []
}
]
},
"tags": [
"transformers",
"gguf",
"liquid",
"lfm2",
"edge",
"moe",
"llama.cpp",
"text-generation",
"en",
"ar",
"zh",
"fr",
"de",
"ja",
"ko",
"es",
"base_model:LiquidAI/LFM2-8B-A1B",
"base_model:quantized:LiquidAI/LFM2-8B-A1B",
"license:other",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 97,
"downloads": 6829,
"gated": false,
"private": false,
"last_modified": "2026-03-30T13:41:14.000Z",
"created_at": "2025-10-06T16:09:29.000Z",
"pipeline_tag": "text-generation",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "68e3e9b9a7beb744f20a6e05",
"id": "LiquidAI/LFM2-8B-A1B-GGUF",
"modelId": "LiquidAI/LFM2-8B-A1B-GGUF",
"sha": "11624c2ea122b97f5dc5c1ec885de7aed7d46333",
"createdAt": "2025-10-06T16:09:29.000Z",
"lastModified": "2026-03-30T13:41:14.000Z",
"author": "LiquidAI",
"downloads": 6829,
"likes": 97,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "transformers",
"siblings_count": 9
}