liquidai/lfm2-350m-gguf Q6_K GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
liquidai/lfm2-350m-gguf overview
LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2-350M
Downloads
45,813
Likes
57
Pipeline
text-generation
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
7 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| LFM2-350M-F16.gguf | GGUF | F16 | 678.52 MB | Download |
| LFM2-350M-Q4_0.gguf | GGUF | — | 209.15 MB | Download |
| LFM2-350M-Q4_K_M-hip-optimized.gguf | GGUF | Q4_K_M | 243.15 MB | Download |
| LFM2-350M-Q4_K_M.gguf | GGUF | Q4_K_M | 218.69 MB | Download |
| LFM2-350M-Q5_K_M.gguf | GGUF | Q5_K_M | 248.31 MB | Download |
| LFM2-350M-Q6_K.gguf | GGUF | Q6_K | 279.79 MB | Download |
| LFM2-350M-Q8_0.gguf | GGUF | — | 361.65 MB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "other",
"license_name": "lfm1.0",
"license_link": "LICENSE",
"language": [
"en",
"ar",
"zh",
"fr",
"de",
"ja",
"ko",
"es"
],
"pipeline_tag": "text-generation",
"tags": [
"liquid",
"lfm2",
"edge",
"llama.cpp",
"gguf"
],
"base_model": [
"LiquidAI/LFM2-350M"
],
"frontmatter": {
"license": "other",
"license_name": "lfm1.0",
"license_link": "LICENSE",
"language": [
"en",
"ar",
"zh",
"fr",
"de",
"ja",
"ko",
"es"
],
"pipeline_tag": "text-generation",
"tags": [
"liquid",
"lfm2",
"edge",
"llama.cpp",
"gguf"
],
"base_model": [
"LiquidAI/LFM2-350M"
]
},
"hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png",
"summary": "LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2-350M",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: other\nlicense_name: lfm1.0\nlicense_link: LICENSE\nlanguage:\n- en\n- ar\n- zh\n- fr\n- de\n- ja\n- ko\n- es\npipeline_tag: text-generation\ntags:\n- liquid\n- lfm2\n- edge\n- llama.cpp\n- gguf\nbase_model:\n- LiquidAI/LFM2-350M\n---\n\n<center>\n<div style=\"text-align: center;\">\n <img \n src=\"https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png\" \n alt=\"Liquid AI\"\n style=\"width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;\"\n />\n</div>\n<div style=\"display: flex; justify-content: center; gap: 0.5em;\">\n<a href=\"https://playground.liquid.ai/\"><strong>Try LFM</strong></a> • <a href=\"https://docs.liquid.ai/lfm/getting-started/welcome\"><strong>Docs</strong></a> • <a href=\"https://leap.liquid.ai/\"><strong>LEAP</strong></a> • <a href=\"https://discord.com/invite/liquid-ai\"><strong>Discord</strong></a>\n</div>\n</center>\n\n<br>\n\n# LFM2-350M-GGUF\n\nLFM2 is a new generation of hybrid models developed by [Liquid AI](https://www.liquid.ai/), specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. \n\nFind more details in the original model card: https://huggingface.co/LiquidAI/LFM2-350M\n\n## 🏃 How to run LFM2\n\nExample usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):\n\n```\nllama-cli -hf LiquidAI/LFM2-350M-GGUF\n```\n\n## 📬 Contact\n\n- Got questions or want to connect? [Join our Discord community](https://discord.com/invite/liquid-ai)\n- If you are interested in custom solutions with edge deployment, please contact [our sales team](https://www.liquid.ai/contact).",
"related_quantizations": []
},
"tags": [
"gguf",
"liquid",
"lfm2",
"edge",
"llama.cpp",
"text-generation",
"en",
"ar",
"zh",
"fr",
"de",
"ja",
"ko",
"es",
"base_model:LiquidAI/LFM2-350M",
"base_model:quantized:LiquidAI/LFM2-350M",
"license:other",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 57,
"downloads": 45813,
"gated": false,
"private": false,
"last_modified": "2026-03-30T12:59:22.000Z",
"created_at": "2025-07-12T12:02:17.000Z",
"pipeline_tag": "text-generation",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "68724ec99789cafbfe644c93",
"id": "LiquidAI/LFM2-350M-GGUF",
"modelId": "LiquidAI/LFM2-350M-GGUF",
"sha": "0ac706a2acd73327c41644713c90494ccce42588",
"createdAt": "2025-07-12T12:02:17.000Z",
"lastModified": "2026-03-30T12:59:22.000Z",
"author": "LiquidAI",
"downloads": 45813,
"likes": 57,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "",
"siblings_count": 14
}