GraySoft
Projects Models About FAQ Contact Download guIDE →

liquidai/lfm2-8b-a1b-gguf - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

liquidai/lfm2-8b-a1b-gguf overview

LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. We're releasing the weights of our first MoE based on LFM2, with 8.3B total parameters and 1.5B active parameters. Find more information about LFM2-8B-A1B in our blog post.

transformersggufliquidlfm2edgemoellama.cpptext-generationenarzhfrdejakoesbase_model:LiquidAI/LFM2-8B-A1Bbase_model:quantized:LiquidAI/LFM2-8B-A1Blicense:otherendpoints_compatibleregion:usconversational
liquidai/lfm2-8b-a1b-gguf visual
Downloads
6,829
Likes
97
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

6 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
LFM2-8B-A1B-F16.gguf GGUF F16 15.54 GB Download
LFM2-8B-A1B-Q4_0.gguf GGUF 4.41 GB Download
LFM2-8B-A1B-Q4_K_M.gguf GGUF Q4_K_M 4.70 GB Download
LFM2-8B-A1B-Q5_K_M.gguf GGUF Q5_K_M 5.51 GB Download
LFM2-8B-A1B-Q6_K.gguf GGUF Q6_K 6.38 GB Download
LFM2-8B-A1B-Q8_0.gguf GGUF 8.26 GB Download

Related Quantizations

Model Details Live

Model Slug
liquidai/lfm2-8b-a1b-gguf
Author
LiquidAI
Pipeline Task
text-generation
Library
transformers
Created
2025-10-06
Last Modified
2026-03-30
Gated
No
Private
No
HF SHA
11624c2ea122b97f5dc5c1ec885de7aed7d46333
License
other
Language
en, ar, zh, fr, de, ja, ko, es
Base Model
LiquidAI/LFM2-8B-A1B

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "library_name": "transformers",
    "license": "other",
    "license_name": "lfm1.0",
    "license_link": "LICENSE",
    "language": [
      "en",
      "ar",
      "zh",
      "fr",
      "de",
      "ja",
      "ko",
      "es"
    ],
    "pipeline_tag": "text-generation",
    "tags": [
      "liquid",
      "lfm2",
      "edge",
      "moe",
      "llama.cpp",
      "gguf"
    ],
    "base_model": [
      "LiquidAI/LFM2-8B-A1B"
    ],
    "frontmatter": {
      "library_name": "transformers",
      "license": "other",
      "license_name": "lfm1.0",
      "license_link": "LICENSE",
      "language": [
        "en",
        "ar",
        "zh",
        "fr",
        "de",
        "ja",
        "ko",
        "es"
      ],
      "pipeline_tag": "text-generation",
      "tags": [
        "liquid",
        "lfm2",
        "edge",
        "moe",
        "llama.cpp",
        "gguf"
      ],
      "base_model": [
        "LiquidAI/LFM2-8B-A1B"
      ]
    },
    "hero_image_url": "https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png",
    "summary": "LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. We're releasing the weights of our first MoE based on LFM2, with 8.3B total parameters and 1.5B active parameters. Find more information about LFM2-8B-A1B in our blog post.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlibrary_name: transformers\nlicense: other\nlicense_name: lfm1.0\nlicense_link: LICENSE\nlanguage:\n- en\n- ar\n- zh\n- fr\n- de\n- ja\n- ko\n- es\npipeline_tag: text-generation\ntags:\n- liquid\n- lfm2\n- edge\n- moe\n- llama.cpp\n- gguf\nbase_model:\n- LiquidAI/LFM2-8B-A1B\n---\n\n<center>\n<div style=\"text-align: center;\">\n  <img \n    src=\"https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png\" \n    alt=\"Liquid AI\"\n    style=\"width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;\"\n  />\n</div>\n<div style=\"display: flex; justify-content: center; gap: 0.5em;\">\n<a href=\"https://playground.liquid.ai/\"><strong>Try LFM</strong></a> • <a href=\"https://docs.liquid.ai/lfm/getting-started/welcome\"><strong>Docs</strong></a> • <a href=\"https://leap.liquid.ai/\"><strong>LEAP</strong></a> • <a href=\"https://discord.com/invite/liquid-ai\"><strong>Discord</strong></a>\n</div>\n</center>\n\n<br>\n\n# LFM2-8B-A1B-GGUF\n\nLFM2 is a new generation of hybrid models developed by [Liquid AI](https://www.liquid.ai/), specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. \n\nWe're releasing the weights of our first MoE based on LFM2, with 8.3B total parameters and 1.5B active parameters.\n\n- LFM2-8B-A1B is the best on-device MoE in terms of both **quality** (comparable to 3-4B dense models) and **speed** (faster than Qwen3-1.7B).\n- **Code and knowledge** capabilities are significantly improved compared to LFM2-2.6B.\n- Quantized variants fit comfortably on high-end **phones, tablets, and laptops**.\n\nFind more information about LFM2-8B-A1B in our [blog post](https://www.liquid.ai/blog/).\n\n## 🏃 How to run LFM2\n\nExample usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):\n\n```\nllama-cli -hf LiquidAI/LFM2-8B-A1B-GGUF\n```",
    "related_quantizations": [
      {
        "id": "Sadiah/ollama-q4_k_m-LFM2-8B-A1B-GGUF",
        "author": "Sadiah",
        "downloads": null,
        "likes": null,
        "pipeline_tag": "",
        "library_name": "",
        "tags": []
      }
    ]
  },
  "tags": [
    "transformers",
    "gguf",
    "liquid",
    "lfm2",
    "edge",
    "moe",
    "llama.cpp",
    "text-generation",
    "en",
    "ar",
    "zh",
    "fr",
    "de",
    "ja",
    "ko",
    "es",
    "base_model:LiquidAI/LFM2-8B-A1B",
    "base_model:quantized:LiquidAI/LFM2-8B-A1B",
    "license:other",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 97,
  "downloads": 6829,
  "gated": false,
  "private": false,
  "last_modified": "2026-03-30T13:41:14.000Z",
  "created_at": "2025-10-06T16:09:29.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "68e3e9b9a7beb744f20a6e05",
  "id": "LiquidAI/LFM2-8B-A1B-GGUF",
  "modelId": "LiquidAI/LFM2-8B-A1B-GGUF",
  "sha": "11624c2ea122b97f5dc5c1ec885de7aed7d46333",
  "createdAt": "2025-10-06T16:09:29.000Z",
  "lastModified": "2026-03-30T13:41:14.000Z",
  "author": "LiquidAI",
  "downloads": 6829,
  "likes": 97,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 9
}