unsloth/glm-4.5-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "mit",
    "language": [
      "en",
      "zh"
    ],
    "pipeline_tag": "text-generation",
    "library_name": "transformers",
    "base_model": [
      "zai-org/GLM-4.5"
    ],
    "frontmatter": {
      "license": "mit",
      "language": [
        "en",
        "zh"
      ],
      "pipeline_tag": "text-generation",
      "library_name": "transformers",
      "base_model": [
        "zai-org/GLM-4.5"
      ]
    },
    "hero_image_url": "https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/bench.png",
    "summary": "👋 Join our Discord community.  📖 Check out the GLM-4.5 technical blog.  📍 Use GLM-4.5 API services on Z.ai API Platform (Global) or  Zhipu AI Open Platform (Mainland China).  👉 One click to GLM-4.5.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: mit\nlanguage:\n- en\n- zh\npipeline_tag: text-generation\nlibrary_name: transformers\nbase_model:\n- zai-org/GLM-4.5\n---\n\n# GLM-4.5\n\n<div align=\"center\">\n<img src=https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/logo.svg width=\"15%\"/>\n</div>\n<p align=\"center\">\n    👋 Join our <a href=\"https://discord.gg/QR7SARHRxK\" target=\"_blank\">Discord</a> community.\n    <br>\n    📖 Check out the GLM-4.5 <a href=\"https://z.ai/blog/glm-4.5\" target=\"_blank\">technical blog</a>.\n    <br>\n    📍 Use GLM-4.5 API services on <a href=\"https://docs.z.ai/guides/llm/glm-4.5\">Z.ai API Platform (Global)</a> or <br> <a href=\"https://docs.bigmodel.cn/cn/guide/models/text/glm-4.5\">Zhipu AI Open Platform (Mainland China)</a>.\n    <br>\n    👉 One click to <a href=\"https://chat.z.ai\">GLM-4.5</a>.\n</p>\n  \n## Model Introduction\n\nThe **GLM-4.5** series models are foundation models designed for intelligent agents. GLM-4.5 has **355** billion total parameters with **32** billion active parameters, while GLM-4.5-Air adopts a more compact design with **106** billion total parameters and **12** billion active parameters. GLM-4.5 models unify reasoning, coding, and intelligent agent capabilities to meet the complex demands of intelligent agent applications.\n\nBoth GLM-4.5 and GLM-4.5-Air are hybrid reasoning models that provide two modes: thinking mode for complex reasoning and tool usage, and non-thinking mode for immediate responses.\n\nWe have open-sourced the base models, hybrid reasoning models, and FP8 versions of the hybrid reasoning models for both GLM-4.5 and GLM-4.5-Air. They are released under the MIT open-source license and can be used commercially and for secondary development.\n\nAs demonstrated in our comprehensive evaluation across 12 industry-standard benchmarks, GLM-4.5 achieves exceptional performance with a score of **63.2**, in the **3rd** place among all the proprietary and open-source  models. Notably, GLM-4.5-Air delivers competitive results at **59.8** while maintaining superior efficiency.\n\n![bench](https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/bench.png)\n\nFor more eval results, show cases, and technical details, please visit\nour [technical blog](https://z.ai/blog/glm-4.5). The technical report will be released soon.\n\n\nThe model code, tool parser and reasoning parser can be found in the implementation of [transformers](https://github.com/huggingface/transformers/tree/main/src/transformers/models/glm4_moe), [vLLM](https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/glm4_moe_mtp.py) and [SGLang](https://github.com/sgl-project/sglang/blob/main/python/sglang/srt/models/glm4_moe.py).\n\n## Quick Start\n\nPlease refer our [github page](https://github.com/zai-org/GLM-4.5) for more detail.",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "text-generation",
    "en",
    "zh",
    "base_model:zai-org/GLM-4.5",
    "base_model:quantized:zai-org/GLM-4.5",
    "license:mit",
    "endpoints_compatible",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 51,
  "downloads": 1884,
  "gated": false,
  "private": false,
  "last_modified": "2025-12-26T05:09:51.000Z",
  "created_at": "2025-08-05T09:21:46.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}

{
  "_id": "6891cd2adedb989c6c544d3c",
  "id": "unsloth/GLM-4.5-GGUF",
  "modelId": "unsloth/GLM-4.5-GGUF",
  "sha": "d4573659be99a9eb1ada9abd5d0df6d8afc5a3a4",
  "createdAt": "2025-08-05T09:21:46.000Z",
  "lastModified": "2025-12-26T05:09:51.000Z",
  "author": "unsloth",
  "downloads": 1884,
  "likes": 51,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 134
}