aaryank/glm-4.7-flash-gguf overview

{
  "metadata": {},
  "card_data": {
    "base_model": "zai-org/GLM-4.7-Flash",
    "base_model_relation": "quantized",
    "language": [
      "en",
      "zh"
    ],
    "library_name": "gguf",
    "license": "mit",
    "pipeline_tag": "text-generation",
    "tags": [
      "text-generation-inference",
      "glm",
      "moe",
      "flash",
      "gguf",
      "glm4_moe_lite"
    ],
    "frontmatter": {
      "base_model": "zai-org/GLM-4.7-Flash",
      "base_model_relation": "quantized",
      "language": [
        "en",
        "zh"
      ],
      "library_name": "gguf",
      "license": "mit",
      "pipeline_tag": "text-generation",
      "tags": [
        "text-generation-inference",
        "glm",
        "moe",
        "flash",
        "gguf",
        "glm4_moe_lite"
      ]
    },
    "hero_image_url": "https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/logo.svg",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: zai-org/GLM-4.7-Flash\nbase_model_relation: quantized\nlanguage:\n- en\n- zh\nlibrary_name: gguf\nlicense: mit\npipeline_tag: text-generation\ntags:\n- text-generation-inference\n- glm\n- moe\n- flash\n- gguf\n- glm4_moe_lite\n---\n\n# GLM-4.7-Flash-GGUF\n\n<div align=\"center\">\n<img src=\"https://raw.githubusercontent.com/zai-org/GLM-4.5/refs/heads/main/resources/logo.svg\" width=\"15%\"/>\n</div>\n\n## Description\n\nThis repository contains **GGUF** format model files for [Zhipu AI's GLM-4.7-Flash](https://huggingface.co/zai-org/GLM-4.7-Flash).\n\n**GLM-4.7-Flash** is a highly efficient **30B-A3B Mixture-of-Experts (MoE)** model. It is designed to be the strongest model in the 30B parameter class, offering a powerful option for lightweight deployment that perfectly balances performance and efficiency.\n\n## Evaluation Results\n\n| Benchmark          | GLM-4.7-Flash | Qwen3-30B-A3B-Thinking-2507 | GPT-OSS-20B |\n|--------------------|---------------|-----------------------------|-------------|\n| AIME 25            | 91.6          | 85.0                        | 91.7        |\n| GPQA               | 75.2          | 73.4                        | 71.5        |\n| LCB v6             | 64.0          | 66.0                        | 61.0        |\n| HLE                | 14.4          | 9.8                         | 10.9        |\n| SWE-bench Verified | 59.2          | 22.0                        | 34.0        |\n| τ²-Bench           | 79.5          | 49.0                        | 47.7        |\n| BrowseComp         | 42.8          | 2.29                        | 28.3        |\n\n## Files & Quantization\n\nTo see the available files, please verify the **Files and versions** tab.\n\n## How to Run (llama.cpp)\n\n**Recommended Parameters:**\n*   **Temperature:** `1.0` (Standard) or `0.7` (For stricter adherence)\n*   **Top-P:** `0.95`\n*   **Context:** `-c` (Adjust based on available RAM).\n\n### CLI Example\n\n```bash\n./llama-cli -m GLM-4.7-Flash.Q4_K_M.gguf \\\n  -c 8192 \\\n  --temp 1.0 \\\n  --top-p 0.95 \\\n  -p \"User: Write a Python script to calculate Fibonacci numbers.\\nAssistant:\" \\\n  -cnv\n```\n\n### Server Example\n\n```bash\n./llama-server -m GLM-4.7-Flash.Q4_K_M.gguf \\\n  --port 8080 \\\n  --host 0.0.0.0 \\\n  -c 16384 \\\n  -ngl 99\n```",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "text-generation-inference",
    "glm",
    "moe",
    "flash",
    "glm4_moe_lite",
    "text-generation",
    "en",
    "zh",
    "base_model:zai-org/GLM-4.7-Flash",
    "base_model:quantized:zai-org/GLM-4.7-Flash",
    "license:mit",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 7,
  "downloads": 378,
  "gated": false,
  "private": false,
  "last_modified": "2026-01-20T00:09:41.000Z",
  "created_at": "2026-01-19T17:48:17.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "gguf"
}

{
  "_id": "696e6e61dd570a25a88fde05",
  "id": "AaryanK/GLM-4.7-Flash-GGUF",
  "modelId": "AaryanK/GLM-4.7-Flash-GGUF",
  "sha": "2caccdaa1f51d2547ab0deff5f254169faa67171",
  "createdAt": "2026-01-19T17:48:17.000Z",
  "lastModified": "2026-01-20T00:09:41.000Z",
  "author": "AaryanK",
  "downloads": 378,
  "likes": 7,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "gguf",
  "siblings_count": 16
}