blcacola/autoglm-phone-9b-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "mit",
    "base_model": [
      "zai-org/AutoGLM-Phone-9B"
    ],
    "tags": [
      "multimodal",
      "vision-language",
      "phone-automation",
      "gguf",
      "quantized",
      "agent"
    ],
    "language": [
      "zh"
    ],
    "pipeline_tag": "image-text-to-text",
    "frontmatter": {
      "license": "mit",
      "base_model": [
        "zai-org/AutoGLM-Phone-9B"
      ],
      "tags": [
        "multimodal",
        "vision-language",
        "phone-automation",
        "gguf",
        "quantized",
        "agent"
      ],
      "language": [
        "zh"
      ],
      "pipeline_tag": "image-text-to-text"
    },
    "hero_image_url": "https://www.nethype.de/huggingface_embed/quantpplgraph.png",
    "summary": "Congratulations! This is the most complete and fully usable collection of AutoGLM-Phone-9B model GGUF quantized versions you can find.🎉🎉🎉 恭喜你！这是你能找到最完整，并且绝对可用的 AutoGLM-Phone-9B 模型 GGUF 量化版本集合。🎉🎉🎉",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: mit\nbase_model:\n- zai-org/AutoGLM-Phone-9B\ntags:\n- multimodal\n- vision-language\n- phone-automation\n- gguf\n- quantized\n- agent\nlanguage:\n- zh\npipeline_tag: image-text-to-text\n---\n\n# AutoGLM-Phone-9B GGUF Quantized Model Collection/AutoGLM-Phone-9B GGUF 量化模型集合\n\nCongratulations! This is the most complete and fully usable collection of AutoGLM-Phone-9B model GGUF quantized versions you can find.🎉🎉🎉   \n恭喜你！这是你能找到最完整，并且绝对可用的 AutoGLM-Phone-9B 模型 GGUF 量化版本集合。🎉🎉🎉\n\n## Model Introduction/模型简介\n\nPhone Agent is a mobile intelligent assistant framework built on AutoGLM, \ncapable of understanding smartphone screens through multimodal perception and executing automated operations to complete tasks.   \nAutoGLM-Phone-9B 是基于 GLM-4V-9B 的多模态视觉语言模型，专门针对手机自动化场景进行了优化。该模型能够理解手机屏幕截图并生成相应的操作指令。\n\n⚠️Please note! This is a multimodal vision language model, \nso in addition to the model itself, you also need the mmproj file. Please be sure to download this file for use!   \n⚠️请注意！这是多模态视觉语言模型，所以除了模型本身，你还需要mmproj文件，请务必下载这个文件一起使用！\n\n## Available quantization versions/可用的量化版本\n\n| Quantization Type | Size | Memory Requirement | Notes | Download Link |\n|---------|---------|---------|----------|----------|\n| **Q2_K** | 3.73 GB | ~4 GB | Not recommended 不推荐 | [Download](AutoGLM-Phone-9B-Q2_K.gguf) |\n| **Q3_K_S** | 4.28 GB | ~5 GB | Not recommended 不推荐 | [Download](AutoGLM-Phone-9B-Q3_K_S.gguf) |\n| **Q3_K_M** | 4.63 GB | ~5 GB | Lower quality 质量较低 | [Download](AutoGLM-Phone-9B-Q3_K_M.gguf) |\n| **Q3_K_L** | 4.84 GB | ~6 GB | Lower quality 质量较低 | [Download](AutoGLM-Phone-9B-Q3_K_L.gguf) |\n| **Q4_0** | 5.08 GB | ~6 GB | Minimum available 最低可用 | [Download](AutoGLM-Phone-9B-Q4_0.gguf) |\n| **Q4_1** | 5.60 GB | ~6 GB | \tFast, recommended 快速，推荐 | [Download](AutoGLM-Phone-9B-Q4_1.gguf) |\n| **Q4_K_S** | 5.36 GB | ~6 GB | Fast, recommended 快速，推荐 | [Download](AutoGLM-Phone-9B-Q4_K_S.gguf) |\n| **Q4_K_M** | 5.74 GB | ~7 GB | ⭐Most Recommended, balanced 最推荐，平衡⭐ | [Download](AutoGLM-Phone-9B-Q4_K_M.gguf) |\n| **Q5_0** | 6.11 GB | ~7 GB | Not recommended 不推荐 | [Download](AutoGLM-Phone-9B-Q5_0.gguf) |\n| **Q5_1** | 6.62 GB | ~8 GB | Not recommended 不推荐 | [Download](AutoGLM-Phone-9B-Q5_1.gguf) |\n| **Q5_K_S** | 6.24 GB | ~7 GB | Good quality 质量不错 | [Download](AutoGLM-Phone-9B-Q5_K_S.gguf) |\n| **Q5_K_M** | 6.57 GB | ~8 GB | Good quality 质量不错 | [Download](AutoGLM-Phone-9B-Q5_K_M.gguf) |\n| **Q6_K** | 7.70 GB | ~9 GB | Very good quality  质量非常好 | [Download](AutoGLM-Phone-9B-Q6_K.gguf) |\n| **Q8_0** | 9.31 GB | ~11 GB | ⭐Fast, best quality 快速，质量最好⭐ | [Download](AutoGLM-Phone-9B-Q8_0.gguf) |\n| **F16** | 17.52 GB | ~20 GB | 16 bpw, overkill  16 bpw，过量 | [Download](AutoGLM-Phone-9B-F16.gguf) |\n\n## Quick Start/快速开始\n\n### Using llama.cpp/使用 llama.cpp\n\n```bash\n# Download the model and visual projector\n# 下载模型和视觉投影器\nwget https://huggingface.co/BlcaCola/AutoGLM-Phone-9B-GGUF.gguf/resolve/main/AutoGLM-Phone-9B-Q8_0.gguf\nwget https://huggingface.co/BlcaCola/AutoGLM-Phone-9B-GGUF.gguf/resolve/main/AutoGLM-Phone-9B-mmproj.gguf\n\n# Start Server\n# 启动服务器\n./llama-server -m AutoGLM-Phone-9B-Q8_0.gguf --mmproj AutoGLM-Phone-9B-mmproj.gguf --host 0.0.0.0 --port 8080\n```\n\n\n## Performance Comparison/性能对比\n\nHere is a chart by ikawrakow comparing the performance levels of partially quantized models (below Q5):   \n这里有一张 ikawrakow 的图表，比较了部分量化的性能水平（低于Q5）：\n\n![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)\n\n## Related Resources/相关资源\n\n- **原项目/Original project**: [Open-AutoGLM](https://github.com/zai-org/Open-AutoGLM)\n- **llama.cpp**: [GitHub](https://github.com/ggerganov/llama.cpp)\n\n## License Agreement/使用许可\n\nThis model is licensed under the MIT License. Please refer to the license terms of the original model.   \n本模型遵循 MIT 许可证。请查看原始模型的许可证条款。\n\n\n---\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "multimodal",
    "vision-language",
    "phone-automation",
    "quantized",
    "agent",
    "image-text-to-text",
    "zh",
    "base_model:zai-org/AutoGLM-Phone-9B",
    "base_model:quantized:zai-org/AutoGLM-Phone-9B",
    "license:mit",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 1,
  "downloads": 597,
  "gated": false,
  "private": false,
  "last_modified": "2025-12-20T03:51:58.000Z",
  "created_at": "2025-12-18T16:10:43.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": ""
}

{
  "_id": "69442783e59da9d23ee27b99",
  "id": "BlcaCola/AutoGLM-Phone-9B-GGUF",
  "modelId": "BlcaCola/AutoGLM-Phone-9B-GGUF",
  "sha": "7427a6610e2ba1275180b482e134b214634ca541",
  "createdAt": "2025-12-18T16:10:43.000Z",
  "lastModified": "2025-12-20T03:51:58.000Z",
  "author": "BlcaCola",
  "downloads": 597,
  "likes": 1,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "",
  "siblings_count": 18
}