gaianet/glm-4-9b-chat-1m-gguf Q5_K_S GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
gaianet/glm-4-9b-chat-1m-gguf overview
Comprehensive model page for gaianet/glm-4-9b-chat-1m-gguf
Downloads
168
Likes
3
Pipeline
—
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
13 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| glm-4-9b-chat-1m-Q2_K.gguf | GGUF | Q2_K | 3.74 GB | Download |
| glm-4-9b-chat-1m-Q3_K_L.gguf | GGUF | Q3_K_L | 4.96 GB | Download |
| glm-4-9b-chat-1m-Q3_K_M.gguf | GGUF | Q3_K_M | 4.76 GB | Download |
| glm-4-9b-chat-1m-Q3_K_S.gguf | GGUF | Q3_K_S | 4.31 GB | Download |
| glm-4-9b-chat-1m-Q4_0.gguf | GGUF | — | 5.12 GB | Download |
| glm-4-9b-chat-1m-Q4_K_M.gguf | GGUF | Q4_K_M | 5.88 GB | Download |
| glm-4-9b-chat-1m-Q4_K_S.gguf | GGUF | Q4_K_S | 5.40 GB | Download |
| glm-4-9b-chat-1m-Q5_0.gguf | GGUF | — | 6.16 GB | Download |
| glm-4-9b-chat-1m-Q5_K_M.gguf | GGUF | Q5_K_M | 6.72 GB | Download |
| glm-4-9b-chat-1m-Q5_K_S.gguf | GGUF | Q5_K_S | 6.29 GB | Download |
| glm-4-9b-chat-1m-Q6_K.gguf | GGUF | Q6_K | 7.76 GB | Download |
| glm-4-9b-chat-1m-Q8_0.gguf | GGUF | — | 9.39 GB | Download |
| glm-4-9b-chat-1m-f16.gguf | GGUF | F16 | 17.67 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "other",
"license_name": "glm-4",
"license_link": "https://huggingface.co/THUDM/glm-4-9b-chat-1m/blob/main/LICENSE",
"inference": false,
"base_model": "THUDM/glm-4-9b-chat-1m",
"model_creator": "THUDM",
"model_name": "glm-4-9b-chat-1m",
"quantized_by": "Second State Inc.",
"language": [
"zh",
"en"
],
"tags": [
"glm",
"chatglm",
"thudm"
],
"frontmatter": {
"license": "other",
"license_name": "glm-4",
"license_link": "https://huggingface.co/THUDM/glm-4-9b-chat-1m/blob/main/LICENSE",
"inference": "false",
"base_model": "THUDM/glm-4-9b-chat-1m",
"model_creator": "THUDM",
"model_name": "glm-4-9b-chat-1m",
"quantized_by": "Second State Inc.",
"language": [
"zh",
"en"
],
"tags": [
"glm",
"chatglm",
"thudm"
]
},
"hero_image_url": "https://github.com/GaiaNet-AI/.github/assets/45785633/d6976adc-f97d-4f86-a648-0f2f5c8e7eee",
"summary": "",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: other\nlicense_name: glm-4\nlicense_link: https://huggingface.co/THUDM/glm-4-9b-chat-1m/blob/main/LICENSE\ninference: false\nbase_model: THUDM/glm-4-9b-chat-1m\nmodel_creator: THUDM\nmodel_name: glm-4-9b-chat-1m\nquantized_by: Second State Inc.\nlanguage:\n- zh\n- en\ntags:\n- glm\n- chatglm\n- thudm\n---\n\n\n\n# glm-4-9b-chat-1m-GGUF\n\n## Original Model\n\n[THUDM/glm-4-9b-chat-1m](https://huggingface.co/THUDM/glm-4-9b-chat-1m)\n\n## Run with Gaianet\n\n**Prompt template:**\n\nprompt template: `glm-4-chat`\n\n**Context size:**\n\nchat_ctx_size: `1000000`\n\n**Run with GaiaNet:**\n\n- Quick start with glm-4-9b-chat-1m: https://github.com/GaiaNet-AI/node-configs/blob/main/glm-4-9b-chat-1m/README.md \n\n- Customize your node: https://docs.gaianet.ai/node-guide/customize\n\n*Quantized with llama.cpp b3333*\n",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"chatglm",
"glm",
"thudm",
"custom_code",
"zh",
"en",
"base_model:zai-org/glm-4-9b-chat-1m",
"base_model:quantized:zai-org/glm-4-9b-chat-1m",
"license:other",
"region:us",
"conversational"
],
"likes": 3,
"downloads": 168,
"gated": false,
"private": false,
"last_modified": "2024-07-11T05:11:25.000Z",
"created_at": "2024-07-08T06:50:01.000Z",
"pipeline_tag": "",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "668b8c1936ff6fa34e7df009",
"id": "gaianet/glm-4-9b-chat-1m-GGUF",
"modelId": "gaianet/glm-4-9b-chat-1m-GGUF",
"sha": "6ab1cabbe0d2bf0f186b209fe6a4908e696930bd",
"createdAt": "2024-07-08T06:50:01.000Z",
"lastModified": "2024-07-11T05:11:25.000Z",
"author": "gaianet",
"downloads": 168,
"likes": 3,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "transformers",
"siblings_count": 16
}