Model Intelligence Sheet
teichai/qwen3-4b-instruct-2507-claude-haiku-4.5-distill-gguf overview
This model was finetuned on 1700 high quality examples generated by Claude Haiku 4.5
Downloads
326
Likes
1
Pipeline
—
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
9 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3-4B-Instruct-Claude-Haiku-4.5-Distill.bf16.gguf | GGUF | BF16 | 7.50 GB | Download |
| Qwen3-4B-Instruct-Claude-Haiku-4.5-Distill.q3_k_m.gguf | GGUF | Q3_K_M | 1.93 GB | Download |
| Qwen3-4B-Instruct-Claude-Haiku-4.5-Distill.q3_k_s.gguf | GGUF | Q3_K_S | 1.76 GB | Download |
| Qwen3-4B-Instruct-Claude-Haiku-4.5-Distill.q4_k_m.gguf | GGUF | Q4_K_M | 2.33 GB | Download |
| Qwen3-4B-Instruct-Claude-Haiku-4.5-Distill.q4_k_s.gguf | GGUF | Q4_K_S | 2.22 GB | Download |
| Qwen3-4B-Instruct-Claude-Haiku-4.5-Distill.q5_k_m.gguf | GGUF | Q5_K_M | 2.69 GB | Download |
| Qwen3-4B-Instruct-Claude-Haiku-4.5-Distill.q5_k_s.gguf | GGUF | Q5_K_S | 2.63 GB | Download |
| Qwen3-4B-Instruct-Claude-Haiku-4.5-Distill.q6_k.gguf | GGUF | Q6_K | 3.08 GB | Download |
| Qwen3-4B-Instruct-Claude-Haiku-4.5-Distill.q8_0.gguf | GGUF | — | 3.99 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"tags": [
"gguf",
"llama.cpp",
"unsloth"
],
"datasets": [
"TeichAI/claude-haiku-4.5-1700x"
],
"base_model": [
"TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill"
],
"frontmatter": {
"tags": [
"gguf",
"llama.cpp",
"unsloth"
],
"datasets": [
"TeichAI/claude-haiku-4.5-1700x"
],
"base_model": [
"TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill"
]
},
"hero_image_url": "",
"summary": "This model was finetuned on 1700 high quality examples generated by Claude Haiku 4.5",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\ntags:\n- gguf\n- llama.cpp\n- unsloth\ndatasets:\n- TeichAI/claude-haiku-4.5-1700x\nbase_model:\n- TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill\n---\n\n# Qwen3 4B Instruct 2507 Claude Haiku 4.5 Distill - GGUF\n\nThis model was finetuned on 1700 high quality examples generated by [Claude Haiku 4.5](https://openrouter.ai/anthropic/claude-haiku-4.5)",
"related_quantizations": []
},
"tags": [
"gguf",
"llama.cpp",
"unsloth",
"dataset:TeichAI/claude-haiku-4.5-1700x",
"base_model:TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill",
"base_model:quantized:TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 1,
"downloads": 326,
"gated": false,
"private": false,
"last_modified": "2025-12-23T02:34:17.000Z",
"created_at": "2025-12-23T02:18:06.000Z",
"pipeline_tag": "",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "6949fbde5c3d54884b02292f",
"id": "TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill-GGUF",
"modelId": "TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill-GGUF",
"sha": "1a9ca840d4c46b906bd2cb0f860c1964e3bef98a",
"createdAt": "2025-12-23T02:18:06.000Z",
"lastModified": "2025-12-23T02:34:17.000Z",
"author": "TeichAI",
"downloads": 326,
"likes": 1,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "",
"siblings_count": 11
}