GraySoft
Projects Models About FAQ Contact Download guIDE โ†’
Model Intelligence Sheet

teichai/qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-gguf overview

This model was trained on a Claude Sonnet 4.5 (reasoning) dataset with a high reasoning effort. | Model | Effective parameters | Active parameters | | ------------- | ------------- | ------------- | | TeichAI/gpt-oss-20b-claude-4.5-sonnet-high-reasoning-distill-GGUF | 20 B | 3 B | | TeichAI/Qwen3-14B-Claude-Sonnet-4.5-Reasoning-Distill-GGUF | 14 B | 14 B | | TeichAI/Qwen3-8B-Claude-Sonnet-4.5-Reasoning-Distill-GGUF | 8 B | 8 B | --- This qwen3_moe model was trained 2x faster with Unsloth and Huggingface's TRL library.

transformersgguftext-generation-inferenceunslothqwen3_moetext-generationendataset:TeichAI/claude-sonnet-4.5-high-reasoning-250xbase_model:TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distillbase_model:quantized:TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distilllicense:apache-2.0endpoints_compatibleregion:usconversational
teichai/qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-gguf visual
Downloads
24,326
Likes
24
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

8 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-bf16-00001-of-00002.gguf GGUF BF16 46.24 GB Download
Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-bf16-00002-of-00002.gguf GGUF BF16 10.65 GB Download
Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-f16-00001-of-00002.gguf GGUF F16 46.24 GB Download
Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-f16-00002-of-00002.gguf GGUF F16 10.65 GB Download
Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-q3_k_m.gguf GGUF Q3_K_M 13.70 GB Download
Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-q3_k_s.gguf GGUF Q3_K_S 12.38 GB Download
Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-q4_k_m.gguf GGUF Q4_K_M 17.28 GB Download
Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-q8_0.gguf GGUF โ€” 30.25 GB Download

Model Details Live

Model Slug
teichai/qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-gguf
Author
TeichAI
Pipeline Task
text-generation
Library
transformers
Created
2025-11-16
Last Modified
2025-11-19
Gated
No
Private
No
HF SHA
42455ab3b1494c35b39d20dd9df1e795de4ff762
License
apache-2.0
Language
en
Base Model
TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": "TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill",
    "tags": [
      "text-generation-inference",
      "transformers",
      "unsloth",
      "qwen3_moe"
    ],
    "license": "apache-2.0",
    "language": [
      "en"
    ],
    "datasets": [
      "TeichAI/claude-sonnet-4.5-high-reasoning-250x"
    ],
    "pipeline_tag": "text-generation",
    "frontmatter": {
      "base_model": "TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill",
      "tags": [
        "text-generation-inference",
        "transformers",
        "unsloth",
        "qwen3_moe"
      ],
      "license": "apache-2.0",
      "language": [
        "en"
      ],
      "datasets": [
        "TeichAI/claude-sonnet-4.5-high-reasoning-250x"
      ],
      "pipeline_tag": "text-generation"
    },
    "hero_image_url": "https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png",
    "summary": "This model was trained on a **Claude Sonnet 4.5 (reasoning)** dataset with a high reasoning effort. | Model      | Effective parameters      | Active parameters     | | ------------- | ------------- | ------------- | | TeichAI/gpt-oss-20b-claude-4.5-sonnet-high-reasoning-distill-GGUF | 20 B | 3 B | | TeichAI/Qwen3-14B-Claude-Sonnet-4.5-Reasoning-Distill-GGUF | 14 B | 14 B | | TeichAI/Qwen3-8B-Claude-Sonnet-4.5-Reasoning-Distill-GGUF | 8 B | 8 B | --- This qwen3_moe model was trained 2x faster with Unsloth and Huggingface's TRL library.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill\ntags:\n- text-generation-inference\n- transformers\n- unsloth\n- qwen3_moe\nlicense: apache-2.0\nlanguage:\n- en\ndatasets:\n- TeichAI/claude-sonnet-4.5-high-reasoning-250x\npipeline_tag: text-generation\n---\n\n# Qwen3 30B A3B Claude Sonnet 4.5 Reasoning Distill\n\n\nThis model was trained on a **Claude Sonnet 4.5 (reasoning)** dataset with a high reasoning effort.\n\n- &#129302; Related Models:\n| Model      | Effective parameters      | Active parameters     |\n| ------------- | ------------- | ------------- |\n| [`TeichAI/gpt-oss-20b-claude-4.5-sonnet-high-reasoning-distill-GGUF`](https://huggingface.co/TeichAI/gpt-oss-20b-claude-4.5-sonnet-high-reasoning-distill-GGUF) | 20 B | 3 B |\n| [`TeichAI/Qwen3-14B-Claude-Sonnet-4.5-Reasoning-Distill-GGUF`](https://huggingface.co/TeichAI/Qwen3-14B-Claude-Sonnet-4.5-Reasoning-Distill-GGUF) | 14 B | 14 B |\n| [`TeichAI/Qwen3-8B-Claude-Sonnet-4.5-Reasoning-Distill-GGUF`](https://huggingface.co/TeichAI/Qwen3-8B-Claude-Sonnet-4.5-Reasoning-Distill-GGUF) | 8 B | 8 B |\n\n\n- ๐Ÿงฌ Datasets:\n  - `TeichAI/claude-sonnet-4.5-high-reasoning-250x`\n\n- ๐Ÿ— Base Model:\n  - `unsloth/qwen3-30b-a3b-thinking-2507`\n \n- &#9889; Use cases:\n  - Coding\n  - Science\n\n---\n- **Developed by:** TeichAI\n- **License:** apache-2.0\n- **Finetuned from model :** unsloth/qwen3-30b-a3b-thinking-2507\n\nThis qwen3_moe model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.\n\n[<img src=\"https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png\" width=\"200\"/>](https://github.com/unslothai/unsloth)",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "text-generation-inference",
    "unsloth",
    "qwen3_moe",
    "text-generation",
    "en",
    "dataset:TeichAI/claude-sonnet-4.5-high-reasoning-250x",
    "base_model:TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill",
    "base_model:quantized:TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 24,
  "downloads": 24326,
  "gated": false,
  "private": false,
  "last_modified": "2025-11-19T04:00:25.000Z",
  "created_at": "2025-11-16T05:39:40.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "6919639c852038da6d18208a",
  "id": "TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-GGUF",
  "modelId": "TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-GGUF",
  "sha": "42455ab3b1494c35b39d20dd9df1e795de4ff762",
  "createdAt": "2025-11-16T05:39:40.000Z",
  "lastModified": "2025-11-19T04:00:25.000Z",
  "author": "TeichAI",
  "downloads": 24326,
  "likes": 24,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 10
}