samuelchristlie/deepseek-r1-0528-qwen3-8b-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "mit",
    "base_model": [
      "deepseek-ai/DeepSeek-R1-0528-Qwen3-8B",
      "Qwen/Qwen3-8B"
    ],
    "frontmatter": {
      "license": "mit",
      "base_model": [
        "deepseek-ai/DeepSeek-R1-0528-Qwen3-8B",
        "Qwen/Qwen3-8B"
      ]
    },
    "hero_image_url": "",
    "summary": "## Direct GGUF Quantizations of DeepSeek-R1-0528-Qwen3-8B This repository provides GGUF quantized models for **deepseek-ai/DeepSeek-R1-0528-Qwen3-8B**. DeepSeek-R1-0528-Qwen3-8B is a powerful 8 billion parameter Large Language Model developed by DeepSeek AI. It is an Instruct model based on the Qwen3 architecture, excelling in a wide range of text generation tasks including chat, coding, and reasoning. These GGUF versions are optimized for efficient CPU and GPU inference using llama.cpp and compatible tools. This release includes various quantization levels (e.g., Q2_K, Q3_K_M, Q4_K_M, Q5_K_M, Q6_K, Q8_0) to suit different hardware capabilities and performance requirements.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: mit\nbase_model:\n- deepseek-ai/DeepSeek-R1-0528-Qwen3-8B\n- Qwen/Qwen3-8B\n---\n\n# DeepSeek-R1-0528-Qwen3-8B-GGUF\n## Direct GGUF Quantizations of DeepSeek-R1-0528-Qwen3-8B\n\nThis repository provides GGUF quantized models for **deepseek-ai/DeepSeek-R1-0528-Qwen3-8B**.\n\nDeepSeek-R1-0528-Qwen3-8B is a powerful 8 billion parameter Large Language Model developed by DeepSeek AI. It is an Instruct model based on the Qwen3 architecture, excelling in a wide range of text generation tasks including chat, coding, and reasoning. These GGUF versions are optimized for efficient CPU and GPU inference using `llama.cpp` and compatible tools.\n\nThis release includes various quantization levels (e.g., Q2_K, Q3_K_M, Q4_K_M, Q5_K_M, Q6_K, Q8_0) to suit different hardware capabilities and performance requirements.\n\n## Table of Contents 📝\n1. ▶ [Usage](#usage)\n2. 📃 [License](#license)\n3. 🙏 [Acknowledgements](#acknowledgements)\n\n<a name=\"usage\"/>\n\n## ▶ Usage\n\n### 1. Download Models\nDownload models using `huggingface-cli`:\n```bash\npip install \"huggingface_hub[cli]\"\nhuggingface-cli download samuelchristlie/DeepSeek-R1-0528-Qwen3-8B-GGUF --local-dir ./DeepSeek-R1-0528-Qwen3-8B-GGUF\n```\nYou can also download directly from [this page](https://huggingface.co/samuelchristlie/DeepSeek-R1-0528-Qwen3-8B-GGUF/tree/main)\n\n### 2. Inference\nTo use these GGUF files, you'll need a compatible inference engine like `llama.cpp` or clients built on top of it (e.g., `Ollama`, `LM Studio`, `KoboldCpp`, `text-generation-webui` with `llama.cpp` backend).\n\n<a name=\"license\"/>\n\n## 📃 License\nThis model is a GGUF conversion of the original `deepseek-ai/DeepSeek-R1-0528-Qwen3-8B` model. The original model is licensed under the **MIT License**, and this derivative work adheres to the terms of that license. Please review the original license for full details.\n\n<a name=\"acknowledgements\"/>\n\n## 🙏 Acknowledgements\n*   **DeepSeek AI** for developing and open-sourcing the powerful DeepSeek-R1-0528-Qwen3-8B model:\n    *   [DeepSeek-R1-0528-Qwen3-8B on Hugging Face](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528-Qwen3-8B)\n*   The **llama.cpp** project and its contributors for the GGUF format and the incredible tooling that makes local LLM inference accessible.\n    *   [llama.cpp GitHub Repository](https://github.com/ggerganov/llama.cpp)\n*   **city96**:\n    *   [https://huggingface.co/city96](https://huggingface.co/city96)\n\n</div>",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "base_model:Qwen/Qwen3-8B",
    "base_model:quantized:Qwen/Qwen3-8B",
    "license:mit",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 1122,
  "gated": false,
  "private": false,
  "last_modified": "2025-05-29T18:24:37.000Z",
  "created_at": "2025-05-29T13:48:18.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "683865a2cce754234b5a84fc",
  "id": "samuelchristlie/DeepSeek-R1-0528-Qwen3-8B-GGUF",
  "modelId": "samuelchristlie/DeepSeek-R1-0528-Qwen3-8B-GGUF",
  "sha": "a10e157e66ed2502ec28f008c6354f42c0bc6010",
  "createdAt": "2025-05-29T13:48:18.000Z",
  "lastModified": "2025-05-29T18:24:37.000Z",
  "author": "samuelchristlie",
  "downloads": 1122,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 20
}