GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

unsloth/DeepSeek-V4-Flash-0731-GGUF overview

Read our How to Run DeepSeek V4 0731 Guide https://unsloth.ai/docs/models/deepseek v4 <p style="margin top: 0;margin bottom: 0;" <em <a href="https://unsloth.a…

ggufunslothdeepseek_v4deepseekarxiv:2606.19348base_model:deepseek-ai/DeepSeek-V4-Flash-0731base_model:quantized:deepseek-ai/DeepSeek-V4-Flash-0731license:mitendpoints_compatibleregion:usimatrixconversational

Runs locally from ~5.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
145,105
Likes
563
Pipeline
Author

Repository Files & Downloads

51 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
UD-IQ1_M/DeepSeek-V4-Flash-0731-UD-IQ1_M-00001-of-00003.ggufGGUFIQ1_M5.0 MBDownload
UD-IQ1_M/DeepSeek-V4-Flash-0731-UD-IQ1_M-00002-of-00003.ggufGGUFIQ1_M46.05 GBDownload
UD-IQ1_M/DeepSeek-V4-Flash-0731-UD-IQ1_M-00003-of-00003.ggufGGUFIQ1_M34.88 GBDownload
UD-IQ1_S/DeepSeek-V4-Flash-0731-UD-IQ1_S-00001-of-00003.ggufGGUFIQ1_S5.0 MBDownload
UD-IQ1_S/DeepSeek-V4-Flash-0731-UD-IQ1_S-00002-of-00003.ggufGGUFIQ1_S45.72 GBDownload
UD-IQ1_S/DeepSeek-V4-Flash-0731-UD-IQ1_S-00003-of-00003.ggufGGUFIQ1_S31.14 GBDownload
UD-IQ2_M/DeepSeek-V4-Flash-0731-UD-IQ2_M-00001-of-00003.ggufGGUFIQ2_M5.0 MBDownload
UD-IQ2_M/DeepSeek-V4-Flash-0731-UD-IQ2_M-00002-of-00003.ggufGGUFIQ2_M46.53 GBDownload
UD-IQ2_M/DeepSeek-V4-Flash-0731-UD-IQ2_M-00003-of-00003.ggufGGUFIQ2_M38.15 GBDownload
UD-IQ2_XXS/DeepSeek-V4-Flash-0731-UD-IQ2_XXS-00001-of-00003.ggufGGUFIQ2_XXS5.0 MBDownload
UD-IQ2_XXS/DeepSeek-V4-Flash-0731-UD-IQ2_XXS-00002-of-00003.ggufGGUFIQ2_XXS46.46 GBDownload
UD-IQ2_XXS/DeepSeek-V4-Flash-0731-UD-IQ2_XXS-00003-of-00003.ggufGGUFIQ2_XXS38.15 GBDownload
UD-IQ3_S/DeepSeek-V4-Flash-0731-UD-IQ3_S-00001-of-00004.ggufGGUFIQ3_S5.0 MBDownload
UD-IQ3_S/DeepSeek-V4-Flash-0731-UD-IQ3_S-00002-of-00004.ggufGGUFIQ3_S45.63 GBDownload
UD-IQ3_S/DeepSeek-V4-Flash-0731-UD-IQ3_S-00003-of-00004.ggufGGUFIQ3_S46.24 GBDownload
UD-IQ3_S/DeepSeek-V4-Flash-0731-UD-IQ3_S-00004-of-00004.ggufGGUFIQ3_S16.22 GBDownload
UD-IQ3_XXS/DeepSeek-V4-Flash-0731-UD-IQ3_XXS-00001-of-00004.ggufGGUFIQ3_XXS5.0 MBDownload
UD-IQ3_XXS/DeepSeek-V4-Flash-0731-UD-IQ3_XXS-00002-of-00004.ggufGGUFIQ3_XXS46.48 GBDownload
UD-IQ3_XXS/DeepSeek-V4-Flash-0731-UD-IQ3_XXS-00003-of-00004.ggufGGUFIQ3_XXS45.87 GBDownload
UD-IQ3_XXS/DeepSeek-V4-Flash-0731-UD-IQ3_XXS-00004-of-00004.ggufGGUFIQ3_XXS4.69 GBDownload
UD-IQ4_NL/DeepSeek-V4-Flash-0731-UD-IQ4_NL-00001-of-00004.ggufGGUFIQ4_NL5.0 MBDownload
UD-IQ4_NL/DeepSeek-V4-Flash-0731-UD-IQ4_NL-00002-of-00004.ggufGGUFIQ4_NL46.04 GBDownload
UD-IQ4_NL/DeepSeek-V4-Flash-0731-UD-IQ4_NL-00003-of-00004.ggufGGUFIQ4_NL46.20 GBDownload
UD-IQ4_NL/DeepSeek-V4-Flash-0731-UD-IQ4_NL-00004-of-00004.ggufGGUFIQ4_NL35.04 GBDownload
UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS-00001-of-00004.ggufGGUFIQ4_XS5.0 MBDownload
UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS-00002-of-00004.ggufGGUFIQ4_XS46.04 GBDownload
UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS-00003-of-00004.ggufGGUFIQ4_XS46.20 GBDownload
UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS-00004-of-00004.ggufGGUFIQ4_XS35.04 GBDownload
UD-Q2_K_XL/DeepSeek-V4-Flash-0731-UD-Q2_K_XL-00001-of-00003.ggufGGUFQ2_K_XL5.0 MBDownload
UD-Q2_K_XL/DeepSeek-V4-Flash-0731-UD-Q2_K_XL-00002-of-00003.ggufGGUFQ2_K_XL46.04 GBDownload
UD-Q2_K_XL/DeepSeek-V4-Flash-0731-UD-Q2_K_XL-00003-of-00003.ggufGGUFQ2_K_XL44.14 GBDownload
UD-Q3_K_M/DeepSeek-V4-Flash-0731-UD-Q3_K_M-00001-of-00004.ggufGGUFQ3_K_M5.0 MBDownload
UD-Q3_K_M/DeepSeek-V4-Flash-0731-UD-Q3_K_M-00002-of-00004.ggufGGUFQ3_K_M45.84 GBDownload
UD-Q3_K_M/DeepSeek-V4-Flash-0731-UD-Q3_K_M-00003-of-00004.ggufGGUFQ3_K_M46.13 GBDownload
UD-Q3_K_M/DeepSeek-V4-Flash-0731-UD-Q3_K_M-00004-of-00004.ggufGGUFQ3_K_M27.30 GBDownload
UD-Q3_K_XL/DeepSeek-V4-Flash-0731-UD-Q3_K_XL-00001-of-00004.ggufGGUFQ3_K_XL5.0 MBDownload
UD-Q3_K_XL/DeepSeek-V4-Flash-0731-UD-Q3_K_XL-00002-of-00004.ggufGGUFQ3_K_XL45.96 GBDownload
UD-Q3_K_XL/DeepSeek-V4-Flash-0731-UD-Q3_K_XL-00003-of-00004.ggufGGUFQ3_K_XL46.13 GBDownload
UD-Q3_K_XL/DeepSeek-V4-Flash-0731-UD-Q3_K_XL-00004-of-00004.ggufGGUFQ3_K_XL27.30 GBDownload
UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00001-of-00005.ggufGGUFQ4_K_XL5.0 MBDownload
UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00002-of-00005.ggufGGUFQ4_K_XL45.57 GBDownload
UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00003-of-00005.ggufGGUFQ4_K_XL45.62 GBDownload
UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00004-of-00005.ggufGGUFQ4_K_XL46.57 GBDownload
UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00005-of-00005.ggufGGUFQ4_K_XL6.68 GBDownload
UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00001-of-00005.ggufGGUFQ8_K_XL5.0 MBDownload
UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00002-of-00005.ggufGGUFQ8_K_XL45.84 GBDownload
UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00003-of-00005.ggufGGUFQ8_K_XL46.29 GBDownload
UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00004-of-00005.ggufGGUFQ8_K_XL46.07 GBDownload
UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00005-of-00005.ggufGGUFQ8_K_XL12.56 GBDownload
dspark-DeepSeek-V4-Flash-0731-Q8_0.ggufGGUFQ8_010.15 GBDownload
dspark/dspark-DeepSeek-V4-Flash-0731-BF16.ggufGGUFBF1610.54 GBDownload

Model Details

Model IDunsloth/DeepSeek-V4-Flash-0731-GGUF
Authorunsloth
Pipeline
Licensemit
Base modeldeepseek-ai/DeepSeek-V4-Flash-0731
Last modified2026-08-06T14:54:45.000Z

Model README

---

license: mit

tags:

  • unsloth
  • deepseek_v4
  • deepseek

base_model:

  • deepseek-ai/DeepSeek-V4-Flash-0731

base_model_relation: quantized

---

Read our How to Run DeepSeek-V4-0731 Guide!

<p style="margin-top: 0;margin-bottom: 0;">

<em><a href="https://unsloth.ai/docs/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>

</p>

<div style="display: flex; gap: 5px; align-items: center; ">

<a href="https://github.com/unslothai/unsloth/">

<img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">

</a>

<a href="https://discord.gg/unsloth">

<img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">

</a>

<a href="https://unsloth.ai/docs/models/deepseek-v4">

<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">

</a>

</div>

</div>

<ul style="margin: 0;">

<li>To run DeepSeek-V4-Flash-0731 in full precision lossless, run Q8 (UD-Q8_K_XL), which is 162GB and only 7GB bigger than Q4 (UD-Q4_K_XL).</li>

<li>See our <a href="https://unsloth.ai/docs/models/deepseek-v4">DeepSeek-V4 guide</a> for quantization analysis and instructions.</li>

<li>You can now run DeepSeek-V4-Flash-0731 in <a href="https://github.com/unslothai/unsloth/">Unsloth Studio</a> with toggles for High and Max thinking.</li>

<li><b>New DSpark support allowing up to 2x faster decoding!</b><a href="https://unsloth.ai/docs/models/deepseek-v4#dspark-speculative-decoding"> Docs for DSpark</a></li> </ul>

</div>

<img width="600" alt="deepseek-v4-flash-0731 in unsloth studio" src="https://3215535692-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FxhOjnexMCB3dmuQFQ2Zq%2Fuploads%2FlvJqDRKlWdAVkn3HXJZA%2F1000024247.png?alt=media&token=e84fd31d-7720-40d5-aba1-ba65ac34ce97" />

---

DeepSeek-V4-Flash-0731

<!-- markdownlint-disable first-line-h1 -->

<!-- markdownlint-disable html -->

<!-- markdownlint-disable no-duplicate-header -->

<div align="center">

<img src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/logo.svg?raw=true" width="60%" alt="DeepSeek-V4" />

</div>

<hr>

<div align="center" style="line-height: 1;">

<a href="https://www.deepseek.com/" target="_blank" style="margin: 2px;">

<img alt="Homepage" src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/badge.svg?raw=true" style="display: inline-block; vertical-align: middle;"/>

</a>

<a href="https://chat.deepseek.com/" target="_blank" style="margin: 2px;">

<img alt="Chat" src="https://img.shields.io/badge/🤖%20Chat-DeepSeek%20V4-536af5?color=536af5&logoColor=white" style="display: inline-block; vertical-align: middle;"/>

</a>

</div>

<div align="center" style="line-height: 1;">

<a href="https://huggingface.co/deepseek-ai" target="_blank" style="margin: 2px;">

<img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-DeepSeek%20AI-ffc107?color=ffc107&logoColor=white" style="display: inline-block; vertical-align: middle;"/>

</a>

<a href="https://twitter.com/deepseek_ai" target="_blank" style="margin: 2px;">

<img alt="Twitter Follow" src="https://img.shields.io/badge/Twitter-deepseek_ai-white?logo=x&logoColor=white" style="display: inline-block; vertical-align: middle;"/>

</a>

</div>

<div align="center" style="line-height: 1;">

<a href="LICENSE" style="margin: 2px;">

<img alt="License" src="https://img.shields.io/badge/License-MIT-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/>

</a>

</div>

<p align="center">

<a href="https://arxiv.org/abs/2606.19348"><b>Technical Report</b>👁️</a>

</p>

Introduction

DeepSeek-V4-Flash-0731 is the official release of DeepSeek-V4-Flash, superseding the preview version, with substantially enhanced agentic capabilities. It has the same model structure as DeepSeek-V4-Flash-DSpark, i.e. it comes with a speculative decoding module attached.

DeepSeek-V4-Flash-0731 outperforms DeepSeek-V4-Pro (Preview) on benchmarks listed below despite its far smaller activated parameter count, and is broadly competitive with the strongest proprietary models available.

<div align="center">

| Benchmark | DeepSeek-V4-Flash-0731 | DeepSeek-V4-Flash (Preview) | DeepSeek-V4-Pro (Preview) | GLM-5.2 | Opus-4.8 |

| :--- | :---: | :---: | :---: | :---: | :---: |

| Terminal Bench 2.1 | 82.7 | 61.8 | 72.1 | 81.0 | 85.0 |

| NL2Repo | 54.2 | 39.4 | 38.5 | 48.9 | 69.7 |

| Cybergym | 76.7 | 38.7 | 52.7 | - | 83.1 |

| DeepSWE | 54.4 | 7.3 | 12.8 | 46.2 | 58.0 |

| Toolathlon-Verified | 70.3 | 49.7 | 55.9 | 59.9 | 76.2 |

| Agents' Last Exam | 25.2 | 15.8 | 16.5 | 23.8 | 25.7 |

| AutomationBench Public | 25.1 | 10.8 | 12.8 | 12.9 | 27.2 |

| DSBench-FullStack † | 68.7 | 37.0 | 41.8 | 61.8 | 71.6 |

| DSBench-Hard † | 59.6 | 25.8 | 31.1 | 54.5 | 71.7 |

</div>

Notes:

  1. For the Code Agent tasks among the public benchmarks above, DeepSeek-V4-Flash-0731 is evaluated with the minimal mode of DeepSeek Harness (to be released) as the agent framework, using the max reasoning effort level with temperature = 1.0, top_p = 0.95.
  2. † DSBench-FullStack is an internal full-stack development test set; DSBench-Hard is an internal test set of difficult coding-agent problems.

License

This repository and the model weights are licensed under the MIT License.

Citation

@misc{deepseekai2026deepseekv4,
      title={DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence},
      author={DeepSeek-AI},
      year={2026},
}

Run unsloth/DeepSeek-V4-Flash-0731-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models