unsloth/DeepSeek-V4-Flash-0731-GGUF overview
Read our How to Run DeepSeek V4 0731 Guide https://unsloth.ai/docs/models/deepseek v4 <p style="margin top: 0;margin bottom: 0;" <em <a href="https://unsloth.a…
Runs locally from ~5.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| UD-IQ1_M/DeepSeek-V4-Flash-0731-UD-IQ1_M-00001-of-00003.gguf | GGUF | IQ1_M | 5.0 MB | Download |
| UD-IQ1_M/DeepSeek-V4-Flash-0731-UD-IQ1_M-00002-of-00003.gguf | GGUF | IQ1_M | 46.05 GB | Download |
| UD-IQ1_M/DeepSeek-V4-Flash-0731-UD-IQ1_M-00003-of-00003.gguf | GGUF | IQ1_M | 34.88 GB | Download |
| UD-IQ1_S/DeepSeek-V4-Flash-0731-UD-IQ1_S-00001-of-00003.gguf | GGUF | IQ1_S | 5.0 MB | Download |
| UD-IQ1_S/DeepSeek-V4-Flash-0731-UD-IQ1_S-00002-of-00003.gguf | GGUF | IQ1_S | 45.72 GB | Download |
| UD-IQ1_S/DeepSeek-V4-Flash-0731-UD-IQ1_S-00003-of-00003.gguf | GGUF | IQ1_S | 31.14 GB | Download |
| UD-IQ2_M/DeepSeek-V4-Flash-0731-UD-IQ2_M-00001-of-00003.gguf | GGUF | IQ2_M | 5.0 MB | Download |
| UD-IQ2_M/DeepSeek-V4-Flash-0731-UD-IQ2_M-00002-of-00003.gguf | GGUF | IQ2_M | 46.53 GB | Download |
| UD-IQ2_M/DeepSeek-V4-Flash-0731-UD-IQ2_M-00003-of-00003.gguf | GGUF | IQ2_M | 38.15 GB | Download |
| UD-IQ2_XXS/DeepSeek-V4-Flash-0731-UD-IQ2_XXS-00001-of-00003.gguf | GGUF | IQ2_XXS | 5.0 MB | Download |
| UD-IQ2_XXS/DeepSeek-V4-Flash-0731-UD-IQ2_XXS-00002-of-00003.gguf | GGUF | IQ2_XXS | 46.46 GB | Download |
| UD-IQ2_XXS/DeepSeek-V4-Flash-0731-UD-IQ2_XXS-00003-of-00003.gguf | GGUF | IQ2_XXS | 38.15 GB | Download |
| UD-IQ3_S/DeepSeek-V4-Flash-0731-UD-IQ3_S-00001-of-00004.gguf | GGUF | IQ3_S | 5.0 MB | Download |
| UD-IQ3_S/DeepSeek-V4-Flash-0731-UD-IQ3_S-00002-of-00004.gguf | GGUF | IQ3_S | 45.63 GB | Download |
| UD-IQ3_S/DeepSeek-V4-Flash-0731-UD-IQ3_S-00003-of-00004.gguf | GGUF | IQ3_S | 46.24 GB | Download |
| UD-IQ3_S/DeepSeek-V4-Flash-0731-UD-IQ3_S-00004-of-00004.gguf | GGUF | IQ3_S | 16.22 GB | Download |
| UD-IQ3_XXS/DeepSeek-V4-Flash-0731-UD-IQ3_XXS-00001-of-00004.gguf | GGUF | IQ3_XXS | 5.0 MB | Download |
| UD-IQ3_XXS/DeepSeek-V4-Flash-0731-UD-IQ3_XXS-00002-of-00004.gguf | GGUF | IQ3_XXS | 46.48 GB | Download |
| UD-IQ3_XXS/DeepSeek-V4-Flash-0731-UD-IQ3_XXS-00003-of-00004.gguf | GGUF | IQ3_XXS | 45.87 GB | Download |
| UD-IQ3_XXS/DeepSeek-V4-Flash-0731-UD-IQ3_XXS-00004-of-00004.gguf | GGUF | IQ3_XXS | 4.69 GB | Download |
| UD-IQ4_NL/DeepSeek-V4-Flash-0731-UD-IQ4_NL-00001-of-00004.gguf | GGUF | IQ4_NL | 5.0 MB | Download |
| UD-IQ4_NL/DeepSeek-V4-Flash-0731-UD-IQ4_NL-00002-of-00004.gguf | GGUF | IQ4_NL | 46.04 GB | Download |
| UD-IQ4_NL/DeepSeek-V4-Flash-0731-UD-IQ4_NL-00003-of-00004.gguf | GGUF | IQ4_NL | 46.20 GB | Download |
| UD-IQ4_NL/DeepSeek-V4-Flash-0731-UD-IQ4_NL-00004-of-00004.gguf | GGUF | IQ4_NL | 35.04 GB | Download |
| UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS-00001-of-00004.gguf | GGUF | IQ4_XS | 5.0 MB | Download |
| UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS-00002-of-00004.gguf | GGUF | IQ4_XS | 46.04 GB | Download |
| UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS-00003-of-00004.gguf | GGUF | IQ4_XS | 46.20 GB | Download |
| UD-IQ4_XS/DeepSeek-V4-Flash-0731-UD-IQ4_XS-00004-of-00004.gguf | GGUF | IQ4_XS | 35.04 GB | Download |
| UD-Q2_K_XL/DeepSeek-V4-Flash-0731-UD-Q2_K_XL-00001-of-00003.gguf | GGUF | Q2_K_XL | 5.0 MB | Download |
| UD-Q2_K_XL/DeepSeek-V4-Flash-0731-UD-Q2_K_XL-00002-of-00003.gguf | GGUF | Q2_K_XL | 46.04 GB | Download |
| UD-Q2_K_XL/DeepSeek-V4-Flash-0731-UD-Q2_K_XL-00003-of-00003.gguf | GGUF | Q2_K_XL | 44.14 GB | Download |
| UD-Q3_K_M/DeepSeek-V4-Flash-0731-UD-Q3_K_M-00001-of-00004.gguf | GGUF | Q3_K_M | 5.0 MB | Download |
| UD-Q3_K_M/DeepSeek-V4-Flash-0731-UD-Q3_K_M-00002-of-00004.gguf | GGUF | Q3_K_M | 45.84 GB | Download |
| UD-Q3_K_M/DeepSeek-V4-Flash-0731-UD-Q3_K_M-00003-of-00004.gguf | GGUF | Q3_K_M | 46.13 GB | Download |
| UD-Q3_K_M/DeepSeek-V4-Flash-0731-UD-Q3_K_M-00004-of-00004.gguf | GGUF | Q3_K_M | 27.30 GB | Download |
| UD-Q3_K_XL/DeepSeek-V4-Flash-0731-UD-Q3_K_XL-00001-of-00004.gguf | GGUF | Q3_K_XL | 5.0 MB | Download |
| UD-Q3_K_XL/DeepSeek-V4-Flash-0731-UD-Q3_K_XL-00002-of-00004.gguf | GGUF | Q3_K_XL | 45.96 GB | Download |
| UD-Q3_K_XL/DeepSeek-V4-Flash-0731-UD-Q3_K_XL-00003-of-00004.gguf | GGUF | Q3_K_XL | 46.13 GB | Download |
| UD-Q3_K_XL/DeepSeek-V4-Flash-0731-UD-Q3_K_XL-00004-of-00004.gguf | GGUF | Q3_K_XL | 27.30 GB | Download |
| UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00001-of-00005.gguf | GGUF | Q4_K_XL | 5.0 MB | Download |
| UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00002-of-00005.gguf | GGUF | Q4_K_XL | 45.57 GB | Download |
| UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00003-of-00005.gguf | GGUF | Q4_K_XL | 45.62 GB | Download |
| UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00004-of-00005.gguf | GGUF | Q4_K_XL | 46.57 GB | Download |
| UD-Q4_K_XL/DeepSeek-V4-Flash-0731-UD-Q4_K_XL-00005-of-00005.gguf | GGUF | Q4_K_XL | 6.68 GB | Download |
| UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00001-of-00005.gguf | GGUF | Q8_K_XL | 5.0 MB | Download |
| UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00002-of-00005.gguf | GGUF | Q8_K_XL | 45.84 GB | Download |
| UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00003-of-00005.gguf | GGUF | Q8_K_XL | 46.29 GB | Download |
| UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00004-of-00005.gguf | GGUF | Q8_K_XL | 46.07 GB | Download |
| UD-Q8_K_XL/DeepSeek-V4-Flash-0731-UD-Q8_K_XL-00005-of-00005.gguf | GGUF | Q8_K_XL | 12.56 GB | Download |
| dspark-DeepSeek-V4-Flash-0731-Q8_0.gguf | GGUF | Q8_0 | 10.15 GB | Download |
| dspark/dspark-DeepSeek-V4-Flash-0731-BF16.gguf | GGUF | BF16 | 10.54 GB | Download |
Model Details
Model README
---
license: mit
tags:
- unsloth
- deepseek_v4
- deepseek
base_model:
- deepseek-ai/DeepSeek-V4-Flash-0731
base_model_relation: quantized
---
Read our How to Run DeepSeek-V4-0731 Guide!
<p style="margin-top: 0;margin-bottom: 0;">
<em><a href="https://unsloth.ai/docs/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
</p>
<div style="display: flex; gap: 5px; align-items: center; ">
<a href="https://github.com/unslothai/unsloth/">
<img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
</a>
<a href="https://discord.gg/unsloth">
<img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
</a>
<a href="https://unsloth.ai/docs/models/deepseek-v4">
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
</a>
</div>
</div>
<ul style="margin: 0;">
<li>To run DeepSeek-V4-Flash-0731 in full precision lossless, run Q8 (UD-Q8_K_XL), which is 162GB and only 7GB bigger than Q4 (UD-Q4_K_XL).</li>
<li>See our <a href="https://unsloth.ai/docs/models/deepseek-v4">DeepSeek-V4 guide</a> for quantization analysis and instructions.</li>
<li>You can now run DeepSeek-V4-Flash-0731 in <a href="https://github.com/unslothai/unsloth/">Unsloth Studio</a> with toggles for High and Max thinking.</li>
<li><b>New DSpark support allowing up to 2x faster decoding!</b><a href="https://unsloth.ai/docs/models/deepseek-v4#dspark-speculative-decoding"> Docs for DSpark</a></li> </ul>
</div>
<img width="600" alt="deepseek-v4-flash-0731 in unsloth studio" src="https://3215535692-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FxhOjnexMCB3dmuQFQ2Zq%2Fuploads%2FlvJqDRKlWdAVkn3HXJZA%2F1000024247.png?alt=media&token=e84fd31d-7720-40d5-aba1-ba65ac34ce97" />
---
DeepSeek-V4-Flash-0731
<!-- markdownlint-disable first-line-h1 -->
<!-- markdownlint-disable html -->
<!-- markdownlint-disable no-duplicate-header -->
<div align="center">
<img src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/logo.svg?raw=true" width="60%" alt="DeepSeek-V4" />
</div>
<hr>
<div align="center" style="line-height: 1;">
<a href="https://www.deepseek.com/" target="_blank" style="margin: 2px;">
<img alt="Homepage" src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/badge.svg?raw=true" style="display: inline-block; vertical-align: middle;"/>
</a>
<a href="https://chat.deepseek.com/" target="_blank" style="margin: 2px;">
<img alt="Chat" src="https://img.shields.io/badge/🤖%20Chat-DeepSeek%20V4-536af5?color=536af5&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
</a>
</div>
<div align="center" style="line-height: 1;">
<a href="https://huggingface.co/deepseek-ai" target="_blank" style="margin: 2px;">
<img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-DeepSeek%20AI-ffc107?color=ffc107&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
</a>
<a href="https://twitter.com/deepseek_ai" target="_blank" style="margin: 2px;">
<img alt="Twitter Follow" src="https://img.shields.io/badge/Twitter-deepseek_ai-white?logo=x&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
</a>
</div>
<div align="center" style="line-height: 1;">
<a href="LICENSE" style="margin: 2px;">
<img alt="License" src="https://img.shields.io/badge/License-MIT-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/>
</a>
</div>
<p align="center">
<a href="https://arxiv.org/abs/2606.19348"><b>Technical Report</b>👁️</a>
</p>
Introduction
DeepSeek-V4-Flash-0731 is the official release of DeepSeek-V4-Flash, superseding the preview version, with substantially enhanced agentic capabilities. It has the same model structure as DeepSeek-V4-Flash-DSpark, i.e. it comes with a speculative decoding module attached.
DeepSeek-V4-Flash-0731 outperforms DeepSeek-V4-Pro (Preview) on benchmarks listed below despite its far smaller activated parameter count, and is broadly competitive with the strongest proprietary models available.
<div align="center">
| Benchmark | DeepSeek-V4-Flash-0731 | DeepSeek-V4-Flash (Preview) | DeepSeek-V4-Pro (Preview) | GLM-5.2 | Opus-4.8 |
| :--- | :---: | :---: | :---: | :---: | :---: |
| Terminal Bench 2.1 | 82.7 | 61.8 | 72.1 | 81.0 | 85.0 |
| NL2Repo | 54.2 | 39.4 | 38.5 | 48.9 | 69.7 |
| Cybergym | 76.7 | 38.7 | 52.7 | - | 83.1 |
| DeepSWE | 54.4 | 7.3 | 12.8 | 46.2 | 58.0 |
| Toolathlon-Verified | 70.3 | 49.7 | 55.9 | 59.9 | 76.2 |
| Agents' Last Exam | 25.2 | 15.8 | 16.5 | 23.8 | 25.7 |
| AutomationBench Public | 25.1 | 10.8 | 12.8 | 12.9 | 27.2 |
| DSBench-FullStack † | 68.7 | 37.0 | 41.8 | 61.8 | 71.6 |
| DSBench-Hard † | 59.6 | 25.8 | 31.1 | 54.5 | 71.7 |
</div>
Notes:
- For the Code Agent tasks among the public benchmarks above, DeepSeek-V4-Flash-0731 is evaluated with the minimal mode of DeepSeek Harness (to be released) as the agent framework, using the
maxreasoning effort level withtemperature = 1.0, top_p = 0.95. - † DSBench-FullStack is an internal full-stack development test set; DSBench-Hard is an internal test set of difficult coding-agent problems.
License
This repository and the model weights are licensed under the MIT License.
Citation
@misc{deepseekai2026deepseekv4,
title={DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence},
author={DeepSeek-AI},
year={2026},
}Run unsloth/DeepSeek-V4-Flash-0731-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models