mondk/DeepSeek-V4.1-Flash-1017-GGUF overview
DeepSeek V4.1 Flash 1017 GGUF GGUF quants of deepseek ai/DeepSeek V4.1 Flash 1017 https://huggingface.co/deepseek ai/DeepSeek V4.1 Flash 1017 . | Folder | Size…
Runs locally from ~3.74 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00001-of-00010.gguf | GGUF | Q3_K_M | 37.05 GB | Download |
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00002-of-00010.gguf | GGUF | Q3_K_M | 35.99 GB | Download |
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00003-of-00010.gguf | GGUF | Q3_K_M | 35.99 GB | Download |
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00004-of-00010.gguf | GGUF | Q3_K_M | 35.99 GB | Download |
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00005-of-00010.gguf | GGUF | Q3_K_M | 35.99 GB | Download |
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00006-of-00010.gguf | GGUF | Q3_K_M | 35.99 GB | Download |
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00007-of-00010.gguf | GGUF | Q3_K_M | 23.99 GB | Download |
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00008-of-00010.gguf | GGUF | Q3_K_M | 39.34 GB | Download |
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00009-of-00010.gguf | GGUF | Q3_K_M | 39.34 GB | Download |
| Q3_K_M/DeepSeek-V4.1-Flash-1017-Q3_K_M-00010-of-00010.gguf | GGUF | Q3_K_M | 3.74 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00001-of-00010.gguf | GGUF | Q4_K_M | 48.16 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00002-of-00010.gguf | GGUF | Q4_K_M | 44.89 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00003-of-00010.gguf | GGUF | Q4_K_M | 44.89 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00004-of-00010.gguf | GGUF | Q4_K_M | 44.89 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00005-of-00010.gguf | GGUF | Q4_K_M | 44.89 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00006-of-00010.gguf | GGUF | Q4_K_M | 45.98 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00007-of-00010.gguf | GGUF | Q4_K_M | 32.83 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00008-of-00010.gguf | GGUF | Q4_K_M | 51.50 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00009-of-00010.gguf | GGUF | Q4_K_M | 51.50 GB | Download |
| Q4_K_M/DeepSeek-V4.1-Flash-1017-Q4_K_M-00010-of-00010.gguf | GGUF | Q4_K_M | 4.67 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00001-of-00010.gguf | GGUF | Q8_0 | 40.35 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00002-of-00010.gguf | GGUF | Q8_0 | 40.34 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00003-of-00010.gguf | GGUF | Q8_0 | 40.34 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00004-of-00010.gguf | GGUF | Q8_0 | 40.34 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00005-of-00010.gguf | GGUF | Q8_0 | 40.34 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00006-of-00010.gguf | GGUF | Q8_0 | 40.34 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00007-of-00010.gguf | GGUF | Q8_0 | 26.89 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00008-of-00010.gguf | GGUF | Q8_0 | 97.28 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00009-of-00010.gguf | GGUF | Q8_0 | 97.28 GB | Download |
| Q8_0/DeepSeek-V4.1-Flash-1017-Q8_0-00010-of-00010.gguf | GGUF | Q8_0 | 9.56 GB | Download |
Model Details
| Model ID | mondk/DeepSeek-V4.1-Flash-1017-GGUF |
|---|---|
| Author | mondk |
| Pipeline | image-text-to-text |
| License | mit |
| Base model | deepseek-ai/DeepSeek-V4.1-Flash-1017 |
| Last modified | 2026-10-17T15:16:05.000Z |
Model README
---
license: mit
base_model: deepseek-ai/DeepSeek-V4.1-Flash-1017
base_model_relation: quantized
pipeline_tag: image-text-to-text
tags:
- gguf
- llama.cpp
- deepseek
---
DeepSeek-V4.1-Flash-1017 GGUF
GGUF quants of deepseek-ai/DeepSeek-V4.1-Flash-1017.
| Folder | Size | Files | Notes |
|---|---|---|---|
| Q8_0 | 473 GiB | 10 | Q8_0 everywhere except the routed experts, which keep their native MXFP4. Closest to the original weights. |
| Q4_K_M | 414 GiB | 10 | The routed experts are already about 4-bit, so this saves less than usual. |
| Q3_K_M | 323 GiB | 10 | |
| Q2_K | 246 GiB | 10 | Smallest usable size. |
These are plain quants with no imatrix. Each folder holds a split GGUF. Point llama.cpp at the -00001-of- file and it loads the rest.
Running
Mainline llama.cpp doesn't support DeepSeek V4.1 yet. These files were made with the branch from ggml-org/llama.cpp#28696 at commit 2076412, and they need that branch or a build that includes it.
git clone https://github.com/vcruz305/llama.cpp && cd llama.cpp
git checkout 2076412598e99127ea2554467b2b7530856895d3
cmake -B build && cmake --build build -j
The two engram tables are large and read a few rows per token. Keeping them on the CPU works well, for example -ot "engram_embd.weight=CPU". The PR has a tested command line.
Text only for now. The llama.cpp branch can't convert the vision tower yet.
Acknowledgements
Huge thanks to Hugging Face for generously sponsoring the compute used for this project 🤗
Run mondk/DeepSeek-V4.1-Flash-1017-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models