kinson888/Huihui-DeepSeek-V4-Flash-Q2-ds4-GGUF overview
Huihui DeepSeek V4 Flash Q2 for DS4 Slim serving repository containing only Huihui DeepSeek V4 Flash BF16 abliterated ds4 Q2.gguf . The weight file is copied s…
Runs locally from ~80.76 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Huihui-DeepSeek-V4-Flash-BF16-abliterated-ds4-Q2.gguf | GGUF | BF16 | 80.76 GB | Download |
Model Details
Model README
---
license: other
base_model: deepseek-ai/DeepSeek-V4-Flash-Base
library_name: gguf
---
Huihui DeepSeek V4 Flash Q2 for DS4
Slim serving repository containing only Huihui-DeepSeek-V4-Flash-BF16-abliterated-ds4-Q2.gguf.
The weight file is copied server-side from
huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF at revision f06f59bce3c36b3282b75c9fe2621c83c9399d10.
This repository exists to avoid caching unrelated Q2_K, Q4_K, and MTP files in
RunPod Serverless.
Run kinson888/Huihui-DeepSeek-V4-Flash-Q2-ds4-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models