---

license: mit

library_name: hebrus

pipeline_tag: text-generation

base_model: deepseek-ai/DeepSeek-V4-Flash

base_model_relation: quantized

quantized_by: antirez

language:

• en

tags:

• hebrus
• gguf
• deepseek
• deepseek-v4
• deepseek-v4-flash
• apple-silicon
• metal
• moe
• expert-major
• iq2_xxs
• q2_k
• imatrix

inference: false

---

DeepSeek V4 Flash — Hebrus ExpertMajor v2

This repository contains DeepSeek V4 Flash artifacts for

andreaborio/hebrus, a source-built

Apple Metal inference engine with bounded SSD expert streaming.

These files are Hebrus-native GGUF extensions. Routed MoE weights are stored

once in an embedded, checksummed ds4.expert_major.v2 store. The ds4 token

in existing filenames and in that tensor identifier is a stable compatibility

field; the runtime and Hugging Face library name are Hebrus.

> Hebrus is not a general GGUF runner. Use only the exact artifact and revision

> listed below. Generic llama.cpp, MLX, Ollama, and hosted Hugging Face

> inference cannot execute the embedded ExpertMajor store.

Supported artifacts

| Artifact | Support status | Hugging Face revision | Bytes | SHA-256 | Minimum unified memory |

| --- | --- | --- | ---: | --- | ---: |

| DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-DS4-ExpertMajor-v2.gguf | Hebrus 0.3.0 default · Qualified pinned download; selected by deepseek-v2 | ds4-v0.2.0, resolving to c0740cd4830f142068a6fbbe074f062f2c7c3d19 | 86,720,114,272 | 8378080263eb9224f7228d72e2afa4ac3cf74a116023fdec2c596ff228a33e3f | 64 GiB |

| DeepSeek-V4-Flash-0731-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-DS4-ExpertMajor-v2.gguf | Current · Opt in; public and covered by dated Hebrus evidence, but not selected by deepseek-v2 | 63e5f2a8fedeeb77add33e13da5f946c043698bc | 86,720,114,240 | d89dd628ed786ecf14285cb886459eec01df89fd7e7bf3cbff1416a551bcd966 | 64 GiB |

The first row is the reproducible release path in the current Hebrus downloader

and runtime contract. The second row is intentionally not substituted into

that command: its retained results are scoped to the exact 0731 artifact,

hardware, prompts, and modes in the

2026-08-05 evidence record.

The Hebrus 0.3.0 release

records that a new exact-artifact DeepSeek smoke was skipped by maintainer

decision. No result from the byte-different 0731 artifact is attributed to the

pinned default.

The canonical GGUF without DS4-ExpertMajor-v2 is an offline converter input,

not an inference fallback. Hebrus rejects it during model admission.

Quick start: qualified pinned artifact

Requirements:

• an Apple Silicon Mac with at least 64 GiB unified memory;
• Xcode Command Line Tools;
• enough local SSD space for the 86,720,114,272-byte artifact;
• the official Hugging Face CLI.

git clone https://github.com/andreaborio/hebrus.git
cd hebrus
git checkout v0.3.0

xcode-select --install
python3 -m pip install -U huggingface_hub hf_xet
make -j

./download_model.sh deepseek-v2

./hebrus \
  -m gguf/DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-DS4-ExpertMajor-v2.gguf \
  --ctx 8192 \
  -p "Explain bounded SSD expert streaming in one paragraph."

The downloader pins ds4-v0.2.0 and verifies both the complete byte count and

SHA-256 before reporting success. The model repositories are public and

ungated, so downloading does not require a Hugging Face token.

Normal startup uses AUTO. On qualified hardware it may resolve to resident

Metal execution or bounded SSD streaming. Do not add a sidecar, model-admission

bypass, manual expert-cache size, or backend flag to the release command.

Optional 0731 artifact

To reproduce the separate opt-in record, download the exact immutable path and

verify it independently:

hf download andreaborio/DeepSeek-V4-Flash-Hebrus-GGUF \
  DeepSeek-V4-Flash-0731-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-DS4-ExpertMajor-v2.gguf \
  --repo-type model \
  --revision 63e5f2a8fedeeb77add33e13da5f946c043698bc \
  --local-dir gguf

shasum -a 256 \
  gguf/DeepSeek-V4-Flash-0731-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-DS4-ExpertMajor-v2.gguf

Expected digest:

d89dd628ed786ecf14285cb886459eec01df89fd7e7bf3cbff1416a551bcd966.

This manual path does not change what deepseek-v2 downloads.

Compatibility and limits

• Apple Silicon and Metal are the only qualified production backend.
• The minimum qualified memory is 64 GiB; it is not a promise that every

context or concurrent workload fits.

• CPU is reference/debug only. CUDA and ROCm sources are absent, and

distributed inference is retired.

• ExpertMajor v1, sidecars, canonical routed-weight GGUF inference, and model

admission bypasses are rejected.

• Performance depends on the exact artifact, runtime revision, context,

prompt, storage state, memory pressure, routing locality, and thermals.

• inference: false is deliberate: these custom files are not served by the

Hugging Face hosted inference widget.

The current authority for supported modes and hardware floors is the

Hebrus runtime support contract.

License and attribution

The upstream deepseek-ai/DeepSeek-V4-Flash

repository declares the MIT license. DeepSeek retains the base-model

copyright. Quantization credit belongs to antirez and the DS4 project; the

embedded ExpertMajor v2 layout and current runtime are maintained by Hebrus.