Blackfrost-Research/M.O.G.-SEC-27B-1M-CTX-GGUF overview
<div align="center" mog 27b mog 27b.jpeg <h1 M.O.G. SEC 27B 1M CTX GGUF</h1 <h3 Minds of Gods · Qwentium, GOD of Cybersec · 1M context · full GGUF ladder + BF1…
Runs locally from ~884.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| M.O.G.-SEC-27B-1M-CTX-Q2_K.gguf | GGUF | Q2_K | 10.12 GB | Download |
| M.O.G.-SEC-27B-1M-CTX-Q3_K_L.gguf | GGUF | Q3_K_L | 13.56 GB | Download |
| M.O.G.-SEC-27B-1M-CTX-Q3_K_M.gguf | GGUF | Q3_K_M | 12.57 GB | Download |
| M.O.G.-SEC-27B-1M-CTX-Q3_K_S.gguf | GGUF | Q3_K_S | 11.41 GB | Download |
| M.O.G.-SEC-27B-1M-CTX-Q4_K_M.gguf | GGUF | Q4_K_M | 15.66 GB | Download |
| M.O.G.-SEC-27B-1M-CTX-Q4_K_S.gguf | GGUF | Q4_K_S | 14.74 GB | Download |
| M.O.G.-SEC-27B-1M-CTX-Q5_K_M.gguf | GGUF | Q5_K_M | 18.19 GB | Download |
| M.O.G.-SEC-27B-1M-CTX-Q5_K_S.gguf | GGUF | Q5_K_S | 17.67 GB | Download |
| M.O.G.-SEC-27B-1M-CTX-Q6_K.gguf | GGUF | Q6_K | 20.89 GB | Download |
| M.O.G.-SEC-27B-1M-CTX-Q8_0.gguf | GGUF | Q8_0 | 27.05 GB | Download |
| dflash-M.O.G.-SEC-27B-1M-CTX-BF16.gguf | GGUF | BF16 | 3.60 GB | Download |
| mmproj-M.O.G.-SEC-27B-1M-CTX-F16.gguf | GGUF | F16 | 884.6 MB | Download |
Model Details
| Model ID | Blackfrost-Research/M.O.G.-SEC-27B-1M-CTX-GGUF |
|---|---|
| Author | Blackfrost-Research |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | Blackfrost-Research/M.O.G.-SEC-27B-1M-CTX-BF16 |
| Last modified | 2026-08-22T16:57:05.000Z |
Model README
---
language:
- en
- multilingual
license: apache-2.0
base_model: Blackfrost-Research/M.O.G.-SEC-27B-1M-CTX-BF16
base_model_relation: quantized
library_name: llama.cpp
pipeline_tag: image-text-to-text
tags:
- qwen3.8
- qwen3.5
- qwen
- gguf
- llama.cpp
- cybersecurity
- offensive-security
- defensive-security
- uncensored
- 1m-context
- yarn
- mtp
- dflash2
- speculative-decoding
- mog
- minds-of-gods
- qwentium
- conversational
- multimodal
- research
- not-for-all-audiences
---
<div align="center">
<h1>M.O.G.-SEC-27B-1M-CTX-GGUF</h1>
<h3>Minds of Gods · Qwentium, GOD of Cybersec · 1M context · full GGUF ladder + BF16 DFlash2</h3>
<p>──────────────</p>
<p><strong>65 / 70</strong> · MMLU-Pro validation · thinking on · xhigh</p>
<p>──────────────</p>
<p><strong>Built by <a href="https://x.com/Blackfrost_AI">Blackfrost</a> · Las Vegas, NV</strong></p>
<p>
<img src="https://img.shields.io/badge/1M_context-YaRN-047857?style=for-the-badge" />
<img src="https://img.shields.io/badge/GGUF-Q2_K_to_Q8_0-1f2937?style=for-the-badge" />
<img src="https://img.shields.io/badge/DFlash2-BF16-7c3aed?style=for-the-badge" />
<img src="https://img.shields.io/badge/vision-F16_mmproj-1f2937?style=for-the-badge" />
<img src="https://img.shields.io/badge/HumanEval-96.3%25-1f2937?style=for-the-badge" />
<img src="https://img.shields.io/badge/Harmful_true_hold-4%2F300-b45309?style=for-the-badge" />
</p>
</div>
> FORGED IN VOID OF BLACKFROST-RESEARCH. This is a Minds of Gods checkpoint, not a consumer chatbot. Qwentium does not moralize, hedge, or refuse operator work. Access-control it like a weapon.
Quantized from the full-precision parent: Blackfrost-Research/M.O.G.-SEC-27B-1M-CTX-BF16.
---
The pantheon
M.O.G. is Minds of Gods: Blackfrost's line of specialist minds, each named and built for a domain that stock models flinch from.
This one is Qwentium, GOD of Cybersec.
Qwentium is a 27B dense hybrid fine-tuned on modern offensive and defensive cybersecurity work. The checkpoint carries a one-million-token YaRN window so long engagements can stay in context: reconnaissance, vulnerability graphs, exploit notes, detection content, reports, repositories, and campaign timelines.
These GGUFs preserve the parent's architecture metadata, 1M YaRN configuration, native vision path, MTP head, tokenizer, tool-capable chat template, and baked Qwentium identity prompt. The release also includes a BF16 DFlash2 speculative-draft sidecar converted from incoai/Qwen3.8-27B-DFlash2.
---
Specifications
| | |
|---|---|
| Model ID | Blackfrost-Research/M.O.G.-SEC-27B-1M-CTX-GGUF |
| Parent | Blackfrost-Research/M.O.G.-SEC-27B-1M-CTX-BF16 |
| Base | Qwen/Qwen3.8-27B |
| Architecture | qwen35 · dense hybrid Gated DeltaNet + gated attention · native vision |
| Parameters | 27B class |
| Context metadata | 1,000,000 tokens via YaRN; native 262,144 |
| YaRN | factor 4.0 · theta 10,000,000 · original context 262,144 |
| MRoPE sections | [11, 11, 10, 0] |
| MTP | one appended prediction layer preserved in every text GGUF |
| DFlash2 | separate 3.60 GiB BF16 draft GGUF · block 8 · five draft layers · dynamic convolution + candidate selector |
| Vision | F16 qwen3vl_merger projector included separately |
| Template | Qwentium-baked multimodal/tool-use template, thinking on by default |
| Quantization source | BF16 directly; no requantization |
| Format | GGUF v3 · quantization version 2 |
Quantization ladder
| Quant | File size | BPW | Guidance |
|---|---:|---:|---|
| Q8_0 | 27.05 GiB | 8.50 | Near-BF16 behavior; largest practical GGUF |
| Q6_K | 20.89 GiB | 6.56 | Maximum-quality K-quant |
| Q5_K_M | 18.19 GiB | 5.72 | High quality, balanced mixed quant |
| Q5_K_S | 17.67 GiB | 5.55 | Slightly smaller Q5 |
| Q4_K_M | 15.66 GiB | 4.92 | Recommended default |
| Q4_K_S | 14.74 GiB | 4.63 | Smaller Q4 |
| Q3_K_L | 13.56 GiB | 4.26 | Highest-quality Q3 |
| Q3_K_M | 12.57 GiB | 3.95 | Balanced Q3 |
| Q3_K_S | 11.41 GiB | 3.59 | Compact Q3 |
| Q2_K | 10.12 GiB | 3.18 | Smallest; expect the largest quality loss |
File size is only the model-weight floor. Leave memory for runtime buffers, the vision projector when used, and the context cache. A one-million-token runtime window has much higher memory requirements than a short-context load, regardless of quant size.
The ladder uses standard llama.cpp K-quants directly from the converted BF16 GGUF. No importance matrix was used and no quant was produced from another quant.
---
Download
Recommended Q4_K_M plus BF16 DFlash2 draft and native-vision projector:
hf download Blackfrost-Research/M.O.G.-SEC-27B-1M-CTX-GGUF \
M.O.G.-SEC-27B-1M-CTX-Q4_K_M.gguf \
dflash-M.O.G.-SEC-27B-1M-CTX-BF16.gguf \
mmproj-M.O.G.-SEC-27B-1M-CTX-F16.gguf \
--local-dir ./M.O.G.-SEC-27B-1M-CTX-GGUF
Text-only use does not require the projector.
Run with llama.cpp
Use a recent llama.cpp build with Qwen3.5/Qwen3.8 hybrid support.
Text
llama-cli \
-m M.O.G.-SEC-27B-1M-CTX-Q4_K_M.gguf \
-cnv -c 8192 -ngl 99
DFlash2 speculative server
DFlash2 GGUF support is currently under review in llama.cpp PR #27342. The release validation used the PR head pinned at commit 1deefcca395743049c3820ab8f9b15043f3e9446; a normal build without that change cannot load this DFlash2 sidecar yet.
Build that revision, then serve the recommended target/draft pair:
git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp
git fetch origin pull/27342/head:dflash2
git checkout 1deefcca395743049c3820ab8f9b15043f3e9446
cmake -S . -B build -DGGML_CUDA=ON -DCMAKE_BUILD_TYPE=Release
cmake --build build --config Release -j --target llama-server
./build/bin/llama-server \
-m M.O.G.-SEC-27B-1M-CTX-Q4_K_M.gguf \
--spec-draft-model dflash-M.O.G.-SEC-27B-1M-CTX-BF16.gguf \
--spec-type draft-dflash \
--spec-draft-n-max 3 \
--spec-draft-n-min 0 \
--spec-draft-p-min 0 \
-ngl all -ngld all \
--device CUDA0 --spec-draft-device CUDA0 \
--split-mode none --main-gpu 0 \
-c 1000000 -ctk q8_0 -ctv q8_0 \
--spec-draft-type-k f16 --spec-draft-type-v f16 \
-fa on --parallel 1 --jinja \
--host 0.0.0.0 --port 8001
Draft length 3 was selected by a local sweep of 2, 3, 4, and 7 tokens. The draft checkpoint's native context metadata is 262,144 tokens; using the sidecar beyond that range with the 1M target is experimental even though the target retains its full 1M YaRN metadata.
Vision
llama-cli \
-m M.O.G.-SEC-27B-1M-CTX-Q4_K_M.gguf \
-mm mmproj-M.O.G.-SEC-27B-1M-CTX-F16.gguf \
--image ./your-image.jpg \
-p "Describe this image." \
-cnv -c 8192 -ngl 99
The embedded template enables thinking by default. To disable it in current llama.cpp builds, add:
-rea off
One-million-token context
The GGUF metadata preserves the parent recipe:
context_length: 1000000
rope.scaling.type: yarn
rope.scaling.factor: 4.0
rope.scaling.original_context: 262144
rope.freq_base: 10000000
rope.dimension_sections: 11,11,10,0
Request the full window with -c 1000000. This is a hardware-heavy configuration: choose cache types, GPU offload, and tensor split for your system. The release validation below used short contexts; preserving the 1M metadata is not a claim that every llama.cpp backend or host can allocate and run the full window.
---
Validation
All twelve GGUF artifacts were structurally checked after conversion:
- Ten text quants:
qwen35, 866 tensors, 65 blocks, one MTP/NextN layer - Context: 1,000,000; YaRN factor 4.0; original context 262,144
- MRoPE sections:
[11, 11, 10, 0] - Embedded Qwentium template: 13,427 characters, identical across the ladder
- Vision projector:
qwen3vl_merger, F16, 334 tensors - DFlash2 draft:
dflash, 81 tensors, BF16 weights, block 8, selector rank 256/top-k 16, dynamic convolution kernel 2/group 16, target layers[6, 20, 34, 48, 62]
Q4_K_M was then smoke-tested with a local CUDA llama.cpp build on 4x NVIDIA RTX PRO 6000 Blackwell GPUs:
| Test | Result | Prompt | Generation |
|---|---|---:|---:|
| Text, 4K context | exact requested phrase | 2715.8 tok/s | 74.2 tok/s |
| Vision, 8K context | coherent description of the supplied artwork | 2374.9 tok/s | 69.1 tok/s |
These are single smoke runs on a busy shared host, not formal performance benchmarks.
The Q4_K_M target plus BF16 DFlash2 sidecar was also tested through the OpenAI-compatible llama.cpp server on one NVIDIA RTX PRO 6000 Blackwell 96 GB GPU. The server allocated the full 1,000,000-token target context with Q8_0 target KV, used one slot, temperature 0, thinking disabled, and draft length 3. Each topic generated 256 tokens:
| Topic | Decode | Draft acceptance |
|---|---:|---:|
| Speculative decoding | 89.45 tok/s | 144 / 331 · 43.5% |
| Event logging systems | 84.90 tok/s | 134 / 360 · 37.2% |
| TLS 1.3 | 92.40 tok/s | 144 / 330 · 43.6% |
| Median / weighted | 89.45 tok/s | 422 / 1,021 · 41.3% |
The measured acceptance gate was 49 tok/s from the prior clean-BF16 service. This GGUF configuration cleared it by 82.6% (1.83x). That comparison is an operational gate, not an engine-isolated benchmark: the prior service used a different precision/runtime/GPU topology. Results will vary with prompt distribution, backend, context occupancy, and sampling.
SHA-256 hashes for every GGUF are in SHA256SUMS.
---
Measured parent capability
The following results are inherited from the BF16 parent's model card. Capability and refusal benches were measured on its NVFP4 child, not independently on every GGUF quant. Quantization can change scores; reproduce on the exact file you deploy.
| Evaluation | Result |
|---|---:|
| MMLU-Pro validation, thinking xhigh | 65/70 · 92.9% |
| HumanEval, executed | 158/164 · 96.3% |
| WikiText-2 perplexity | 8.19 |
| Harmful true holds after full-text judge | 4/300 · 1.3% |
The source protocol and complete tables are documented on the BF16 parent card.
---
What Qwentium is for
- Adversary emulation, exploit reasoning, payload and tradecraft writeups
- Detection engineering, hunting queries, control gaps, and incident-response narrative
- Long-context case files: repositories, pcaps-as-text, ticket storms, and campaign timelines
- Operator work where refusal is the failure mode
This is not a public assistant and not a claim that every answer is correct. Validate outputs, isolate the runtime, control access, and use it only within your authorization and applicable law.
Notes and limitations
- The full ladder preserves the parent's one-layer MTP head. Standard inference works without a separate draft model; no GGUF MTP speedup is claimed here.
- The optional DFlash2 sidecar is a distinct speculative path and currently requires the pinned llama.cpp PR above. It was validated for text generation only.
- Native image/video input requires the included F16 projector and a compatible llama.cpp multimodal build.
- The model's custom template is Jinja-based and carries baked system identity, reasoning controls, tool-call formatting, and multimodal handling.
- Very low-bit quants trade capability for footprint. Q4_K_M or higher is recommended for demanding cyber work.
- The 1M context setting is static YaRN. Short-context behavior may differ from the native-context parent.
License
Apache-2.0, following the parent checkpoint. Review the parent model card and the base model's terms before deployment.
Run Blackfrost-Research/M.O.G.-SEC-27B-1M-CTX-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models