What is SC117/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-GGUF?

--- library_name: transformers license: mit license_link: https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B/blob/main/LICENSE pipeline_tag: text-generation tags: - qwen3_5_moe - reasoning - agentic-coding - heretic - mtp - apex - quantization - gguf - multimodal base_model: - ornith-ai/Ornith-1.5-35B-A3B --- <div style="position: absolute; top: 50%; left…

What license applies to SC117/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-GGUF?

License: mit. Verify terms on Hugging Face before commercial use.

Model Intelligence Sheet

SC117/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-GGUF overview

Q: What license applies to SC117/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-GGUF?

License: mit. Verify terms on Hugging Face before commercial use.

Q: How do I run SC117/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-GGUF locally?

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Q: How much VRAM or disk space does SC117/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-GGUF need?

Runs locally from ~861.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

<div style="font family: apple system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans serif; margin bottom: 24px;" <div style="background: f5f5f7; border radius:…

transformersggufqwen3_5_moereasoningagentic-codinghereticmtpapexquantizationmultimodaltext-generationbase_model:ornith-ai/Ornith-1.5-35B-A3Bbase_model:quantized:ornith-ai/Ornith-1.5-35B-A3Blicense:mitendpoints_compatibleregion:us

Runs locally from ~861.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads

Likes

Pipeline

text-generation

Author

SC117

Repository Files & Downloads

5 GGUF files detected

Direct downloads for local inference

File	Type	Quantization	Size	Link
Ornith-1.5-35B-A3B-Heretic-MTP-APEX-I-Balanced.gguf	GGUF	GGUF	24.27 GB	Download
Ornith-1.5-35B-A3B-Heretic-MTP-APEX-I-Compact.gguf	GGUF	GGUF	16.14 GB	Download
Ornith-1.5-35B-A3B-Heretic-MTP-APEX-I-Mini.gguf	GGUF	GGUF	13.29 GB	Download
Ornith-1.5-35B-A3B-Heretic-MTP-APEX-I-Quality.gguf	GGUF	GGUF	21.87 GB	Download
mmproj-Ornith-1.5-35B-A3B-Heretic-MTP-BF16.gguf	GGUF	BF16	861.0 MB	Download

Model Details

Model ID	SC117/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-GGUF
Author	SC117
Pipeline	text-generation
License	mit
Base model	ornith-ai/Ornith-1.5-35B-A3B
Last modified	2026-08-22T22:49:35.000Z

Model README

---

library_name: transformers

license: mit

license_link: https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B/blob/main/LICENSE

pipeline_tag: text-generation

tags:

qwen3_5_moe
reasoning
agentic-coding
heretic
mtp
apex
quantization
gguf
multimodal

base_model:

ornith-ai/Ornith-1.5-35B-A3B

---

<div style="display: inline-flex; gap: 8px; margin-bottom: 16px; position: relative; z-index: 1;"><span style="background: #007aff; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">HERETIC 1.4.0</span><span style="background: #af52de; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">MTP</span><span style="background: #30d158; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">APEX</span><span style="background: #ff9500; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">MIT</span></div>

<h1 style="margin: 0 0 8px 0; font-size: 32px; font-weight: 700; color: #1d1d1f; letter-spacing: -0.5px; border: none; position: relative; z-index: 1;">Ornith-1.5-35B-A3B-Heretic-MTP-APEX</h1>

<p style="margin: 8px 0 0 0; font-size: 14px; position: relative; z-index: 1;"><span style="color: #86868b;">English</span> | <a href="https://huggingface.co/SC117/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-GGUF/blob/main/README_zh.md" style="color: #007aff; text-decoration: none;">📖 中文文档</a></p>

<p style="margin: 0; font-size: 15px; color: #86868b; position: relative; z-index: 1;">Heretic Trial 62 BF16 merge · replaced MTP head · APEX GGUFs + mmproj</p>

</div>

./llama-server -m ./models/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-I-Compact.gguf --mmproj ./models/mmproj-Ornith-1.5-35B-A3B-Heretic-MTP-BF16.gguf -ngl 99 -c 131072 --draft-mtp</p></div></div>

<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);"><div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>❓</span> FAQ: Why is I-Balanced larger than I-Quality?</div><div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;"><p style="margin: 0 0 10px 0;"><b>Short answer: the tiers are bit-allocation strategies, not a size ladder.</b> APEX assigns precision per tensor from measured importance, so file size does not grow monotonically with the tier name.</p><p style="margin: 0 0 10px 0;"><b>I-Quality</b> keeps every sensitive tensor high-precision — attention Q6_K in all 40 blocks, shared experts Q8_0, edge blocks and the MTP layer high as well — but compresses the redundant middle routed experts (blk.10–30) aggressively to <b>IQ4_XS</b>. Routed experts carry most of an MoE's parameters, and the importance analysis shows the middle blocks absorb this compression with virtually no measurable loss. That is where the bytes are saved.</p><p style="margin: 0 0 10px 0;"><b>I-Balanced</b> is the conservative, uniform profile: no tensor anywhere below Q5_K. Uniformity simply costs more bytes.</p><p style="margin: 0 0 10px 0;">So bigger does not mean better. I-Quality is the smarter bit allocation and remains the highest-quality preset despite the smaller size; if you need a smaller file, step down to I-Compact or I-Mini instead of picking by file size.</p><table style="width: 100%; border-collapse: collapse; font-size: 13px;"><thead><tr style="background: rgba(255,107,53,0.05);"><th style="padding: 8px 10px; border-bottom: 2px solid #ff6b35; text-align: left; color: #c2410c;">Tensor group</th><th style="padding: 8px 10px; border-bottom: 2px solid #ff6b35; text-align: left; color: #c2410c;">I-Quality</th><th style="padding: 8px 10px; border-bottom: 2px solid #ff6b35; text-align: left; color: #c2410c;">I-Balanced</th></tr></thead><tbody><tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155;">Routed experts · edge blocks (0–4, 35–39)</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;">Q6_K</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;">Q6_K</td></tr><tr><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155;">Routed experts · blk.5–9, 31–34</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;">Q5_K</td><td style="padding: 6px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;">Q5_K</td></tr><tr><td style="padding: 6px 10px; font-weight: bold; color: #334155;">Routed experts · middle blocks (10–30)</td><td style="padding: 6px 10px;"><b>IQ4_XS</b></td><td style="padding: 6px 10px;"><b>Q5_K</b></td></tr><tr><td style="padding: 6px 10px; font-weight: bold; color: #334155;">Shared experts · all blocks</td><td style="padding: 6px 10px;">Q8_0</td><td style="padding: 6px 10px;">Q8_0</td></tr><tr><td style="padding: 6px 10px; font-weight: bold; color: #334155;">Attention · all 40 blocks</td><td style="padding: 6px 10px;">Q6_K</td><td style="padding: 6px 10px;">Q6_K</td></tr><tr><td style="padding: 6px 10px; font-weight: bold; color: #334155;">MTP layer (blk.40)</td><td style="padding: 6px 10px;">Q8_0</td><td style="padding: 6px 10px;">Q8_0</td></tr></tbody></table><p style="margin: 12px 0 0 0; font-size: 12px; color: #64748b; font-style: italic;">The two tiers are identical everywhere except the middle routed-expert band — that single band is the whole size difference.</p></div></div>

</div>

Citation

@misc{ornith-1.5-35b,
    title = {{Ornith-1.5-35B-A3B}: From Self-Scaffolding to Self-Improvement},
    url = {https://ornith.ai/ornith_1_5.html},
    author = {{DeepReinforce Team}},
    year = {2026}
}

Run SC117/Ornith-1.5-35B-A3B-Heretic-MTP-APEX-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models