Model Intelligence Sheet
owao/Sabi-Noema-GGUF overview
Sabi Noema GGUF Quantizations See the original model card https://huggingface.co/sabicap/sabi noema for details description, benchmarks, generation parameters …
Runs locally from ~888.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
10 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Sabi-Noema-BF16.gguf | GGUF | BF16 | 50.11 GB | Download |
| Sabi-Noema-Q3_K_L.gguf | GGUF | Q3_K_L | 13.36 GB | Download |
| Sabi-Noema-Q3_K_M.gguf | GGUF | Q3_K_M | 12.39 GB | Download |
| Sabi-Noema-Q4_K_M.gguf | GGUF | Q4_K_M | 15.41 GB | Download |
| Sabi-Noema-Q4_K_S.gguf | GGUF | Q4_K_S | 14.52 GB | Download |
| Sabi-Noema-Q5_K_M.gguf | GGUF | Q5_K_M | 17.91 GB | Download |
| Sabi-Noema-Q5_K_S.gguf | GGUF | Q5_K_S | 17.40 GB | Download |
| Sabi-Noema-Q6_K.gguf | GGUF | Q6_K | 20.57 GB | Download |
| Sabi-Noema-Q8_0.gguf | GGUF | Q8_0 | 26.63 GB | Download |
| mmproj-Sabi-Noema-BF16.gguf | GGUF | BF16 | 888.0 MB | Download |
Model Details
| Model ID | owao/Sabi-Noema-GGUF |
|---|---|
| Author | owao |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | sabicap/sabi-noema |
| Last modified | 2026-10-15T14:20:14.000Z |
Model README
---
license: apache-2.0
pipeline_tag: text-generation
library_name: llama.cpp
tags:
- gguf
- qwen3_5
- image-text-to-text
- agentic
- reinforcement-learning
- tool-use
- hybrid-attention
- qwen3.8
- conversational
base_model:
- sabicap/sabi-noema
---
Sabi-Noema GGUF Quantizations
See the original model card for details (description, benchmarks, generation parameters).
Speculative decoding
sabi didn't include spec decoding tensors, but you can try one from any other Qwen3.8-27B GGUFs. For example:
- ggml-org/Qwen3.8-27B-GGUF — MTP and DFLASH
- unsloth/Qwen3.8-27B-GGUF — MTP only
I'm getting around 40%+ acc rate with Unsloth Q4_0 MTP.
Usage
llama-cli -m Sabi-Noema-Q4_K_M.gguf --mmproj mmproj-Sabi-Noema-BF16.gguf --model-draft mtp-Qwen3.8-27B-Q4_0.gguf --spec-type draft-mtpConversion
llama.cpp 23deec025 (v0.6.0)
Run owao/Sabi-Noema-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models