tooltd/GRM-3.2-Sky-MTP-GGUF overview
tooltd/GRM 3.2 Sky MTP GGUF This model was converted to GGUF format from OrionLLM/GRM 3.2 Sky https://huggingface.co/OrionLLM/GRM 3.2 Sky using llama.cpp via t…
Runs locally from ~34.37 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| grm-3.2-sky-q8_0.gguf | GGUF | Q8_0 | 34.37 GB | Download |
Model Details
| Model ID | tooltd/GRM-3.2-Sky-MTP-GGUF |
|---|---|
| Author | tooltd |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | OrionLLM/GRM-3.2-Sky |
| Last modified | 2026-08-02T04:28:44.000Z |
Model README
---
license: apache-2.0
base_model: OrionLLM/GRM-3.2-Sky
pipeline_tag: image-text-to-text
tags:
- llama-cpp
---
tooltd/GRM-3.2-Sky-MTP-GGUF
This model was converted to GGUF format from OrionLLM/GRM-3.2-Sky using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
MTP HEAD
- Download Qwen3.6-35B-A3B MTP-ONLY from https://huggingface.co/a4lg/Qwen3.6-35B-A3B-MTP-ONLY-GGUF
- Add MTP HEAD to
GRM-3.2-SkyGGUF model by using my script modified. otherwise, it will cause an error.
https://huggingface.co/tooltd/GRM-3.2-Sky-MTP-GGUF/blob/main/grm_mtp_graft.py
python grm_mtp_graft.py grm-3.2-sky-q8_0.gguf Qwen3.6-35B-A3B-MTP-ONLY-Q8_0.gguf grm-3.2-sky-mtp-q8_0.gguf
Draft acceptance rate is usually above 80%. Done!
Run tooltd/GRM-3.2-Sky-MTP-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models