Model Intelligence Sheet
eugene-kamenev/GRM-3.2-Sky-Q4_K_M-GGUF overview
Quantized using no mtp flag, Tested the inference does work using latest llama.cpp with vision support.
Runs locally from ~857.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
5 GGUF files detected
Direct downloads for local inference
Model Details
| Model ID | eugene-kamenev/GRM-3.2-Sky-Q4_K_M-GGUF |
|---|---|
| Author | eugene-kamenev |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | OrionLLM/GRM-3.2-Sky |
| Last modified | 2026-08-02T02:58:40.000Z |
Model README
---
license: apache-2.0
base_model: OrionLLM/GRM-3.2-Sky
pipeline_tag: image-text-to-text
tags:
- llama-cpp
---
Quantized using --no-mtp flag,
Tested the inference does work using latest llama.cpp with vision support.
Run eugene-kamenev/GRM-3.2-Sky-Q4_K_M-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models