GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ShayonSarker/SmolVLM-500M-Instruct-MM-GGUF overview

SmolVLM 500M Instruct full multimodal GGUF Q4 text + F16 mmproj Base: HuggingFaceTB/SmolVLM 500M Instruct Apache 2.0 · Text tower: Q4 K M imatrix quant reused …

ggufllama.cppvisionsmolvlmchartqaimage-text-to-textbase_model:HuggingFaceTB/SmolVLM-500M-Instructbase_model:finetune:HuggingFaceTB/SmolVLM-500M-Instructlicense:apache-2.0region:us
Downloads
0
Likes
0
Pipeline
image-text-to-text

Repository Files & Downloads

0 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Browse files on Hugging Face

Model Details

Model IDShayonSarker/SmolVLM-500M-Instruct-MM-GGUF
AuthorShayonSarker
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelHuggingFaceTB/SmolVLM-500M-Instruct
Last modified2026-09-19T19:16:15.000Z

Model README

---

base_model: HuggingFaceTB/SmolVLM-500M-Instruct

tags:

  • gguf
  • llama.cpp
  • vision
  • smolvlm
  • chartqa

license: apache-2.0

pipeline_tag: image-text-to-text

---

SmolVLM-500M-Instruct full-multimodal GGUF (Q4 text + F16 mmproj)

Base: HuggingFaceTB/SmolVLM-500M-Instruct (Apache-2.0) · Text tower: Q4_K_M imatrix quant (reused from our measured build, +1.85% text PPL) · Vision: F16 mmproj via convert_hf_to_gguf.py --mmproj

Status

Pipeline running. Vision eval (50 real ChartQA images via llama-mtmd-cli) fills the table below on gate pass (bar ≥20%).

Eval (pending gate)

| model | ChartQA-50 vision relaxed-acc |

|---|---|

| SmolVLM-500M-Instruct base (published) | 63.2 (test, for reference) |

| Q4 + mmproj (this repo) | _pending_ |

Use

./llama-mtmd-cli -m q4.gguf --mmproj mmproj-f16.gguf --image chart.png -p "What value is shown for 2015?"

Needs both files from this repo. Fully offline.

Run ShayonSarker/SmolVLM-500M-Instruct-MM-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models