GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ngquocvinh/MiniCPM-V-4.7-1B-GGUF overview

MiniCPM V 4.7 1B GGUF Community GGUF quantizations of openbmb/MiniCPM V 4.7 1B https://huggingface.co/openbmb/MiniCPM V 4.7 1B . <div align="center" style="bac…

llama.cppggufminicpm-vquantizedmultimodalimage-text-to-textconversationalbase_model:openbmb/MiniCPM-V-4.7-1Bbase_model:quantized:openbmb/MiniCPM-V-4.7-1Blicense:apache-2.0endpoints_compatibleregion:usimatrix

Runs locally from ~2.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
1
Pipeline
image-text-to-text

Repository Files & Downloads

32 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
MiniCPM-V-4_7-1B-IQ1_M.ggufGGUFIQ1_M402.0 MBDownload
MiniCPM-V-4_7-1B-IQ1_S.ggufGGUFIQ1_S394.0 MBDownload
MiniCPM-V-4_7-1B-IQ2_M.ggufGGUFIQ2_M464.4 MBDownload
MiniCPM-V-4_7-1B-IQ2_S.ggufGGUFIQ2_S453.7 MBDownload
MiniCPM-V-4_7-1B-IQ2_XS.ggufGGUFIQ2_XS426.4 MBDownload
MiniCPM-V-4_7-1B-IQ2_XXS.ggufGGUFIQ2_XXS415.3 MBDownload
MiniCPM-V-4_7-1B-IQ3_M.ggufGGUFIQ3_M536.8 MBDownload
MiniCPM-V-4_7-1B-IQ3_S.ggufGGUFIQ3_S533.9 MBDownload
MiniCPM-V-4_7-1B-IQ3_XS.ggufGGUFIQ3_XS526.7 MBDownload
MiniCPM-V-4_7-1B-IQ3_XXS.ggufGGUFIQ3_XXS483.5 MBDownload
MiniCPM-V-4_7-1B-IQ4_NL.ggufGGUFIQ4_NL628.2 MBDownload
MiniCPM-V-4_7-1B-IQ4_XS.ggufGGUFIQ4_XS609.3 MBDownload
MiniCPM-V-4_7-1B-Q2_0.ggufGGUFQ2_0480.8 MBDownload
MiniCPM-V-4_7-1B-Q2_K.ggufGGUFQ2_K482.1 MBDownload
MiniCPM-V-4_7-1B-Q2_K_S.ggufGGUFQ2_K_S474.8 MBDownload
MiniCPM-V-4_7-1B-Q3_K_L.ggufGGUFQ3_K_L572.5 MBDownload
MiniCPM-V-4_7-1B-Q3_K_M.ggufGGUFQ3_K_M548.5 MBDownload
MiniCPM-V-4_7-1B-Q3_K_S.ggufGGUFQ3_K_S519.1 MBDownload
MiniCPM-V-4_7-1B-Q4_0.ggufGGUFQ4_0615.0 MBDownload
MiniCPM-V-4_7-1B-Q4_1.ggufGGUFQ4_1659.1 MBDownload
MiniCPM-V-4_7-1B-Q4_K_M.ggufGGUFQ4_K_M640.9 MBDownload
MiniCPM-V-4_7-1B-Q4_K_S.ggufGGUFQ4_K_S617.9 MBDownload
MiniCPM-V-4_7-1B-Q5_0.ggufGGUFQ5_0704.6 MBDownload
MiniCPM-V-4_7-1B-Q5_1.ggufGGUFQ5_1748.7 MBDownload
MiniCPM-V-4_7-1B-Q5_K_M.ggufGGUFQ5_K_M717.6 MBDownload
MiniCPM-V-4_7-1B-Q5_K_S.ggufGGUFQ5_K_S703.9 MBDownload
MiniCPM-V-4_7-1B-Q6_K.ggufGGUFQ6_K799.1 MBDownload
MiniCPM-V-4_7-1B-Q8_0.ggufGGUFQ8_01.01 GBDownload
MiniCPM-V-4_7-1B-TQ1_0.ggufGGUFGGUF447.5 MBDownload
MiniCPM-V-4_7-1B-TQ2_0.ggufGGUFGGUF469.7 MBDownload
calibration/MiniCPM-V-4_7-1B.imatrix.ggufGGUFGGUF2.2 MBDownload
mmproj-model-f16.ggufGGUFF161.03 GBDownload

Model Details

Model IDngquocvinh/MiniCPM-V-4.7-1B-GGUF
Authorngquocvinh
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelopenbmb/MiniCPM-V-4.7-1B
Last modified2026-10-15T06:40:08.000Z

Model README

---

license: apache-2.0

base_model: openbmb/MiniCPM-V-4.7-1B

base_model_relation: quantized

library_name: llama.cpp

pipeline_tag: image-text-to-text

tags:

  • gguf
  • llama.cpp
  • minicpm-v
  • quantized
  • multimodal
  • image-text-to-text

---

MiniCPM-V 4.7 1B GGUF

Community GGUF quantizations of openbmb/MiniCPM-V-4.7-1B.

<div align="center" style="background-color:#f59e0b;color:#ffffff;padding:16px 20px;border-radius:10px;line-height:1.7;">

☕ If this GGUF made your day easier, a coffee would make mine.<br>

<a href="https://ko-fi.com/ngquocvinh" style="color:#ffffff;"><strong style="color:#ffffff;">Send a coffee ☕</strong></a><br>

I build and test these releases myself. Your coffee helps keep me going.<br>

Thank you for supporting this work.

</div>

About MiniCPM-V 4.7

MiniCPM-V 4.7 1B is OpenBMB's compact multimodal model for image and video understanding. The upstream model describes single-image, multi-image, and video use, with an efficient vision encoder and on-device deployment targets. See the official model card and the upstream deployment guide.

The upstream configuration declares a 262,144-token text context. The example below uses a 4,096-token context; long-context behavior has not been evaluated in this release. This GGUF release keeps the vision projector in F16 and quantizes the language-model weights. The default upstream 16x visual-token compression is used.

<a href="https://huggingface.co/openbmb/MiniCPM-V-4.7-1B"><img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/minicpmv4.7/performance_efficiency_frontier.png" alt="Performance versus inference time for MiniCPM-V 4.7 1B"></a>

Quick start

With a CPU build of llama.cpp, ask a question about a local image:

./llama-mtmd-cli \
  -m MiniCPM-V-4_7-1B-Q4_K_M.gguf \
  --mmproj mmproj-model-f16.gguf \
  --chat-template-file chat_template.jinja \
  --image ./photo.jpg \
  --jinja \
  --simple-io --single-turn \
  -p 'Describe the image in one sentence.' \
  -n 128 -c 4096

Reproducibility and validation

The locked upstream BF16 checkpoint is converted to one F16 GGUF, and every quantized language-model GGUF is quantized directly from that same F16 input using a MiniCPM-V 4.7 1B-specific imatrix. No quantized GGUF is used as the source for another quantization. The projector stays in F16. The reproducibility manifest records source and runtime revisions, hashes, commands, and validation details. Artifact measurements use decimal GB (bytes / 1e9); SHA256SUMS.txt covers the published files.

Each published quantization is loaded with llama.cpp and must generate non-empty output for text and a single-image prompt. This is a compatibility smoke test, not a quality benchmark. No hold-out fidelity evaluation is published, so this card does not rank quantizations or make quality recommendations. The 2-bit, IQ, and ternary variants are experimental builds without a quality claim.

License and attribution

The upstream model is licensed under Apache 2.0. These are community GGUF quantizations, not an official OpenBMB release or endorsement.

Run ngquocvinh/MiniCPM-V-4.7-1B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models