---

base_model: openbmb/MiniCPM-V-4.7-1B

library_name: gguf

pipeline_tag: text-generation

tags:

- gguf

- llama.cpp

- quantized

---

MiniCPM-V-4.7-1B GGUF

GGUF quantizations of openbmb/MiniCPM-V-4.7-1B, covering 30 files (18.0 GB total).

Files

| File | Quant | Size | Notes |

|---|---|---:|---|

| MiniCPM-V-4.7-1B-BF16.gguf | BF16 | 1.89 GB | Full precision source. Every quant below is cut from this file. |

| MiniCPM-V-4.7-1B-Q8_0.gguf | Q8_0 | 1.01 GB | Effectively lossless. Use when disk and RAM are not the constraint. |

| MiniCPM-V-4.7-1B-Q6_K.gguf | Q6_K | 0.78 GB | Near-lossless; the last stop before quality becomes measurable. |

| MiniCPM-V-4.7-1B-Q5_K_M.gguf | Q5_K_M | 0.70 GB | Very good quality, noticeably smaller than Q6_K. |

| MiniCPM-V-4.7-1B-Q5_K_S.gguf | Q5_K_S | 0.69 GB | Slightly smaller than Q5_K_M for a slight quality cost. |

| MiniCPM-V-4.7-1B-Q5_1.gguf | Q5_1 | 0.73 GB | Legacy. Prefer Q5_K_M. |

| MiniCPM-V-4.7-1B-Q5_0.gguf | Q5_0 | 0.69 GB | Legacy. Prefer Q5_K_M. |

| MiniCPM-V-4.7-1B-Q4_K_M.gguf | Q4_K_M | 0.63 GB | The usual default. Best quality-per-byte for most people. |

| MiniCPM-V-4.7-1B-Q4_K_S.gguf | Q4_K_S | 0.60 GB | A little smaller than Q4_K_M, a little worse. |

| MiniCPM-V-4.7-1B-IQ4_NL.gguf | IQ4_NL | 0.61 GB | Non-linear 4-bit; good on hardware without fast K-quant kernels. |

| MiniCPM-V-4.7-1B-IQ4_XS.gguf | IQ4_XS | 0.59 GB | Best sub-4.5bpw option; usually beats Q4_K_S at a smaller size. |

| MiniCPM-V-4.7-1B-Q4_1.gguf | Q4_1 | 0.64 GB | Legacy. Prefer Q4_K_M. |

| MiniCPM-V-4.7-1B-Q4_0.gguf | Q4_0 | 0.60 GB | Legacy round-to-nearest. Prefer Q4_K_M unless a runtime needs this. |

| MiniCPM-V-4.7-1B-Q3_K_L.gguf | Q3_K_L | 0.56 GB | Small, with real quality loss. Usable when RAM is tight. |

| MiniCPM-V-4.7-1B-Q3_K_M.gguf | Q3_K_M | 0.54 GB | Smaller again; noticeable degradation. |

| MiniCPM-V-4.7-1B-IQ3_M.gguf | IQ3_M | 0.52 GB | Strong at ~3.7bpw, clearly better than Q3_K_M. |

| MiniCPM-V-4.7-1B-IQ3_S.gguf | IQ3_S | 0.52 GB | Slightly smaller than IQ3_M. |

| MiniCPM-V-4.7-1B-Q3_K_S.gguf | Q3_K_S | 0.51 GB | Aggressive. Prefer IQ3_M at a similar size. |

| MiniCPM-V-4.7-1B-IQ3_XS.gguf | IQ3_XS | 0.51 GB | Aggressive but coherent. |

| MiniCPM-V-4.7-1B-IQ3_XXS.gguf | IQ3_XXS | 0.47 GB | Very aggressive; the last coherent step down. |

| MiniCPM-V-4.7-1B-Q2_K.gguf | Q2_K | 0.47 GB | Very small, heavily degraded. For experimentation. |

| MiniCPM-V-4.7-1B-IQ2_M.gguf | IQ2_M | 0.45 GB | The smallest size most people find usable. |

| MiniCPM-V-4.7-1B-Q2_K_S.gguf | Q2_K_S | 0.46 GB | Smaller than Q2_K, at a further quality cost. |

| MiniCPM-V-4.7-1B-IQ2_S.gguf | IQ2_S | 0.44 GB | Below the usual usability line. |

| MiniCPM-V-4.7-1B-IQ2_XS.gguf | IQ2_XS | 0.42 GB | Experimental. |

| MiniCPM-V-4.7-1B-IQ2_XXS.gguf | IQ2_XXS | 0.41 GB | Experimental. |

| MiniCPM-V-4.7-1B-Q2_0.gguf | Q2_0 | 0.47 GB | Extreme, group-64. Included for completeness. |

| MiniCPM-V-4.7-1B-IQ1_M.gguf | IQ1_M | 0.39 GB | Extreme. Expect substantial degradation. |

| MiniCPM-V-4.7-1B-IQ1_S.gguf | IQ1_S | 0.38 GB | Extreme. Expect substantial degradation. |

| MiniCPM-V-4.7-1B-Q1_0.gguf | Q1_0 | 0.30 GB | Extreme. Included for completeness. |

Which one should I download?

Pick the largest file that leaves a couple of gigabytes of headroom on the device you will run it on — the model has to fit in RAM (or VRAM, if you are offloading) alongside the KV cache and the OS.

• Plenty of memory: Q6_K or Q8_0.
• The usual choice: Q4_K_M.
• Tight on memory: IQ4_XS, then IQ3_M, then IQ2_M.
• The IQ files generally beat a Q file of similar size, at the cost of slightly slower inference on some hardware.

Runtime requirement

This architecture is not in upstream llama.cpp yet. These files were built with ggml-org/llama.cpp at pull/30510/head, and need that build (or upstream once it merges) to run.

Usage

llama-cli -hf NANI-Nithin/MiniCPM-V-4.7-1B-GGUF:Q4_K_M -p "Hello"

Or download one file and point at it directly:

huggingface-cli download NANI-Nithin/MiniCPM-V-4.7-1B-GGUF MiniCPM-V-4.7-1B-Q4_K_M.gguf --local-dir .
llama-cli -m MiniCPM-V-4.7-1B-Q4_K_M.gguf -p "Hello"

---

Quantized with llama.cpp by AgentQuantix on 2026-10-15. Licensing follows the base model.