WhiskyAKM/MiniCPM-V-4.7-1B-NVFP4-GGUF overview
MiniCPM V 4.7 1B NVFP4 — GGUF NVFP4 GGUF conversions derived from the MiniCPM V 4.7 1B model, providing highly efficient 4 bit floating point quantization for …
Runs locally from ~614.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | WhiskyAKM/MiniCPM-V-4.7-1B-NVFP4-GGUF |
|---|---|
| Author | WhiskyAKM |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | openbmb/MiniCPM-V-4.7-1B |
| Last modified | 2026-10-13T12:24:49.000Z |
Model README
---
pipeline_tag: image-text-to-text
base_model: openbmb/MiniCPM-V-4.7-1B
license: apache-2.0
license_name: apache-license-2.0
license_link: https://opensource.org/licenses/Apache-2.0
library_name: llama-cpp
tags:
- minicpm-v
- multimodal
- on-device
- lightweight
- gguf
- nvfp4
language:
- multilingual
---
MiniCPM-V 4.7 1B NVFP4 — GGUF
NVFP4 GGUF conversions derived from the MiniCPM-V 4.7 1B model, providing highly efficient 4-bit floating-point quantization for multimodal tasks.
This repository provides NVFP4 (NVIDIA 4-bit floating-point) GGUF files, making the model usable with llama.cpp and other GGUF-compatible inference engines.
Model Overview
MiniCPM-V 4.7 1B is a lightweight multimodal model capable of single-image, multi-image, and video understanding. It is designed to advance the performance–efficiency Pareto frontier, delivering high capability density for resource-constrained on-device environments.
Model Architecture
| Property | Value |
| :----------------------- | :------------------------------------------------ |
| Architecture | MiniCPM-V 4.7 |
| Parameters | 1B |
| Capabilities | Text, Image, Video |
| Key Technique | Intra-ViT early compression (LLaVA-UHD v4 style) |
| Token Compression | Supports mixed 4x/16x visual token compression |
| Supported Modalities | Text, Image, Video |
| Context Length | High-efficiency multimodal context |
GGUF Files
| File | Format | Description |
| :----------------------------------- | :----- | :---------------------------------------------- |
| minicpm-v-4_7-1b-nvfp4.gguf | NVFP4 | NVFP4 quantized model - optimized for efficiency |
| mmproj.gguf | — | Multimodal projector (vision/video) |
> About NVFP4: NVFP4 is NVIDIA's 4-bit floating-point format (E2M1). It offers significant memory savings while preserving quality close to bfloat16, and is accelerated on NVIDIA Blackwell GPUs via llama.cpp.
Usage
llama.cpp (CLI)
# Multimodal inference (Image/Video)
./llama-cli \
-m minicpm-v-4_7-1b-nvfp4.gguf \
--mmproj mmproj.gguf \
-p "Describe this image in detail." \
--temp 1.0 --top-k 64 --top-p 0.95
llama-server (OpenAI-compatible API)
# Multimodal server
./llama-server \
-m minicpm-v-4_7-1b-nvfp4.gguf \
--mmproj mmproj.gguf \
--host [IP_ADDRESS] --port 8080
Generation Parameters
Recommended parameters for MiniCPM-V 4.7:
| Parameter | Value |
| :------------ | :---- |
| Temperature | 1.0 |
| Top-K | 64 |
| Top-P | 0.95 |
Key Features
- Efficiency: Advances the performance–efficiency Pareto frontier for MLLMs.
- Architecture: Uses early visual token compression to reduce computation.
- On-Device Ready: Optimized for mobile and local computing devices.
- Versatile: Supports single-image, multi-image, and video understanding.
License
Run WhiskyAKM/MiniCPM-V-4.7-1B-NVFP4-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models