GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

WhiskyAKM/MiniCPM-V-4.7-1B-NVFP4-GGUF overview

MiniCPM V 4.7 1B NVFP4 — GGUF NVFP4 GGUF conversions derived from the MiniCPM V 4.7 1B model, providing highly efficient 4 bit floating point quantization for …

llama-cppggufminicpm-vmultimodalon-devicelightweightnvfp4image-text-to-textconversationalmultilingualbase_model:openbmb/MiniCPM-V-4.7-1Bbase_model:quantized:openbmb/MiniCPM-V-4.7-1Blicense:apache-2.0endpoints_compatibleregion:usimatrix

Runs locally from ~614.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
269
Likes
1
Pipeline
image-text-to-text
Author

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
minicpm-v-4_7-1b-nvfp4.ggufGGUFGGUF614.3 MBDownload
mmproj-q8_0.ggufGGUFQ8_0694.2 MBDownload
mmproj.ggufGGUFGGUF1.03 GBDownload

Model Details

Model IDWhiskyAKM/MiniCPM-V-4.7-1B-NVFP4-GGUF
AuthorWhiskyAKM
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelopenbmb/MiniCPM-V-4.7-1B
Last modified2026-10-13T12:24:49.000Z

Model README

---

pipeline_tag: image-text-to-text

base_model: openbmb/MiniCPM-V-4.7-1B

license: apache-2.0

license_name: apache-license-2.0

license_link: https://opensource.org/licenses/Apache-2.0

library_name: llama-cpp

tags:

  • minicpm-v
  • multimodal
  • on-device
  • lightweight
  • gguf
  • nvfp4

language:

  • multilingual

---

MiniCPM-V 4.7 1B NVFP4 — GGUF

NVFP4 GGUF conversions derived from the MiniCPM-V 4.7 1B model, providing highly efficient 4-bit floating-point quantization for multimodal tasks.

This repository provides NVFP4 (NVIDIA 4-bit floating-point) GGUF files, making the model usable with llama.cpp and other GGUF-compatible inference engines.

Model Overview

MiniCPM-V 4.7 1B is a lightweight multimodal model capable of single-image, multi-image, and video understanding. It is designed to advance the performance–efficiency Pareto frontier, delivering high capability density for resource-constrained on-device environments.

Model Architecture

| Property | Value |

| :----------------------- | :------------------------------------------------ |

| Architecture | MiniCPM-V 4.7 |

| Parameters | 1B |

| Capabilities | Text, Image, Video |

| Key Technique | Intra-ViT early compression (LLaVA-UHD v4 style) |

| Token Compression | Supports mixed 4x/16x visual token compression |

| Supported Modalities | Text, Image, Video |

| Context Length | High-efficiency multimodal context |

GGUF Files

| File | Format | Description |

| :----------------------------------- | :----- | :---------------------------------------------- |

| minicpm-v-4_7-1b-nvfp4.gguf | NVFP4 | NVFP4 quantized model - optimized for efficiency |

| mmproj.gguf | — | Multimodal projector (vision/video) |

> About NVFP4: NVFP4 is NVIDIA's 4-bit floating-point format (E2M1). It offers significant memory savings while preserving quality close to bfloat16, and is accelerated on NVIDIA Blackwell GPUs via llama.cpp.

Usage

llama.cpp (CLI)

# Multimodal inference (Image/Video)
./llama-cli \
  -m minicpm-v-4_7-1b-nvfp4.gguf \
  --mmproj mmproj.gguf \
  -p "Describe this image in detail." \
  --temp 1.0 --top-k 64 --top-p 0.95

llama-server (OpenAI-compatible API)

# Multimodal server
./llama-server \
  -m minicpm-v-4_7-1b-nvfp4.gguf \
  --mmproj mmproj.gguf \
  --host [IP_ADDRESS] --port 8080

Generation Parameters

Recommended parameters for MiniCPM-V 4.7:

| Parameter | Value |

| :------------ | :---- |

| Temperature | 1.0 |

| Top-K | 64 |

| Top-P | 0.95 |

Key Features

  • Efficiency: Advances the performance–efficiency Pareto frontier for MLLMs.
  • Architecture: Uses early visual token compression to reduce computation.
  • On-Device Ready: Optimized for mobile and local computing devices.
  • Versatile: Supports single-image, multi-image, and video understanding.

License

Apache License 2.0

Run WhiskyAKM/MiniCPM-V-4.7-1B-NVFP4-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models