GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

IsValorum/MiniCPM-V-4.7-35B-A3B-APEX-I-NanoPlus-GGUF overview

<a id="quick navigation" </a Quick Navigation Index <a href="https://ko fi.com/isvalorum" <img src="https://ko fi.com/img/githubbutton sm.svg" alt="Support on …

ggufllama.cppquantizedquantizationapexapex-quantapex-i-nanoplusv2.1custom-quantizationminicpm-vminicpmopenbmbmoemultimodalvisionimage-text-to-textvideoon-deviceimatrixatomic-chatenzhesfr

Runs locally from ~226.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
1,355
Likes
5
Pipeline
image-text-to-text
Author

Repository Files & Downloads

4 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
MiniCPM-V-4.7-35B-A3B.APEX-I-NanoPlus-V2.1.ggufGGUFGGUF11.69 GBDownload
dspark-MiniCPM-V-4_7-35B-A3B-Q4_K_M.ggufGGUFQ4_K_M226.0 MBDownload
dspark-MiniCPM-V-4_7-35B-A3B-Q6_K.ggufGGUFQ6_K315.0 MBDownload
mmproj-Q8_0.ggufGGUFQ8_0699.0 MBDownload

Model Details

Model IDIsValorum/MiniCPM-V-4.7-35B-A3B-APEX-I-NanoPlus-GGUF
AuthorIsValorum
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelopenbmb/MiniCPM-V-4.7-35B-A3B
Last modified2026-10-18T21:17:05.000Z

Model README

---

base_model: openbmb/MiniCPM-V-4.7-35B-A3B

base_model_relation: quantized

quantized_by: IsValorum

library_name: gguf

pipeline_tag: image-text-to-text

license: apache-2.0

language:

  • en
  • zh
  • es
  • fr
  • de
  • pt
  • it
  • ru
  • ja
  • ko

tags:

  • gguf
  • llama.cpp
  • quantized
  • quantization
  • apex
  • apex-quant
  • apex-i-nanoplus
  • v2.1
  • custom-quantization
  • minicpm-v
  • minicpm
  • openbmb
  • moe
  • multimodal
  • vision
  • image-text-to-text
  • video
  • on-device
  • imatrix
  • atomic-chat

---

<a id="quick-navigation"></a>Quick Navigation Index

<a href="https://ko-fi.com/isvalorum"><img src="https://ko-fi.com/img/githubbutton_sm.svg" alt="Support on Ko-fi" height="38"></a>

Independently computed using dedicated cloud compute clusters, funded 100% out-of-pocket.

If you consider these releases to be of high quality and they help you in your day-to-day workflow, consider supporting on Ko-fi. Every contribution directly sustains future cloud compute hours and helps support my university studies.

---

MiniCPM-V 4.7 35B-A3B APEX-I NanoPlus V2.1 GGUF

Official APEX-I NanoPlus V2.1 canonical release for OpenBMB MiniCPM-V 4.7 35B-A3B, engineered for ultra-compact on-device memory footprints while preserving recurrent DeltaNet dynamics and visual fidelity.

Key Architectural Features:

  • Canonical 733-Tensor Allocation:

- output.weight in Q6_K and token_embd.weight in Q4_K.

- MoE Expert Routers (ffn_gate_inp) in F32.

- Shared foundation experts (shexp) in Q4_K.

- Recurrent SSM continuous states in F32 (ssm_a, ssm_conv1d, ssm_dt, ssm_norm).

- Border down projections in Q3_K and border gate/up in IQ3_XXS.

- Core down projections (layers 2-37) in IQ3_XXS, gate in IQ2_S, protected up (layers 2-15) in IQ2_S, compact up (layers 16-37) in IQ2_XXS.

  • Multimodal Projector:

- Includes companion mmproj-Q8_0.gguf for on-device visual inference.

CLI Usage Example:

llama-minicpmv-cli \
  -m MiniCPM-V-4.7-35B-A3B.APEX-I-NanoPlus-V2.1.gguf \
  --mmproj mmproj-Q8_0.gguf \
  --image test.jpg \
  -p "Describe what you see in this image in detail." \
  -c 4096 --temp 0.7

Run IsValorum/MiniCPM-V-4.7-35B-A3B-APEX-I-NanoPlus-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models