Model Intelligence Sheet
Lolol857/minicpm5-1b-sft-gguf overview
Lolol857/minicpm5-1b-sft-gguf GGUF downloads for local AI inference with guIDE.
Runs locally from ~0.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
27 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| llama.cpp/models/ggml-vocab-aquila.gguf | GGUF | GGUF | 4.6 MB | Download |
| llama.cpp/models/ggml-vocab-baichuan.gguf | GGUF | GGUF | 1.3 MB | Download |
| llama.cpp/models/ggml-vocab-bert-bge.gguf | GGUF | GGUF | 0.6 MB | Download |
| llama.cpp/models/ggml-vocab-command-r.gguf | GGUF | GGUF | 10.4 MB | Download |
| llama.cpp/models/ggml-vocab-deepseek-coder.gguf | GGUF | GGUF | 1.1 MB | Download |
| llama.cpp/models/ggml-vocab-deepseek-llm.gguf | GGUF | GGUF | 3.8 MB | Download |
| llama.cpp/models/ggml-vocab-falcon.gguf | GGUF | GGUF | 2.2 MB | Download |
| llama.cpp/models/ggml-vocab-gemma-4.gguf | GGUF | GGUF | 15.0 MB | Download |
| llama.cpp/models/ggml-vocab-gpt-2.gguf | GGUF | GGUF | 1.7 MB | Download |
| llama.cpp/models/ggml-vocab-gpt-neox.gguf | GGUF | GGUF | 1.7 MB | Download |
| llama.cpp/models/ggml-vocab-llama-bpe.gguf | GGUF | GGUF | 7.5 MB | Download |
| llama.cpp/models/ggml-vocab-llama-spm.gguf | GGUF | GGUF | 0.7 MB | Download |
| llama.cpp/models/ggml-vocab-mpt.gguf | GGUF | GGUF | 1.7 MB | Download |
| llama.cpp/models/ggml-vocab-nomic-bert-moe.gguf | GGUF | GGUF | 6.5 MB | Download |
| llama.cpp/models/ggml-vocab-phi-3.gguf | GGUF | GGUF | 0.7 MB | Download |
| llama.cpp/models/ggml-vocab-qwen2.gguf | GGUF | GGUF | 5.7 MB | Download |
| llama.cpp/models/ggml-vocab-qwen35.gguf | GGUF | GGUF | 5.7 MB | Download |
| llama.cpp/models/ggml-vocab-refact.gguf | GGUF | GGUF | 1.6 MB | Download |
| llama.cpp/models/ggml-vocab-starcoder.gguf | GGUF | GGUF | 1.6 MB | Download |
| minicpm5-1b-sft-f16.gguf | GGUF | F16 | 2.02 GB | Download |
| minicpm5-1b-sft-q3_k_m.gguf | GGUF | Q3_K_M | 555.9 MB | Download |
| minicpm5-1b-sft-q4_0.gguf | GGUF | Q4_0 | 634.2 MB | Download |
| minicpm5-1b-sft-q4_k_m.gguf | GGUF | Q4_K_M | 656.2 MB | Download |
| minicpm5-1b-sft-q4_k_s.gguf | GGUF | Q4_K_S | 636.9 MB | Download |
| minicpm5-1b-sft-q5_k_m.gguf | GGUF | Q5_K_M | 750.4 MB | Download |
| minicpm5-1b-sft-q6_k.gguf | GGUF | Q6_K | 850.5 MB | Download |
| minicpm5-1b-sft-q8_0.gguf | GGUF | Q8_0 | 1.07 GB | Download |
Model Details
Run Lolol857/minicpm5-1b-sft-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models