Model Intelligence Sheet
ggml-org/vllm-d3-mini-GGUF overview
vllm d3 mini Run it in the Llama app: https://llama.app Or from the terminal: bash llama serve hf ggml org/vllm d3 mini GGUF This is a decision model, to be us…
Runs locally from ~349.9 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
5 GGUF files detected
Direct downloads for local inference
Model Details
| Model ID | ggml-org/vllm-d3-mini-GGUF |
|---|---|
| Author | ggml-org |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | vllm-sr/d3-mini |
| Last modified | 2026-10-19T15:40:55.000Z |
Model README
---
license: apache-2.0
pipeline_tag: image-text-to-text
tags:
- gguf
- quantized
- decision-model
base_model:
- vllm-sr/d3-mini
---
vllm-d3-mini
Run it in the Llama app: https://llama.app
Or from the terminal:
llama serve -hf ggml-org/vllm-d3-mini-GGUFThis is a decision model, to be used via /v1/systemone API. See https://github.com/ggml-org/llama.cpp/pull/30383
Source models
- https://huggingface.co/vllm-sr/d3-mini
> [!IMPORTANT]
> This model is automatically converted using https://github.com/ggml-org/convert
Run ggml-org/vllm-d3-mini-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models