GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ggml-org/vllm-d3-flash-GGUF overview

vllm d3 flash Run it in the Llama app: https://llama.app Or from the terminal: bash llama serve hf ggml org/vllm d3 flash GGUF This is a decision model, to be …

ggufquantizeddecision-modelimage-text-to-textbase_model:vllm-sr/d3-flashbase_model:quantized:vllm-sr/d3-flashlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~595.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
8,539
Likes
8
Pipeline
image-text-to-text
Author

Repository Files & Downloads

5 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
mmproj-vllm-d3-flash-BF16.ggufGGUFBF16879.0 MBDownload
mmproj-vllm-d3-flash-Q8_0.ggufGGUFQ8_0595.3 MBDownload
vllm-d3-flash-BF16.ggufGGUFBF1616.69 GBDownload
vllm-d3-flash-Q4_K_M.ggufGGUFQ4_K_M6.15 GBDownload
vllm-d3-flash-Q8_0.ggufGGUFQ8_08.87 GBDownload

Model Details

Model IDggml-org/vllm-d3-flash-GGUF
Authorggml-org
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelvllm-sr/d3-flash
Last modified2026-10-19T15:38:53.000Z

Model README

---

license: apache-2.0

pipeline_tag: image-text-to-text

tags:

  • gguf
  • quantized
  • decision-model

base_model:

  • vllm-sr/d3-flash

---

vllm-d3-flash

Run it in the Llama app: https://llama.app

Or from the terminal:

llama serve -hf ggml-org/vllm-d3-flash-GGUF

This is a decision model, to be used via /v1/systemone API. See https://github.com/ggml-org/llama.cpp/pull/30383

Source models

  • https://huggingface.co/vllm-sr/d3-flash

> [!IMPORTANT]

> This model is automatically converted using https://github.com/ggml-org/convert

Run ggml-org/vllm-d3-flash-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models