GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

AiAF/Qwen2.5-VL-7B-Instruct-GGUF overview

AiAF/Qwen2.5-VL-7B-Instruct-GGUF GGUF downloads for local AI inference with guIDE.

ggufendpoints_compatibleregion:usconversational

Runs locally from ~1.26 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
Author

Repository Files & Downloads

4 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen-Qwen2.5-VL-7B-Instruct-Q4_K_M.ggufGGUFQ4_K_M4.36 GBDownload
Qwen-Qwen2.5-VL-7B-Instruct-Q8_0.ggufGGUFQ8_07.54 GBDownload
Qwen-Qwen2.5-VL-7B-Instruct-bf16.ggufGGUFBF1614.19 GBDownload
Qwen-Qwen2.5-VL-7B-Instruct-mmproj-bf16.ggufGGUFBF161.26 GBDownload

Model Details

Model IDAiAF/Qwen2.5-VL-7B-Instruct-GGUF
AuthorAiAF
Pipeline
License
Base model
Last modified2026-08-14T03:52:43.000Z

Run AiAF/Qwen2.5-VL-7B-Instruct-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models