GraySoft
Download guIDE →
Model Comparison

mradermacher/qwen3-vl-reranker-8b-ggufvsqwen/qwen3-vl-4b-instruct-gguf

Side-by-side comparison of mradermacher/qwen3-vl-reranker-8b-gguf and qwen/qwen3-vl-4b-instruct-gguf: downloads, license, context length, tasks, and benchmarks.

mradermacher/qwen3-vl-reranker-8b-gguf

mradermacher · —

## About static quants of https://huggingface.co/Qwen/Qwen3-VL-Reranker-8B ***For a convenient overview and download list, visit our model page for this model.*** weighted/imatrix quants are available at https://huggingface.co/mradermacher/Qwen3-VL-Reranker-8B-i1-GGUF

qwen/qwen3-vl-4b-instruct-gguf

Qwen · image-text-to-text

This repository provides GGUF-format weights for Qwen3-VL-4B-Instruct, split into two components: These files are compatible with llama.cpp, Ollama, and other GGUF-based tools, supporting inference on CPU, NVIDIA GPU (CUDA), Apple Silicon (Metal), Intel GPUs (SYCL), and more. Yo…

Side-by-side Specifications

mradermacher/qwen3-vl-reranker-8b-ggufqwen/qwen3-vl-4b-instruct-gguf
AuthormradermacherQwen
Pipeline Task—image-text-to-text
Librarytransformerstransformers
Downloads26,09618,897
Likes441
LicenseUnknownUnknown
Context Length——
Created2026-01-102025-10-31
Last Modified2026-01-192025-11-01
Tags
transformersggufmultimodal reranktext rerankenbase_model:Qwen/Qwen3-VL-Reranker-8Bbase_model:quantized:Qwen/Qwen3-VL-Reranker-8Blicense:apache-2.0endpoints_compatibleregion:us
transformersggufimage-text-to-textarxiv:2505.09388arxiv:2502.13923arxiv:2409.12191arxiv:2308.12966base_model:Qwen/Qwen3-VL-4B-Instructbase_model:quantized:Qwen/Qwen3-VL-4B-Instructlicense:apache-2.0

View full details: mradermacher/qwen3-vl-reranker-8b-gguf · qwen/qwen3-vl-4b-instruct-gguf