GraySoft
Download guIDE →
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsqwen/qwen3-vl-4b-instruct-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and qwen/qwen3-vl-4b-instruct-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

qwen/qwen3-vl-4b-instruct-gguf

Qwen · image-text-to-text

This repository provides GGUF-format weights for Qwen3-VL-4B-Instruct, split into two components: These files are compatible with llama.cpp, Ollama, and other GGUF-based tools, supporting inference on CPU, NVIDIA GPU (CUDA), Apple Silicon (Metal), Intel GPUs (SYCL), and more. Yo…

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufqwen/qwen3-vl-4b-instruct-gguf
Authorggml-orgQwen
Pipeline Taskfeature-extractionimage-text-to-text
Librarysentence-transformerstransformers
Downloads47,80618,897
Likes1541
LicenseUnknownUnknown
Context Length——
Created2025-09-042025-10-31
Last Modified2025-09-152025-11-01
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
transformersggufimage-text-to-textarxiv:2505.09388arxiv:2502.13923arxiv:2409.12191arxiv:2308.12966base_model:Qwen/Qwen3-VL-4B-Instructbase_model:quantized:Qwen/Qwen3-VL-4B-Instructlicense:apache-2.0

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · qwen/qwen3-vl-4b-instruct-gguf