GraySoft
Download guIDE →
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsunsloth/mistral-small-3.2-24b-instruct-2506-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and unsloth/mistral-small-3.2-24b-instruct-2506-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

unsloth/mistral-small-3.2-24b-instruct-2506-gguf

unsloth · image-text-to-text

Mistral-Small-3.2-24B-Instruct-2506 is a minor update of Mistral-Small-3.1-24B-Instruct-2503. Small-3.2 improves in the following categories: In all other categories Small-3.2 should match or slightly improve compared to Mistral-Small-3.1-24B-Instruct-2503.

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufunsloth/mistral-small-3.2-24b-instruct-2506-gguf
Authorggml-orgunsloth
Pipeline Taskfeature-extractionimage-text-to-text
Librarysentence-transformersvllm
Downloads47,80638,087
Likes15166
LicenseUnknownUnknown
Context Length——
Created2025-09-042025-06-20
Last Modified2025-09-152025-08-26
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
vllmggufimage-text-to-textenfrdeesptitja

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · unsloth/mistral-small-3.2-24b-instruct-2506-gguf