GraySoft
Download guIDE →
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsunsloth/devstral-small-2-24b-instruct-2512-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and unsloth/devstral-small-2-24b-instruct-2512-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

unsloth/devstral-small-2-24b-instruct-2512-gguf

unsloth · —

Devstral is an agentic LLM for software engineering tasks. **Devstral Small 2** excels at using tools to explore codebases, editing multiple files and power software engineering agents. The model achieves remarkable performance on SWE-bench. This model is an Instruct model in **…

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufunsloth/devstral-small-2-24b-instruct-2512-gguf
Authorggml-orgunsloth
Pipeline Taskfeature-extraction—
Librarysentence-transformers—
Downloads47,80637,401
Likes15128
LicenseUnknownUnknown
Context Length——
Created2025-09-042025-12-10
Last Modified2025-09-152025-12-15
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
ggufmistral3mistral-commonunslothmistralarxiv:2501.19399base_model:mistralai/Devstral-Small-2-24B-Instruct-2512base_model:quantized:mistralai/Devstral-Small-2-24B-Instruct-2512license:otherendpoints_compatible

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · unsloth/devstral-small-2-24b-instruct-2512-gguf