GraySoft
Download guIDE →
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsunsloth/qwen3-0.6b-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and unsloth/qwen3-0.6b-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

unsloth/qwen3-0.6b-gguf

unsloth · text-generation

If you are using llama.cpp, Ollama, Open WebUI etc., you can add /think and /no_think to user prompts or system messages to switch the model's thinking mode from turn to turn. The model will follow the most recent instruction in multi-turn conversations. Here is an example of mu…

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufunsloth/qwen3-0.6b-gguf
Authorggml-orgunsloth
Pipeline Taskfeature-extractiontext-generation
Librarysentence-transformerstransformers
Downloads47,80668,786
Likes15123
LicenseUnknownUnknown
Context Length——
Created2025-09-042025-04-28
Last Modified2025-09-152025-06-23
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
transformersggufqwen3text-generationqwenunslothenbase_model:Qwen/Qwen3-0.6Bbase_model:quantized:Qwen/Qwen3-0.6Blicense:apache-2.0

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · unsloth/qwen3-0.6b-gguf