ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsunsloth/gemma-4-31b-it-gguf
Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and unsloth/gemma-4-31b-it-gguf: downloads, license, context length, tasks, and benchmarks.
ggml-org/embeddinggemma-300m-qat-q8_0-gguf
# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…
unsloth/gemma-4-31b-it-gguf
processor = AutoProcessor.from_pretrained(MODEL_ID) model = AutoModelForCausalLM.from_pretrained( MODEL_ID, dtype="auto", device_map="auto" ) `` Once the model is loaded, you can start generating output: `python # Prompt messages = [ {"role": "system", "content": "You are a help…
Side-by-side Specifications
| ggml-org/embeddinggemma-300m-qat-q8_0-gguf | unsloth/gemma-4-31b-it-gguf | |
|---|---|---|
| Author | ggml-org | unsloth |
| Pipeline Task | feature-extraction | image-text-to-text |
| Library | sentence-transformers | — |
| Downloads | 47,806 | 1,362,626 |
| Likes | 15 | 325 |
| License | Unknown | Unknown |
| Context Length | — | — |
| Created | 2025-09-04 | 2026-04-01 |
| Last Modified | 2025-09-15 | 2026-04-11 |
| Tags |
View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · unsloth/gemma-4-31b-it-gguf