GraySoft
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvss1arsky/gemma-4-31b-animus-v14.0-imatrix-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and s1arsky/gemma-4-31b-animus-v14.0-imatrix-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

s1arsky/gemma-4-31b-animus-v14.0-imatrix-gguf

s1arsky · —

Imatrix quants of the following model: Darkhn/Gemma-4-31B-Animus-V14.0 - refer for more details on the model.

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufs1arsky/gemma-4-31b-animus-v14.0-imatrix-gguf
Authorggml-orgs1arsky
Pipeline Taskfeature-extraction
Librarysentence-transformers
Downloads47,80618,908
Likes151
LicenseUnknownUnknown
Context Length
Created2025-09-042026-04-07
Last Modified2025-09-152026-04-09
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
gguffinetuneroleplaychatwings-of-firensfwnot-for-all-audiencesbase_model:Darkhn/Gemma-4-31B-Animus-V14.0base_model:quantized:Darkhn/Gemma-4-31B-Animus-V14.0license:apache-2.0

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · s1arsky/gemma-4-31b-animus-v14.0-imatrix-gguf