GraySoft
Download guIDE →
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsmradermacher/q3.5-bluestar-27b-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and mradermacher/q3.5-bluestar-27b-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

mradermacher/q3.5-bluestar-27b-gguf

mradermacher · —

## About static quants of https://huggingface.co/zerofata/Q3.5-BlueStar-27B ***For a convenient overview and download list, visit our model page for this model.*** weighted/imatrix quants are available at https://huggingface.co/mradermacher/Q3.5-BlueStar-27B-i1-GGUF

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufmradermacher/q3.5-bluestar-27b-gguf
Authorggml-orgmradermacher
Pipeline Taskfeature-extraction—
Librarysentence-transformerstransformers
Downloads47,806139,049
Likes151
LicenseUnknownUnknown
Context Length——
Created2025-09-042026-03-04
Last Modified2025-09-152026-03-04
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
transformersggufendataset:zerofata/Instruct-Animedataset:zerofata/Gemini-3.1-Pro-SmallWikidataset:zerofata/Gemini-3.1-Pro-GLM5-Charactersdataset:zerofata/Roleplay-Anime-Charactersbase_model:zerofata/Q3.5-BlueStar-27Bbase_model:quantized:zerofata/Q3.5-BlueStar-27Blicense:mit

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · mradermacher/q3.5-bluestar-27b-gguf