GraySoft
Download guIDE →
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsunsloth/deepseek-r1-distill-qwen-14b-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and unsloth/deepseek-r1-distill-qwen-14b-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

unsloth/deepseek-r1-distill-qwen-14b-gguf

unsloth · —

We have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Alpaca.ipynb

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufunsloth/deepseek-r1-distill-qwen-14b-gguf
Authorggml-orgunsloth
Pipeline Taskfeature-extraction—
Librarysentence-transformerstransformers
Downloads47,80690,574
Likes15104
LicenseUnknownUnknown
Context Length——
Created2025-09-042025-01-20
Last Modified2025-09-152025-01-25
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
transformersggufdeepseekqwenqwen2unslothenarxiv:2501.12948base_model:deepseek-ai/DeepSeek-R1-Distill-Qwen-14Bbase_model:quantized:deepseek-ai/DeepSeek-R1-Distill-Qwen-14B

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · unsloth/deepseek-r1-distill-qwen-14b-gguf