GraySoft
Download guIDE →
Model Comparison

bartowski/deepseek-r1-distill-qwen-32b-ggufvsggml-org/embeddinggemma-300m-qat-q8_0-gguf

Side-by-side comparison of bartowski/deepseek-r1-distill-qwen-32b-gguf and ggml-org/embeddinggemma-300m-qat-q8_0-gguf: downloads, license, context length, tasks, and benchmarks.

bartowski/deepseek-r1-distill-qwen-32b-gguf

bartowski · text-generation

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

Side-by-side Specifications

bartowski/deepseek-r1-distill-qwen-32b-ggufggml-org/embeddinggemma-300m-qat-q8_0-gguf
Authorbartowskiggml-org
Pipeline Tasktext-generationfeature-extraction
Library—sentence-transformers
Downloads23,95847,806
Likes30115
LicenseUnknownUnknown
Context Length——
Created2025-01-202025-09-04
Last Modified2025-01-222025-09-15
Tags
gguftext-generationbase_model:deepseek-ai/DeepSeek-R1-Distill-Qwen-32Bbase_model:quantized:deepseek-ai/DeepSeek-R1-Distill-Qwen-32Bendpoints_compatibleregion:usimatrixconversational
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us

View full details: bartowski/deepseek-r1-distill-qwen-32b-gguf · ggml-org/embeddinggemma-300m-qat-q8_0-gguf