GraySoft
Download guIDE →
Model Comparison

bartowski/phi-3.5-mini-instruct-ggufvsggml-org/embeddinggemma-300m-qat-q8_0-gguf

Side-by-side comparison of bartowski/phi-3.5-mini-instruct-gguf and ggml-org/embeddinggemma-300m-qat-q8_0-gguf: downloads, license, context length, tasks, and benchmarks.

bartowski/phi-3.5-mini-instruct-gguf

bartowski · text-generation

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

Side-by-side Specifications

bartowski/phi-3.5-mini-instruct-ggufggml-org/embeddinggemma-300m-qat-q8_0-gguf
Authorbartowskiggml-org
Pipeline Tasktext-generationfeature-extraction
Librarytransformerssentence-transformers
Downloads32,91947,806
Likes7815
LicenseUnknownUnknown
Context Length——
Created2024-08-202025-09-04
Last Modified2024-09-152025-09-15
Tags
transformersggufnlpcodetext-generationmultilingualbase_model:microsoft/Phi-3.5-mini-instructbase_model:quantized:microsoft/Phi-3.5-mini-instructlicense:mitendpoints_compatible
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us

View full details: bartowski/phi-3.5-mini-instruct-gguf · ggml-org/embeddinggemma-300m-qat-q8_0-gguf