GraySoft
Download guIDE →
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsmaziyarpanahi/mixtral-8x22b-v0.1-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and maziyarpanahi/mixtral-8x22b-v0.1-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

maziyarpanahi/mixtral-8x22b-v0.1-gguf

MaziyarPanahi · text-generation

On April 10th, @MistralAI released a model named "Mixtral 8x22B," an 176B MoE via magnet link (torrent): The GGUF and quantized models here are based on v2ray/Mixtral-8x22B-v0.1 model

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufmaziyarpanahi/mixtral-8x22b-v0.1-gguf
Authorggml-orgMaziyarPanahi
Pipeline Taskfeature-extractiontext-generation
Librarysentence-transformerstransformers
Downloads47,80689,597
Likes1575
LicenseUnknownUnknown
Context Length——
Created2025-09-042024-04-10
Last Modified2025-09-152024-04-15
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
transformersggufmixtraltext-generationquantized2-bit3-bit4-bit5-bit6-bit

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · maziyarpanahi/mixtral-8x22b-v0.1-gguf