GraySoft
Download guIDE →
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsnoctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and noctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

noctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-gguf

noctrex · image-text-to-text

These are quantizations of the model Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated The imatrix from unsloth has been used for these. Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated Download the latest llama.cpp to use them. Try to use…

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufnoctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-gguf
Authorggml-orgnoctrex
Pipeline Taskfeature-extractionimage-text-to-text
Librarysentence-transformers—
Downloads47,80619,336
Likes1518
LicenseUnknownUnknown
Context Length——
Created2025-09-042025-10-22
Last Modified2025-09-152025-11-07
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
ggufimage-text-to-textbase_model:huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliteratedbase_model:quantized:huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliteratedendpoints_compatibleregion:usimatrixconversational

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · noctrex/huihui-qwen3-vl-30b-a3b-instruct-abliterated-gguf