GraySoft
Model Comparison

ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsmudler/gemma-4-26b-a4b-it-heretic-apex-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and mudler/gemma-4-26b-a4b-it-heretic-apex-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-qat-q8_0-gguf

ggml-org · feature-extraction

# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…

mudler/gemma-4-26b-a4b-it-heretic-apex-gguf

mudler · —

**APEX (Adaptive Precision for EXpert Models)** quantizations of gemma-4-26B-A4B-it-heretic — an **abliterated (uncensored)** version of Gemma 4, created with the Heretic tool (v1.2.0) using Arbitrary-Rank Ablation (ARA) on layers 10-30 to reduce refusals while preserving capabi…

Side-by-side Specifications

ggml-org/embeddinggemma-300m-qat-q8_0-ggufmudler/gemma-4-26b-a4b-it-heretic-apex-gguf
Authorggml-orgmudler
Pipeline Taskfeature-extraction
Librarysentence-transformers
Downloads47,80618,849
Likes1522
LicenseUnknownUnknown
Context Length
Created2025-09-042026-04-05
Last Modified2025-09-152026-04-05
Tags
sentence-transformersggufsentence-similarityfeature-extractionbase_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaendpoints_compatibleregion:us
ggufquantizedapexmoemixture-of-expertsgemma4vlmvisionbase_model:coder3101/gemma-4-26B-A4B-it-hereticbase_model:quantized:coder3101/gemma-4-26B-A4B-it-heretic

View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · mudler/gemma-4-26b-a4b-it-heretic-apex-gguf