ggml-org/embeddinggemma-300m-qat-q8_0-ggufvsmudler/gemma-4-26b-a4b-it-heretic-apex-gguf
Side-by-side comparison of ggml-org/embeddinggemma-300m-qat-q8_0-gguf and mudler/gemma-4-26b-a4b-it-heretic-apex-gguf: downloads, license, context length, tasks, and benchmarks.
ggml-org/embeddinggemma-300m-qat-q8_0-gguf
# embeddinggemma-300m-qat-q8_0 GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q8_0-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --u…
mudler/gemma-4-26b-a4b-it-heretic-apex-gguf
**APEX (Adaptive Precision for EXpert Models)** quantizations of gemma-4-26B-A4B-it-heretic — an **abliterated (uncensored)** version of Gemma 4, created with the Heretic tool (v1.2.0) using Arbitrary-Rank Ablation (ARA) on layers 10-30 to reduce refusals while preserving capabi…
Side-by-side Specifications
| ggml-org/embeddinggemma-300m-qat-q8_0-gguf | mudler/gemma-4-26b-a4b-it-heretic-apex-gguf | |
|---|---|---|
| Author | ggml-org | mudler |
| Pipeline Task | feature-extraction | — |
| Library | sentence-transformers | — |
| Downloads | 47,806 | 18,849 |
| Likes | 15 | 22 |
| License | Unknown | Unknown |
| Context Length | — | — |
| Created | 2025-09-04 | 2026-04-05 |
| Last Modified | 2025-09-15 | 2026-04-05 |
| Tags |
View full details: ggml-org/embeddinggemma-300m-qat-q8_0-gguf · mudler/gemma-4-26b-a4b-it-heretic-apex-gguf