GraySoft
Model Comparison

ggml-org/embeddinggemma-300m-ggufvsmlabonne/meta-llama-3.1-8b-instruct-abliterated-gguf

Side-by-side comparison of ggml-org/embeddinggemma-300m-gguf and mlabonne/meta-llama-3.1-8b-instruct-abliterated-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/embeddinggemma-300m-gguf

ggml-org · —

# embeddinggemma-300M GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300M-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --url http://localhos…

mlabonne/meta-llama-3.1-8b-instruct-abliterated-gguf

mlabonne · —

!image/png 🦙 Llama 3.1 70B Instruct lorablated This is an uncensored version of Llama 3.1 8B Instruct created with abliteration (see this article to know more about it). Special thanks to @FailSpy for the original code and technique. Please follow him if you're interested in ab…

Side-by-side Specifications

ggml-org/embeddinggemma-300m-ggufmlabonne/meta-llama-3.1-8b-instruct-abliterated-gguf
Authorggml-orgmlabonne
Pipeline Task
Librarytransformers
Downloads349,29022,885
Likes26177
LicenseUnknownUnknown
Context Length
Created2025-09-042024-07-24
Last Modified2025-09-042024-08-03
Tags
ggufbase_model:google/embeddinggemma-300mbase_model:quantized:google/embeddinggemma-300mendpoints_compatibleregion:us
transformersggufabliterateduncensoredbase_model:meta-llama/Llama-3.1-8B-Instructbase_model:quantized:meta-llama/Llama-3.1-8B-Instructlicense:llama3.1endpoints_compatibleregion:usconversational

View full details: ggml-org/embeddinggemma-300m-gguf · mlabonne/meta-llama-3.1-8b-instruct-abliterated-gguf