ggml-org/embeddinggemma-300m-ggufvstvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
Side-by-side comparison of ggml-org/embeddinggemma-300m-gguf and tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf: downloads, license, context length, tasks, and benchmarks.
ggml-org/embeddinggemma-300m-gguf
# embeddinggemma-300M GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/embeddinggemma-300M-GGUF --embeddings ` Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl: `console curl --request POST \ --url http://localhos…
tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf
can i fit moe qwen3.5 in 10gb vram? since thats already risky, lets yolo and use claude distil too. 0.65 compression this time. my original goal was 8gb vram but i mathed wrong somewhere. that fits fine on my gpro x080 but not single gpu in the radeon v340l. maybe ill give it an…
Side-by-side Specifications
| ggml-org/embeddinggemma-300m-gguf | tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf | |
|---|---|---|
| Author | ggml-org | tvall43 |
| Pipeline Task | — | text-generation |
| Library | — | transformers |
| Downloads | 349,290 | 20,490 |
| Likes | 26 | 18 |
| License | Unknown | Unknown |
| Context Length | — | — |
| Created | 2025-09-04 | 2026-03-09 |
| Last Modified | 2025-09-04 | 2026-03-09 |
| Tags |
View full details: ggml-org/embeddinggemma-300m-gguf · tvall43/qwen3.5-14b-a3b-claude-4.6-opus-reasoning-distilled-reap-gguf