kratark/MiniLM-L6-H384-Uncased-23M-F16.gguf overview
all MiniLM L6 v2 This is a Sentence Transformers model that maps sentences and paragraphs to a 384 dimensional dense vector space and can be used for tasks suc…
Runs locally from ~44.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| MiniLM-L6-H384-Uncased-23M-F16.gguf | GGUF | F16 | 44.1 MB | Download |
Model Details
Model README
---
license: mit
---
all-MiniLM-L6-v2
This is a Sentence-Transformers model that maps sentences and paragraphs to a 384-dimensional dense vector space and can be used for tasks such as semantic search, clustering, and similarity comparison.
Usage (Sentence-Transformers)
Using this model is straightforward once you have sentence-transformers installed:
pip install -U sentence-transformers
Note
The GGUF version was generated from the official sentence-transformers/all-MiniLM-L6-v2 model sources. The conversion only changes the distribution format to GGUF for compatibility with supported inference engines and does not alter the underlying model architecture or weights.
Base model: sentence-transformers/all-MiniLM-L6-v2
Run kratark/MiniLM-L6-H384-Uncased-23M-F16.gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models