Model Intelligence Sheet
intextus/bge-small-en-v1.5-GGUF overview
bge small en v1.5 GGUF This repository contains GGUF format model files for BAAI/bge small en v1.5 https://huggingface.co/BAAI/bge small en v1.5 , generated wi…
Runs locally from ~24.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
10 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| bge-small-en-v1.5-F16.gguf | GGUF | F16 | 64.5 MB | Download |
| bge-small-en-v1.5-F32.gguf | GGUF | F32 | 127.3 MB | Download |
| bge-small-en-v1.5-Q2_K.gguf | GGUF | Q2_K | 24.0 MB | Download |
| bge-small-en-v1.5-Q3_K_M.gguf | GGUF | Q3_K_M | 25.3 MB | Download |
| bge-small-en-v1.5-Q4_0.gguf | GGUF | Q4_0 | 24.9 MB | Download |
| bge-small-en-v1.5-Q4_K_M.gguf | GGUF | Q4_K_M | 27.7 MB | Download |
| bge-small-en-v1.5-Q5_0.gguf | GGUF | Q5_0 | 27.4 MB | Download |
| bge-small-en-v1.5-Q5_K_M.gguf | GGUF | Q5_K_M | 29.7 MB | Download |
| bge-small-en-v1.5-Q6_K.gguf | GGUF | Q6_K | 33.4 MB | Download |
| bge-small-en-v1.5-Q8_0.gguf | GGUF | Q8_0 | 35.0 MB | Download |
Model Details
Model README
bge-small-en-v1.5-GGUF
This repository contains GGUF format model files for BAAI/bge-small-en-v1.5, generated with llama.cpp's conversion tools.
These files are fully compatible with llama.cpp and intextus.
Available Files & Quantizations
bge-small-en-v1.5-F32.gguf: Full precision F32.bge-small-en-v1.5-F16.gguf: Half precision F16.bge-small-en-v1.5-Q8_0.gguf: 8-bit quantization (recommended default, fast and near-lossless).bge-small-en-v1.5-Q6_K.gguf: 6-bit quantization.bge-small-en-v1.5-Q5_K_M.gguf: 5-bit quantization (Medium).bge-small-en-v1.5-Q5_0.gguf: 5-bit quantization.bge-small-en-v1.5-Q4_K_M.gguf: 4-bit quantization (Medium).bge-small-en-v1.5-Q4_0.gguf: 4-bit quantization.bge-small-en-v1.5-Q3_K_M.gguf: 3-bit quantization (Medium).bge-small-en-v1.5-Q2_K.gguf: 2-bit quantization.
Run intextus/bge-small-en-v1.5-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models