Model Intelligence Sheet
armandosds/OLMo-2-0425-1B-Instruct-GGUF overview
GGUF version of https://huggingface.co/allenai/OLMo 2 0425 1B Instruct
Runs locally from ~604.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
13 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| OLMo-2-0425-1B-Instruct-F16.gguf | GGUF | F16 | 2.77 GB | Download |
| OLMo-2-0425-1B-Instruct-Q2_K.gguf | GGUF | Q2_K | 604.0 MB | Download |
| OLMo-2-0425-1B-Instruct-Q3_K_L.gguf | GGUF | Q3_K_L | 787.9 MB | Download |
| OLMo-2-0425-1B-Instruct-Q3_K_M.gguf | GGUF | Q3_K_M | 742.9 MB | Download |
| OLMo-2-0425-1B-Instruct-Q3_K_S.gguf | GGUF | Q3_K_S | 688.9 MB | Download |
| OLMo-2-0425-1B-Instruct-Q4_0.gguf | GGUF | Q4_0 | 850.9 MB | Download |
| OLMo-2-0425-1B-Instruct-Q4_K_M.gguf | GGUF | Q4_K_M | 892.2 MB | Download |
| OLMo-2-0425-1B-Instruct-Q4_K_S.gguf | GGUF | Q4_K_S | 856.9 MB | Download |
| OLMo-2-0425-1B-Instruct-Q5_0.gguf | GGUF | Q5_0 | 1003.4 MB | Download |
| OLMo-2-0425-1B-Instruct-Q5_K_M.gguf | GGUF | Q5_K_M | 1.00 GB | Download |
| OLMo-2-0425-1B-Instruct-Q5_K_S.gguf | GGUF | Q5_K_S | 1003.4 MB | Download |
| OLMo-2-0425-1B-Instruct-Q6_K.gguf | GGUF | Q6_K | 1.14 GB | Download |
| OLMo-2-0425-1B-Instruct-Q8_0.gguf | GGUF | Q8_0 | 1.47 GB | Download |
Model Details
| Model ID | armandosds/OLMo-2-0425-1B-Instruct-GGUF |
|---|---|
| Author | armandosds |
| Pipeline | — |
| License | — |
| Base model | allenai/OLMo-2-0425-1B-Instruct |
| Last modified | 2026-07-09T00:20:03.000Z |
Model README
---
base_model:
- allenai/OLMo-2-0425-1B-Instruct
---
GGUF version of https://huggingface.co/allenai/OLMo-2-0425-1B-Instruct
Run armandosds/OLMo-2-0425-1B-Instruct-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models