artificialguybr/LLAMA-3.2-1B-OpenHermes2.5-gguf overview
About < quantize version: 2 < output tensor quantised: 1 < convert type: hf < vocab type: 🌐 Website You can find more of my models, projects, and information …
Runs locally from ~636.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| model-Q2_K.gguf | GGUF | Q2_K | 636.2 MB | Download |
| model-Q3_K_L.gguf | GGUF | Q3_K_L | 806.2 MB | Download |
| model-Q3_K_M.gguf | GGUF | Q3_K_M | 766.5 MB | Download |
| model-Q3_K_S.gguf | GGUF | Q3_K_S | 719.6 MB | Download |
| model-Q4_0.gguf | GGUF | Q4_0 | 876.1 MB | Download |
| model-Q4_K_M.gguf | GGUF | Q4_K_M | 911.2 MB | Download |
| model-Q4_K_S.gguf | GGUF | Q4_K_S | 880.6 MB | Download |
| model-Q5_0.gguf | GGUF | Q5_0 | 1023.4 MB | Download |
| model-Q5_K_M.gguf | GGUF | Q5_K_M | 1.02 GB | Download |
| model-Q5_K_S.gguf | GGUF | Q5_K_S | 1023.4 MB | Download |
| model-Q6_K.gguf | GGUF | Q6_K | 1.15 GB | Download |
| model-Q8_0.gguf | GGUF | Q8_0 | 1.49 GB | Download |
| model-f16.gguf | GGUF | F16 | 2.80 GB | Download |
Model Details
| Model ID | artificialguybr/LLAMA-3.2-1B-OpenHermes2.5-gguf |
|---|---|
| Author | artificialguybr |
| Pipeline | — |
| License | apache-2.0 |
| Base model | artificialguybr/LLAMA-3.2-1B-OpenHermes2.5 |
| Last modified | 2026-07-20T16:53:27.000Z |
Model README
---
base_model: artificialguybr/LLAMA-3.2-1B-OpenHermes2.5
datasets:
- teknium/OpenHermes-2.5
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: artificialguybr
tags:
- llama
- instruct
- finetune
- chatml
- gpt4
- synthetic data
- distillation
---
About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
---
🌐 Website
You can find more of my models, projects, and information on my official website:
🚀 Prompt Hub
Need high-quality prompts for image models and LLMs? Explore findgoodprompt.com.
💖 Support My Work
If you find this model useful, please consider supporting my work. It helps me cover server costs and dedicate more time to new open-source projects.
- Patreon: Support on Patreon
- Ko-fi: Buy me a Ko-fi
- Buy Me a Coffee: Buy me a Coffee
<!-- ### tags: -->
Thanks Redmond.AI for GPU Sponsor!
Quantization for: https://huggingface.co/artificialguybr/LLAMA-3.2-1B-OpenHermes2.5/
How to use
If you are unsure how to use GGUF files, look at the [TheBloke
READMEs](https://huggingface.co/TheBloke/CodeLlama-70B-Python-GGUF) for
more details, including on how to concatenate multi-part files.
<!-- artificialguybr-links:start -->
Explore More
Discover more of my models, projects, and practical AI resources:
- AI tools directory: JustGoodAI — a curated directory of useful AI tools.
<!-- artificialguybr-links:end -->
Run artificialguybr/LLAMA-3.2-1B-OpenHermes2.5-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models