artificialguybr/QWEN-2.5-0.5B-Synthia-I-gguf overview
About < quantize version: 2 < output tensor quantised: 1 < convert type: hf < vocab type: 🌐 Website You can find more of my models, projects, and information …
Runs locally from ~395.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| model-Q2_K.gguf | GGUF | Q2_K | 395.9 MB | Download |
| model-Q3_K_L.gguf | GGUF | Q3_K_L | 425.3 MB | Download |
| model-Q3_K_M.gguf | GGUF | Q3_K_M | 412.0 MB | Download |
| model-Q3_K_S.gguf | GGUF | Q3_K_S | 395.6 MB | Download |
| model-Q4_0.gguf | GGUF | Q4_0 | 408.9 MB | Download |
| model-Q4_K_M.gguf | GGUF | Q4_K_M | 468.6 MB | Download |
| model-Q4_K_S.gguf | GGUF | Q4_K_S | 456.9 MB | Download |
| model-Q5_0.gguf | GGUF | Q5_0 | 467.8 MB | Download |
| model-Q5_K_M.gguf | GGUF | Q5_K_M | 498.0 MB | Download |
| model-Q5_K_S.gguf | GGUF | Q5_K_S | 491.0 MB | Download |
| model-Q6_K.gguf | GGUF | Q6_K | 620.3 MB | Download |
| model-Q8_0.gguf | GGUF | Q8_0 | 644.4 MB | Download |
| model-f16.gguf | GGUF | F16 | 1.18 GB | Download |
Model Details
| Model ID | artificialguybr/QWEN-2.5-0.5B-Synthia-I-gguf |
|---|---|
| Author | artificialguybr |
| Pipeline | — |
| License | apache-2.0 |
| Base model | artificialguybr/QWEN-2.5-0.5B-Synthia-I |
| Last modified | 2026-07-20T16:55:01.000Z |
Model README
---
base_model: artificialguybr/QWEN-2.5-0.5B-Synthia-I
datasets:
- migtissera/Synthia-v1.5-I
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: artificialguybr
tags:
- instruct
- finetune
- chatml
- gpt4
- synthetic data
- distillation
---
About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
---
🌐 Website
You can find more of my models, projects, and information on my official website:
🚀 Prompt Hub
Need high-quality prompts for image models and LLMs? Explore findgoodprompt.com.
💖 Support My Work
If you find this model useful, please consider supporting my work. It helps me cover server costs and dedicate more time to new open-source projects.
- Patreon: Support on Patreon
- Ko-fi: Buy me a Ko-fi
- Buy Me a Coffee: Buy me a Coffee
<!-- ### tags: -->
Thanks Redmond.AI for GPU Sponsor!
Quantization for: https://huggingface.co/artificialguybr/QWEN-2.5-0.5B-Synthia-I
How to use
If you are unsure how to use GGUF files, look at the [TheBloke
READMEs](https://huggingface.co/TheBloke/CodeLlama-70B-Python-GGUF) for
more details, including on how to concatenate multi-part files.
<!-- artificialguybr-links:start -->
Explore More
Discover more of my models, projects, and practical AI resources:
- AI tools directory: JustGoodAI — a curated directory of useful AI tools.
<!-- artificialguybr-links:end -->
Run artificialguybr/QWEN-2.5-0.5B-Synthia-I-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models