burhan2753y/qwen2.5-coder-0.5b-nl2bash-gguf overview
π Qwen2.5 Coder 0.5B Instruct NL2Bash GGUF Quantized A fine tuned version of Qwen/Qwen2.5 Coder 0.5B Instruct specialized for converting natural language instβ¦
Runs locally from ~506.5 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| qwen2.5-coder-0.5b-bash-gguf.gguf | GGUF | GGUF | 506.5 MB | Download |
Model Details
| Model ID | burhan2753y/qwen2.5-coder-0.5b-nl2bash-gguf |
|---|---|
| Author | burhan2753y |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | Qwen/Qwen2.5-Coder-0.5B-Instruct |
| Last modified | 2026-09-15T11:58:39.000Z |
Model README
---
license: apache-2.0
base_model: Qwen/Qwen2.5-Coder-0.5B-Instruct
tags:
- unsloth
- text-generation-inference
- llama-cpp
- gguf
- ollama
- nl2bash
- bash
- terminal-assistant
datasets:
- emirkaanozdemr/bash_command_data_6K
language:
- en
pipeline_tag: text-generation
---
π Qwen2.5-Coder-0.5B-Instruct - NL2Bash (GGUF Quantized)
A fine-tuned version of Qwen/Qwen2.5-Coder-0.5B-Instruct specialized for converting natural language instructions directly into executable Linux/Ubuntu Bash commands with zero conversational filler.
π Dual-Track Benchmark Results
π Track 1: Academic NL2Bash Benchmark (EMNLP 2018 / Microsoft CodeXGLUE)
| Metric | Base Model (qwen2.5-coder:0.5b) | Fine-Tuned Model (bash-coder-assistant) | Improvement |
| :--- | :--- | :--- | :--- |
| Exact Match (EM %) | 0.0% | 44.0% | +44.0% |
| Token F1 Score | 12.93 | 81.60 | +68.7 pts |
| BLEU-4 Score | 4.60 | 65.01 | +60.4 pts |
| Bash Syntax Validity | 88.0% | 100.0% | +12.0% |
| Zero-Chatter Clean Format | 4.0% | 100.0% | +96.0% |
| Mean Latency (CPU) | 19.03s | 1.58s | β‘ 91.7% Faster |
π οΈ Track 2: Real-World DevOps, Cloud & SysAdmin Benchmark
| Metric | Base Model (qwen2.5-coder:0.5b) | Fine-Tuned Model (bash-coder-assistant) | Improvement |
| :--- | :--- | :--- | :--- |
| Exact Match (EM %) | 0.0% | 15.0% | +15.0% |
| Token F1 Score | 6.76 | 62.42 | +55.7 pts |
| Bash Syntax Validity | 90.0% | 100.0% | +10.0% |
| Mean Latency (CPU) | 20.98s | 1.78s | β‘ 91.5% Faster |
π¦ Quickstart with Ollama
- Download the
qwen2.5-coder-0.5b-bash-gguf.gguffile andModelfile. - Create the model in Ollama:
ollama create bash-coder-assistant -f Modelfile
- Run a query:
ollama run bash-coder-assistant "Find all processes running on port 8080 and terminate them immediately"
# Output: sudo kill -9 $(lsof -i :8080 | awk '{print $2}')
π οΈ Training Details
- Architecture: Qwen2.5-Coder (0.5B parameters)
- Framework: Unsloth + TRL SFTTrainer
- Dataset:
emirkaanozdemr/bash_command_data_6K - LoRA Rank:
r=16,lora_alpha=16 - Training Compute: Google Colab Tesla T4 GPU (< 2GB VRAM, ~8 min runtime)
- Final Loss:
0.6726(converged from initial4.1045)
Run burhan2753y/qwen2.5-coder-0.5b-nl2bash-gguf with guIDE
Download guIDE β the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face Β· Compare models