---

base_model: TaimoorSiddiqui/Hopcoder-Mini-9B

library_name: llama.cpp

tags:

• gguf
• quantized
• tool-calling
• swe-agent
• qwen3.5

---

Hopcoder-Mini-9B-SWE-Agent

GGUF quantized version of the Hopcoder-Mini-9B-SWE-Agent model.

Model Details

• Base model: TaimoorSiddiqui/Hopcoder-Mini-9B
• LoRA adapter: TaimoorSiddiqui/Hopcoder-Mini-9B-SWE-Agent-LoRA-H200
• Architecture: Qwen3.5 (Qwen3_5ForConditionalGeneration)
• Parameters: 9.4B
• Format: GGUF

Available Quantizations

| Quantization | File | Size |

|---|---|---|

| Q4_K_M | Hopcoder-Mini-9B-SWE-Agent-Q4_K_M.gguf | 5.63 GB |

| Q5_K_M | Hopcoder-Mini-9B-SWE-Agent-Q5_K_M.gguf | 6.47 GB |

| Q8_0 | Hopcoder-Mini-9B-SWE-Agent-Q8_0.gguf | 9.53 GB |

| F16 | Hopcoder-Mini-9B-SWE-Agent-F16.gguf | 17.92 GB |

Usage

# Download a quantized file
huggingface-cli download TaimoorSiddiqui/Hopcoder-Mini-9B-SWE-Agent-GGUF Hopcoder-Mini-9B-SWE-Agent-Q4_K_M.gguf --local-dir ./

# Run with llama.cpp
llama-server --model Hopcoder-Mini-9B-SWE-Agent-Q4_K_M.gguf --n-gpu-layers 99 --port 8080

Merging Process

1. Loaded base model in FP16 on CPU
2. Merged LoRA adapter(s) into base (Stage-2 SWE-Agent (already contains Stage-1))
3. Converted merged model to GGUF format
4. Quantized to multiple levels using llama-quantize
5. Uploaded to HuggingFace

Original Model

The original PEFT/LoRA adapter is available at:

• Stage-2 (contains Stage-1): TaimoorSiddiqui/Hopcoder-Mini-9B-SWE-Agent-LoRA-H200