Mosfets/Qwen2.5-7B-Instruct-MathCoder-GGUF overview
QuantFactory Banner https://lh7 rt.googleusercontent.com/docsz/AD 4nXeiuCm7c8lEwEJuRey9kiVZsRn2W b4pWlu3 X534V3YmVuVc2ZL NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT…
Runs locally from ~2.81 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen2.5-7B-Instruct-MathCoder.Q2_K.gguf | GGUF | GGUF | 2.81 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q3_K_L.gguf | GGUF | GGUF | 3.81 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q3_K_M.gguf | GGUF | GGUF | 3.55 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q3_K_S.gguf | GGUF | GGUF | 3.25 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q4_0.gguf | GGUF | GGUF | 4.13 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q4_1.gguf | GGUF | GGUF | 4.54 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q4_K_M.gguf | GGUF | GGUF | 4.36 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q4_K_S.gguf | GGUF | GGUF | 4.15 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q5_0.gguf | GGUF | GGUF | 4.95 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q5_1.gguf | GGUF | GGUF | 5.36 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q5_K_M.gguf | GGUF | GGUF | 5.07 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q5_K_S.gguf | GGUF | GGUF | 4.95 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q6_K.gguf | GGUF | GGUF | 5.82 GB | Download |
| Qwen2.5-7B-Instruct-MathCoder.Q8_0.gguf | GGUF | GGUF | 7.54 GB | Download |
Model Details
Model README
---
base_model:
- Qwen/Qwen2.5-Coder-7B-Instruct
- Qwen/Qwen2.5-7B-Instruct
- Qwen/Qwen2.5-Math-7B-Instruct
library_name: transformers
tags:
- mergekit
- merge
---
QuantFactory/Qwen2.5-7B-Instruct-MathCoder-GGUF
This is quantized version of DeepMount00/Qwen2.5-7B-Instruct-MathCoder created using llama.cpp
Original Model Card
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the TIES merge method using Qwen/Qwen2.5-7B-Instruct as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: Qwen/Qwen2.5-7B-Instruct
#no parameters necessary for base model
- model: Qwen/Qwen2.5-Math-7B-Instruct
parameters:
density: 0.5
weight: 0.5
- model: Qwen/Qwen2.5-Coder-7B-Instruct
parameters:
density: 0.5
weight: 0.5
merge_method: ties
base_model: Qwen/Qwen2.5-7B-Instruct
parameters:
normalize: false
int8_mask: true
dtype: float16Run Mosfets/Qwen2.5-7B-Instruct-MathCoder-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models