---

license: other

base_model: Skywork/Skywork-OR1-Math-7B

tags:

- llama-cpp

- gguf

- qwen2

- math

- reasoning

language:

- en

pipeline_tag: text-generation

library_name: gguf

---

Skywork-OR1-Math-7B - GGUF

GGUF quantizations of Skywork/Skywork-OR1-Math-7B.

Model Description

Skywork-OR1-Math-7B is a math-specialized reasoning model from the Skywork Open Reasoner 1 (OR1) series, trained using large-scale rule-based reinforcement learning. It is fine-tuned on top of DeepSeek-R1-Distill-Qwen-7B with a curated dataset of 110K verifiable math problems and 14K coding questions.

It achieves 69.8 on AIME24 and 52.3 on AIME25, outperforming all similarly sized models on mathematical reasoning tasks.

Benchmark Results

| Model | AIME24 (Avg@32) | AIME25 (Avg@32) |

|---|---|---|

| DeepSeek-R1-Distill-Qwen-7B | 55.5 | 39.2 |

| Light-R1-7B-DS | 59.1 | 44.3 |

| Skywork-OR1-Math-7B | 69.8 | 52.3 |

Available Quantizations

| File | Bits | Size (approx) | Use Case |

|---|---|---|---|

| model_f16.gguf | 16 | ~15.3 GB | Maximum quality, reference |

| model_q8_0.gguf | 8 | ~8.1 GB | Best quality, if VRAM allows |

| model_q6_k.gguf | 6 | ~6.3 GB | Very high quality |

| model_q5_k_m.gguf | 5 | ~5.5 GB | Recommended balance |

| model_q5_k_s.gguf | 5 | ~5.3 GB | High quality, slightly smaller |

| model_q4_k_m.gguf | 4 | ~4.7 GB | Good quality, widely used |

| model_q4_k_s.gguf | 4 | ~4.5 GB | Smaller, slight quality loss |

| model_q3_k_l.gguf | 3 | ~4.0 GB | Low VRAM, moderate quality |

| model_q3_k_m.gguf | 3 | ~3.7 GB | Low VRAM |

| model_q3_k_s.gguf | 3 | ~3.5 GB | Minimal VRAM |

| model_q2_k.gguf | 2 | ~2.9 GB | Lowest quality, smallest size |

VRAM Requirements

| Quantization | VRAM (approx) |

|---|---|

| F16 | ~16 GB |

| Q8_0 | ~9 GB |

| Q6_K | ~7 GB |

| Q5_K_M | ~6 GB |

| Q4_K_M | ~5.5 GB |

| Q3_K_M | ~4.5 GB |

| Q2_K | ~3.5 GB |

Usage

llama.cpp

./llama-cli -m model_q4_k_m.gguf -p "Solve: What is the sum of all prime numbers less than 20?" -n 512

llama-cpp-python

from llama_cpp import Llama

llm = Llama(model_path="model_q4_k_m.gguf", n_ctx=4096)
output = llm("Solve: What is the sum of all prime numbers less than 20?", max_tokens=512)
print(output["choices"][0]["text"])

LM Studio

Download any .gguf file from this repository and load it directly in LM Studio.

Ollama

ollama run hf.co/tinyopsec/Skywork-OR1-Math-7B-GGUF:Q4_K_M

Original Model

• Original model: Skywork/Skywork-OR1-Math-7B
• Base model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
• Paper: Skywork Open Reasoner 1 Technical Report
• License: Qwen License

Citation

@article{he2025skywork,
  title={Skywork Open Reasoner 1 Technical Report},
  author={He, Jujie and Liu, Jiacai and Liu, Chris Yuhao and Yan, Rui and Wang, Chaojie and Cheng, Peng and Zhang, Xiaoyu and Zhang, Fuxiang and Xu, Jiacheng and Shen, Wei and Li, Siyuan and Zeng, Liang and Wei, Tianwen and Cheng, Cheng and An, Bo and Liu, Yang and Zhou, Yahui},
  journal={arXiv preprint arXiv:2505.22312},
  year={2025}
}