GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

lm-kit/qwq-32b-gguf overview

Model Summary This repository hosts quantized versions of the QWQ 32B reasoning model. Format: GGUF Converter: llama.cpp ba7654380a3c7c1b5ae154bea19134a3a9417a…

gguflicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~18.49 GB disk (24 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
12
Likes
0
Pipeline
Author

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
QwQ-32B-F16.ggufGGUFF1661.04 GBDownload
QwQ-32B-Q4_K_M.ggufGGUFQ4_K_M18.49 GBDownload

Model Details

Model IDlm-kit/qwq-32b-gguf
Authorlm-kit
Pipeline
Licenseapache-2.0
Base model
Last modified2026-08-11T16:51:00.000Z

Model README

---

license: apache-2.0

---

Model Summary

This repository hosts quantized versions of the QWQ-32B reasoning model.

Format: GGUF

Converter: llama.cpp ba7654380a3c7c1b5ae154bea19134a3a9417a1e

Quantizer: LM-Kit.NET 2025.3.3

For more detailed information on the base model, please visit the following link

Run lm-kit/qwq-32b-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models