GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

marafx2007/Q3.6-27B-GLM-5.1-DA-GGUF overview

Q3.6 27B GLM 5.1 DA GGUF Q3.6 27B GLM 5.1 DA Qwen3.6 GLM Distilled Abliterated is a reasoning focused model built on top of Qwen/Qwen3.6 27B through the prithi…

transformersggufqwen3_5text-generation-inferenceglm-5.1mathreasoninguncensoredabliteratedunfilteredunredactedrefusal-ablatedalignment-modifiedllama-cppbf16image-text-to-textendataset:prithivMLmods/harm_benchdataset:Jackrong/GLM-5.1-Reasoning-1M-Cleanedbase_model:prithivMLmods/Q3.6-27B-GLM-5.1-DAbase_model:quantized:prithivMLmods/Q3.6-27B-GLM-5.1-DAlicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~600.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
image-text-to-text

Repository Files & Downloads

17 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Q3.6-27B-GLM-5.1-DA.BF16.ggufGGUFQ350.11 GBDownload
Q3.6-27B-GLM-5.1-DA.F16.ggufGGUFQ350.11 GBDownload
Q3.6-27B-GLM-5.1-DA.Q2_K.ggufGGUFQ39.98 GBDownload
Q3.6-27B-GLM-5.1-DA.Q3_K_L.ggufGGUFQ313.36 GBDownload
Q3.6-27B-GLM-5.1-DA.Q3_K_M.ggufGGUFQ312.39 GBDownload
Q3.6-27B-GLM-5.1-DA.Q3_K_S.ggufGGUFQ311.24 GBDownload
Q3.6-27B-GLM-5.1-DA.Q4_0.ggufGGUFQ314.41 GBDownload
Q3.6-27B-GLM-5.1-DA.Q4_K_M.ggufGGUFQ315.41 GBDownload
Q3.6-27B-GLM-5.1-DA.Q4_K_S.ggufGGUFQ314.52 GBDownload
Q3.6-27B-GLM-5.1-DA.Q5_0.ggufGGUFQ317.40 GBDownload
Q3.6-27B-GLM-5.1-DA.Q5_K_M.ggufGGUFQ317.91 GBDownload
Q3.6-27B-GLM-5.1-DA.Q5_K_S.ggufGGUFQ317.40 GBDownload
Q3.6-27B-GLM-5.1-DA.Q6_K.ggufGGUFQ320.57 GBDownload
Q3.6-27B-GLM-5.1-DA.Q8_0.ggufGGUFQ326.63 GBDownload
Q3.6-27B-GLM-5.1-DA.mmproj-bf16.ggufGGUFQ3888.0 MBDownload
Q3.6-27B-GLM-5.1-DA.mmproj-f16.ggufGGUFQ3888.0 MBDownload
Q3.6-27B-GLM-5.1-DA.mmproj-q8_0.ggufGGUFQ3600.1 MBDownload

Model Details

Model IDmarafx2007/Q3.6-27B-GLM-5.1-DA-GGUF
Authormarafx2007
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelprithivMLmods/Q3.6-27B-GLM-5.1-DA
Last modified2026-06-22T19:53:58.000Z

Model README

---

license: apache-2.0

tags:

  • text-generation-inference
  • glm-5.1
  • math
  • reasoning
  • uncensored
  • abliterated
  • unfiltered
  • unredacted
  • refusal-ablated
  • alignment-modified
  • llama-cpp
  • bf16

datasets:

  • prithivMLmods/harm_bench
  • Jackrong/GLM-5.1-Reasoning-1M-Cleaned

base_model:

  • prithivMLmods/Q3.6-27B-GLM-5.1-DA

language:

  • en

pipeline_tag: image-text-to-text

library_name: transformers

---

Q3.6-27B-GLM-5.1-DA-GGUF

> Q3.6-27B-GLM-5.1-DA (Qwen3.6 GLM Distilled-Abliterated) is a reasoning-focused model built on top of Qwen/Qwen3.6-27B through the prithivMLmods/Qwen3.6-27B-abliterated-rMAX base. The model is optimized for rich, detailed, and context-aware reasoning using GLM-5.1 distilled reasoning traces combined with advanced refusal direction analysis and ablation-based training strategies to reduce internal refusal behaviors while preserving strong reasoning and instruction-following performance.

> [!IMPORTANT]

> This model is intended strictly for research and learning purposes. Due to reduced internal refusal mechanisms, it may generate sensitive or unrestricted content. Users assume full responsibility for how the model is used. The authors and hosting platform disclaim any liability for generated outputs.

> [!NOTE]

> Note: This model is experimental and may generate artifacts.

Model Files

File Name | Quant Type | File Size | File Link |

|-----------|------------|-----------|-----------|

| Q3.6-27B-GLM-5.1-DA.BF16.gguf | BF16 | 53.8 GB | Download |

| Q3.6-27B-GLM-5.1-DA.F16.gguf | F16 | 53.8 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q2_K.gguf | Q2_K | 10.7 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q3_K_L.gguf | Q3_K_L | 14.3 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q3_K_M.gguf | Q3_K_M | 13.3 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q3_K_S.gguf | Q3_K_S | 12.1 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q4_0.gguf | Q4_0 | 15.5 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q4_K_M.gguf | Q4_K_M | 16.5 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q4_K_S.gguf | Q4_K_S | 15.6 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q5_0.gguf | Q5_0 | 18.7 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q5_K_M.gguf | Q5_K_M | 19.2 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q5_K_S.gguf | Q5_K_S | 18.7 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q6_K.gguf | Q6_K | 22.1 GB | Download |

| Q3.6-27B-GLM-5.1-DA.Q8_0.gguf | Q8_0 | 28.6 GB | Download |

| Q3.6-27B-GLM-5.1-DA.mmproj-bf16.gguf | mmproj-bf16 | 931 MB | Download |

| Q3.6-27B-GLM-5.1-DA.mmproj-f16.gguf | mmproj-f16 | 931 MB | Download |

| Q3.6-27B-GLM-5.1-DA.mmproj-q8_0.gguf | mmproj-q8_0 | 629 MB | Download |

## Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant

types (lower is better):

!image.png

Run marafx2007/Q3.6-27B-GLM-5.1-DA-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models