GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

groxaxo/Qwen3.6-27B-abliterated-v2-GGUF overview

Qwen3.6 27B abliterated v2 GGUF < polished overview:start Overview Qwen3.6 27B abliterated v2 GGUF is a GGUF release for llama.cpp compatible runtimes and loca…

ggufendpoints_compatibleregion:usimatrixconversational

Runs locally from ~10.63 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
4
Likes
1
Pipeline
Author

Repository Files & Downloads

6 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.6-27B-abliterated-UD-Q2_K_XL.ggufGGUFQ2_K_XL10.63 GBDownload
Qwen3.6-27B-abliterated-UD-Q3_K_XL.ggufGGUFQ3_K_XL13.58 GBDownload
Qwen3.6-27B-abliterated-UD-Q4_K_XL.ggufGGUFQ4_K_XL17.01 GBDownload
Qwen3.6-27B-abliterated-UD-Q5_K_XL.ggufGGUFQ5_K_XL20.39 GBDownload
Qwen3.6-27B-abliterated-UD-Q6_K_XL.ggufGGUFQ6_K_XL20.57 GBDownload
Qwen3.6-27B-abliterated-UD-Q8_K_XL.ggufGGUFQ8_K_XL33.34 GBDownload

Model Details

Model IDgroxaxo/Qwen3.6-27B-abliterated-v2-GGUF
Authorgroxaxo
Pipeline
License
Base model
Last modified2026-08-22T07:46:20.000Z

Model README

Qwen3.6-27B-abliterated-v2-GGUF

<!-- polished-overview:start -->

Overview

Qwen3.6-27B-abliterated-v2-GGUF is a GGUF release for llama.cpp-compatible runtimes and local inference, published by groxaxo.

It is intended for open-source evaluation, reproducible experimentation, and compatible local or

hosted inference workflows. The wording below is deliberately limited to what can be verified

from this repository's metadata and artifacts.

The repository name identifies a behavior-modified or reduced-filtering lineage. That label describes the source or conversion history; it is not a guarantee of unrestricted behavior in every prompt or runtime. Test outputs carefully before sharing or deploying them.

At a glance

| Field | Details |

|---|---|

| Format | GGUF |

| Source / base | the source checkpoint identified in the repository metadata |

| Intended task | the task described by the included configuration and documentation |

| License | the license declared in the repository files |

What is included

  • *.gguf (6 files)
  • Additional configuration, tokenizer, processor, or shard files (6 visible artifacts total)

Quick start

llama.cpp

Download a .gguf file that fits your available memory, then run it with a current llama.cpp

build:

llama-cli \
  -m /path/to/model.gguf \
  -p "Write a concise technical summary."

For vision or any-to-any models, download the matching multimodal projection file when one is

provided and follow the source model's modality-specific instructions.

Compatibility and responsible use

  • Use a runtime that explicitly supports this format, architecture, and modality.
  • Keep configuration, tokenizer, processor, projection, and weight files from the same revision together.
  • Review the source model card and license before redistribution or deployment.
  • Hardware needs depend on parameter count, context length, cache precision, quantization, and concurrency.
  • Report reproducible issues with the runtime version, hardware, launch command, and a minimal example.

Quantization or conversion changes numerical behavior, memory use, and throughput relative to the source checkpoint; validate quality on your own workload.

Generated outputs may be inaccurate or unsuitable for a given use case. Users are responsible for

testing behavior, applying appropriate safeguards, and complying with applicable licenses and laws.

<!-- polished-overview:end -->

Run groxaxo/Qwen3.6-27B-abliterated-v2-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models