xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud-GGUF overview
Qwen3 VL 32B Abliterated xCloud GGUF 繁體中文 | English below xCloudinfo/Qwen3 VL 32B Abliterated xCloud https://huggingface.co/xCloudinfo/Qwen3 VL 32B Abliterated…
Runs locally from ~1.12 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3-VL-32B-Abliterated-xCloud-IQ2_M.gguf | GGUF | IQ2_M | 10.58 GB | Download |
| Qwen3-VL-32B-Abliterated-xCloud-IQ4_XS.gguf | GGUF | IQ4_XS | 16.48 GB | Download |
| Qwen3-VL-32B-Abliterated-xCloud-Q4_K_M.gguf | GGUF | Q4_K_M | 18.40 GB | Download |
| Qwen3-VL-32B-Abliterated-xCloud-Q5_K_M.gguf | GGUF | Q5_K_M | 21.62 GB | Download |
| Qwen3-VL-32B-Abliterated-xCloud-Q6_K.gguf | GGUF | Q6_K | 25.04 GB | Download |
| Qwen3-VL-32B-Abliterated-xCloud-Q8_0.gguf | GGUF | Q8_0 | 32.43 GB | Download |
| Qwen3-VL-32B-Abliterated-xCloud-mmproj.gguf | GGUF | GGUF | 1.12 GB | Download |
Model Details
| Model ID | xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud-GGUF |
|---|---|
| Author | xCloudinfo |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud |
| Last modified | 2026-08-21T19:26:19.000Z |
Model README
---
license: apache-2.0
base_model: xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud
pipeline_tag: image-text-to-text
library_name: gguf
tags:
- gguf
- llama.cpp
- uncensored
- abliterated
- multimodal
- vision
- qwen3_vl
language:
- en
- zh
---
Qwen3-VL-32B-Abliterated-xCloud (GGUF)
繁體中文 | English below
xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud
的 llama.cpp GGUF 量化版(含視覺 mmproj)。原模型由 xCloudinfo 以 Qwen/Qwen3-VL-32B-Instruct 為基礎、
移除過度拒絕(abliteration)而得。公開釋出供社群測試。
版本對照
| 量化 | 大小 | 說明 |
|---|---|---|
| Q8_0 | 33 GB | 近乎無損 |
| Q6_K | 26 GB | 高品質 |
| Q5_K_M | 22 GB | 品質/體積平衡 |
| Q4_K_M | 19 GB | 一般部署建議 |
| IQ4_XS | 17 GB | imatrix 量化 |
| IQ2_M | 11 GB | 最小可用,imatrix 量化 |
另附 mmproj.gguf(視覺投影,1.2 GB,看圖必需)與 imatrix.dat。
使用方式(含看圖)
llama-server -m Qwen3-VL-32B-Abliterated-xCloud-Q4_K_M.gguf \
--mmproj Qwen3-VL-32B-Abliterated-xCloud-mmproj.gguf \
--jinja -ngl 99 -c 8192
Responsible use / 責任
授權 Apache-2.0(沿用 base)。本模型已移除安全對齊的拒絕行為,可能對敏感或雙用途請求直接作答,
僅供社群測試與研究;使用者須自負合法、合規、合乎倫理之責。xCloudinfo 不對輸出或後續使用承擔責任。
---
Qwen3-VL-32B-Abliterated-xCloud (GGUF) — English
llama.cpp GGUF quantizations (with vision mmproj) of
xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud,
an abliterated (reduced over-refusal) build of Qwen/Qwen3-VL-32B-Instruct. Released for community testing.
Use --mmproj for image input. Apache-2.0. Safety refusals removed — users are solely responsible for lawful,
ethical use; released for research/testing only.
Run xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models