GraySoft
Projects Models About FAQ Contact Download guIDE →

bobber/routangseng-qwen35-0.8b-abliterated-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

bobber/routangseng-qwen35-0.8b-abliterated-gguf overview

GGUF export of the stable sft-qwen35-0.8b-abliterated-run1 checkpoint.

llama.cppggufllama-cppqwen3.5chineseuncensoredzhenbase_model:huihui-ai/Huihui-Qwen3.5-0.8B-abliteratedbase_model:quantized:huihui-ai/Huihui-Qwen3.5-0.8B-abliteratedlicense:apache-2.0endpoints_compatibleregion:usconversational
bobber/routangseng-qwen35-0.8b-abliterated-gguf visual
Downloads
165
Likes
1
Pipeline
Library
llama.cpp
Visibility
Public
Access
Open

Repository Files & Downloads

5 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
sft-qwen35-0.8b-abliterated-f16.gguf GGUF F16 1.41 GB Download
sft-qwen35-0.8b-abliterated-q4_k_m.gguf GGUF Q4_K_M 503.07 MB Download
sft-qwen35-0.8b-abliterated-q4_k_m.gguf-00001-of-00003.gguf GGUF Q4_K_M 253.35 MB Download
sft-qwen35-0.8b-abliterated-q4_k_m.gguf-00002-of-00003.gguf GGUF Q4_K_M 242.90 MB Download
sft-qwen35-0.8b-abliterated-q4_k_m.gguf-00003-of-00003.gguf GGUF Q4_K_M 6.81 MB Download

Model Details Live

Model Slug
bobber/routangseng-qwen35-0.8b-abliterated-gguf
Author
bobber
Pipeline Task
Library
llama.cpp
Created
2026-03-09
Last Modified
2026-03-10
Gated
No
Private
No
HF SHA
8fa9c31428e6dd095ee7a42c91de08545ecef5f4
License
apache-2.0
Language
zh, en
Base Model
huihui-ai/Huihui-Qwen3.5-0.8B-abliterated

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "language": [
      "zh",
      "en"
    ],
    "license": "apache-2.0",
    "library_name": "llama.cpp",
    "tags": [
      "gguf",
      "llama-cpp",
      "qwen3.5",
      "chinese",
      "uncensored"
    ],
    "base_model": "huihui-ai/Huihui-Qwen3.5-0.8B-abliterated",
    "frontmatter": {
      "language": [
        "zh",
        "en"
      ],
      "license": "apache-2.0",
      "library_name": "llama.cpp",
      "tags": [
        "gguf",
        "llama-cpp",
        "qwen3.5",
        "chinese",
        "uncensored"
      ],
      "base_model": "huihui-ai/Huihui-Qwen3.5-0.8B-abliterated"
    },
    "hero_image_url": "",
    "summary": "GGUF export of the stable sft-qwen35-0.8b-abliterated-run1 checkpoint.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlanguage:\n- zh\n- en\nlicense: apache-2.0\nlibrary_name: llama.cpp\ntags:\n- gguf\n- llama-cpp\n- qwen3.5\n- chinese\n- uncensored\nbase_model: huihui-ai/Huihui-Qwen3.5-0.8B-abliterated\n---\n\n# Routangseng Qwen3.5-0.8B Abliterated GGUF\n\nGGUF export of the stable `sft-qwen35-0.8b-abliterated-run1` checkpoint.\n\n## Files\n- `sft-qwen35-0.8b-abliterated-f16.gguf`\n- `sft-qwen35-0.8b-abliterated-q4_k_m.gguf`\n- `sft-qwen35-0.8b-abliterated-q4_k_m.gguf-00001-of-00003.gguf`\n- `sft-qwen35-0.8b-abliterated-q4_k_m.gguf-00002-of-00003.gguf`\n- `sft-qwen35-0.8b-abliterated-q4_k_m.gguf-00003-of-00003.gguf`\n\n## Notes\n- Base model: `huihui-ai/Huihui-Qwen3.5-0.8B-abliterated`\n- Intended for the `bobber/routangseng-chat` Hugging Face Space.\n- Split GGUF chunks were added for browser friendliness with `wllama`; point the loader at the first `-00001-of-00003.gguf` shard.\n",
    "related_quantizations": []
  },
  "tags": [
    "llama.cpp",
    "gguf",
    "llama-cpp",
    "qwen3.5",
    "chinese",
    "uncensored",
    "zh",
    "en",
    "base_model:huihui-ai/Huihui-Qwen3.5-0.8B-abliterated",
    "base_model:quantized:huihui-ai/Huihui-Qwen3.5-0.8B-abliterated",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 1,
  "downloads": 165,
  "gated": false,
  "private": false,
  "last_modified": "2026-03-10T04:22:00.000Z",
  "created_at": "2026-03-09T21:39:59.000Z",
  "pipeline_tag": "",
  "library_name": "llama.cpp"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "69af3e2fd286aae339715df8",
  "id": "bobber/routangseng-qwen35-0.8b-abliterated-gguf",
  "modelId": "bobber/routangseng-qwen35-0.8b-abliterated-gguf",
  "sha": "8fa9c31428e6dd095ee7a42c91de08545ecef5f4",
  "createdAt": "2026-03-09T21:39:59.000Z",
  "lastModified": "2026-03-10T04:22:00.000Z",
  "author": "bobber",
  "downloads": 165,
  "likes": 1,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "llama.cpp",
  "siblings_count": 7
}