---

license: apache-2.0

base_model: AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16

library_name: llama.cpp

pipeline_tag: text-generation

tags:

• gguf
• llama.cpp
• rocm
• rocmfpx
• amd
• strix-halo
• qwen3.8
• qwen35
• imatrix
• thinking
• uncensored

---

Qwen3.8-27B AEON ULTIMATE — ROCmFPX iMatrix GGUF

ROCmFPX iMatrix quantizations of the full BF16 checkpoint published by

Aeon / AEON-7.

Attribution

The source weights are Aeon's Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16,

pinned at Hub revision

8f76e82ed7ef4de7735f5d4148fce7b643b00fae. Aeon deserves attribution for the

BF16 model and its model work. This repository contains derived GGUF

quantizations produced by vmlinux with the ROCmFPX toolchain; it is not a new

training run or a claim of ownership of the source model.

The source model declares Apache 2.0 licensing. Review the source model card

and applicable terms before redistribution or deployment.

Quantizations

| File | Preset | Size | SHA-256 |

| --- | --- | ---: | --- |

| Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP4-iMatrix.gguf | Q4_0_ROCMFP4 | 17,735,469,440 bytes | 34c04aaec2399fab8179a921d0ea1e9d3b93da213201ab0ec2930ee1420307b0 |

| Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP6-iMatrix.gguf | Q6_0_ROCMFPX | 22,528,383,360 bytes | d096fdd0ece150cefa793a8fdae55076b63d61d9e135571de6c73b016a641ba1 |

| Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP8-iMatrix.gguf | Q8_0_ROCMFPX | 28,193,397,120 bytes | 10eff5653c51e23a8a816761feea69b235c9003e80821759ecef41814843a761 |

All three use the same model-specific importance matrix:

Qwen3.8-27B-AEON-ULTIMATE-iMatrix.imatrix.gguf. The matrix was generated

from 339 chunks of 512 tokens using the shared calibration corpus, and each

quantizer consumed 496 entries.

Runtime

These are experimental ROCmFPX tensor types and require a compatible

ROCmFPX-enabled llama.cpp build. Stock upstream llama.cpp will not load them.

Example ROCm0 invocation:

hf download vmlinux/Qwen3.8-27B-AEON-ULTIMATE-ROCmFPX-GGUF \
  Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP4-iMatrix.gguf \
  --local-dir ./Qwen3.8-27B-AEON-ULTIMATE-ROCmFPX

./llama-completion \
  -m ./Qwen3.8-27B-AEON-ULTIMATE-ROCmFPX/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP4-iMatrix.gguf \
  -dev ROCm0 -ngl all -c 8192 -n 256 -p "Hello."

The GGUFs retain the native one-layer MTP head. Thinking is enabled by the

embedded Qwen template by default; pass the appropriate chat-template kwargs

when an application needs thinking disabled.

Validation and provenance

All three files loaded and generated a short completion on ROCm0 with all

layers offloaded. Detailed public build information is in

BUILD_RESULTS.md, with exact hashes in

SHA256SUMS and source/toolchain details in

PROVENANCE.md.