GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

jamiefutch/Qwopus3.6-35B-A3B-v1-MTP-MXFP4_MOE-GGUF overview

These are MXFP4 quantizations of the model Jackrong / Qwopus3.6 35B A3B v1 https://huggingface.co/Jackrong/Qwopus3.6 35B A3B v1 This is the multi token predict…

ggufqwenqwen3_5_moeMTPimage-text-to-textbase_model:Jackrong/Qwopus3.6-35B-A3B-v1base_model:quantized:Jackrong/Qwopus3.6-35B-A3B-v1endpoints_compatibleregion:usconversational

Runs locally from ~19.71 GB disk (24 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
image-text-to-text

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwopus3.6-35B-A3B-v1-MTP-MXFP4_MOE.ggufGGUFGGUF19.71 GBDownload
Qwopus3.6-35B-A3B-v1-MTP-MXFP4_MOE_BF16.ggufGGUFBF1621.39 GBDownload
Qwopus3.6-35B-A3B-v1-MTP-MXFP4_MOE_F16.ggufGGUFF1621.39 GBDownload

Model Details

Model IDjamiefutch/Qwopus3.6-35B-A3B-v1-MTP-MXFP4_MOE-GGUF
Authorjamiefutch
Pipelineimage-text-to-text
License
Base modelJackrong/Qwopus3.6-35B-A3B-v1
Last modified2026-07-12T09:49:08.000Z

Model README

---

pipeline_tag: image-text-to-text

base_model:

  • Jackrong/Qwopus3.6-35B-A3B-v1

tags:

- qwen

- qwen3_5_moe

- MTP

---

These are MXFP4 quantizations of the model Jackrong / Qwopus3.6-35B-A3B-v1

This is the multi-token prediction (MTP) version.

Quick Start

  1. Download the latest release of llama.cpp.
  2. Download your preferred model variant from below.

Which version should I choose?

All variants use MXFP4 for the MoE (Mixture of Experts) weights to keep the model efficient. The difference lies in how the remaining tensors are handled:

| Variant | Quality | Performance | Size | Recommendation |

| :--- | :--- | :--- | ---: | :--- |

| BF16 | ⭐⭐⭐ | Variable* | 21.39GiB | Best for maximum accuracy; original unquantized weights. |

| F16 | ⭐⭐ | Fast | 21.39GiB | Great alternative if BF16 is slow on your hardware. |

| Q8 | ⭐ | Fastest | 19.71GiB | Balanced performance and memory usage. |

\Note: On some older architectures, BF16 may be slower than F16. Check that your GPU supports native BF16 *

Read the guide from unsloth in order to set up the model's recommended settings for MTP:

Qwen3.6 - MTP Guide

On my system it works very well with the commands:

--spec-type draft-mtp
--spec-draft-p-min 0.75
--spec-draft-n-max 3

Run jamiefutch/Qwopus3.6-35B-A3B-v1-MTP-MXFP4_MOE-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models