lightx2v/Qwen-Image-2.1-PE-I2I-GGUF-Q8_0 overview
Qwen Image 2.1 PE I2I GGUF Q8 0 This repository provides the Q8 0 GGUF quantization of Qwen Image 2.1 PE I2I and the files needed to run it with llama.cpp. Ori…
Runs locally from ~879.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | lightx2v/Qwen-Image-2.1-PE-I2I-GGUF-Q8_0 |
|---|---|
| Author | lightx2v |
| Pipeline | text-generation |
| License | other |
| Base model | Qwen/Qwen-Image-2.1-PE-I2I |
| Last modified | 2026-10-12T22:08:21.000Z |
Model README
---
license: other
license_name: qwen-research
license_link: >-
https://huggingface.co/Qwen/Qwen-Image-2.1-PE-I2I/blob/72927bc08afc99b7888ceb7d7d51a12db3700bbd/LICENSE
base_model: Qwen/Qwen-Image-2.1-PE-I2I
base_model_relation: quantized
library_name: gguf
pipeline_tag: text-generation
tags:
- gguf
- llama-cpp
- prompt-rewriting
- image-editing
---
Qwen-Image-2.1-PE-I2I GGUF Q8_0
This repository provides the Q8_0 GGUF quantization of Qwen-Image-2.1-PE-I2I and the files needed to run it with llama.cpp.
Original model: Qwen/Qwen-Image-2.1-PE-I2I.
Download llama.cpp binaries
Download a binary package for your operating system and processor architecture from the llama.cpp releases page.
For Apple Silicon MacBooks and Macs, download the b11564 macOS arm64 binary package.
Run
Set the environment variables below, replacing the example paths with the actual absolute paths to your model and binary directories. Use absolute paths for input images as well. You can run the commands from any directory.
export MODEL_DIR="/path/to/Qwen-Image-2.1-PE-I2I-GGUF-Q8_0"
export LLAMA_BIN="/path/to/llama-b11564"
Replace /path/to/input.png with the actual absolute path to your input image.
"${LLAMA_BIN}/llama-mtmd-cli" \
--model "${MODEL_DIR}/Qwen-Image-2.1-PE-I2I-Q8_0.gguf" \
--mmproj "${MODEL_DIR}/mmproj-Qwen-Image-2.1-PE-I2I-BF16.gguf" \
--image "/path/to/input.png" \
--system-prompt "$(cat "${MODEL_DIR}/system_prompt.txt")" \
--jinja --chat-template "$(cat "${MODEL_DIR}/chat_template.jinja")" \
--ctx-size 32768 --n-gpu-layers 99 --threads 8 \
--n-predict 24000 --seed 42 \
--temp 1.0 --top-p 0.95 --top-k 20 --min-p 0 --repeat-penalty 1.0 \
--verbosity 1 \
--prompt "Change the red square in the image to green, keeping everything else unchanged"
Multiple reference images
Add one --image argument for each image. In argument order, the first image is <image1>, the second is <image2>, and so on. Use these tags in your editing instruction to describe each image's role.
"${LLAMA_BIN}/llama-mtmd-cli" \
--model "${MODEL_DIR}/Qwen-Image-2.1-PE-I2I-Q8_0.gguf" \
--mmproj "${MODEL_DIR}/mmproj-Qwen-Image-2.1-PE-I2I-BF16.gguf" \
--image "/path/to/base.png" \
--image "/path/to/reference.png" \
--system-prompt "$(cat "${MODEL_DIR}/system_prompt.txt")" \
--jinja --chat-template "$(cat "${MODEL_DIR}/chat_template.jinja")" \
--ctx-size 32768 --n-gpu-layers 99 --threads 8 \
--n-predict 24000 --seed 42 \
--temp 1.0 --top-p 0.95 --top-k 20 --min-p 0 --repeat-penalty 1.0 \
--verbosity 1 \
--prompt "Use <image1> as the base image. Replace the person's clothing with the clothing from <image2>, keeping the person's identity, pose, and background in <image1> unchanged. Match the output aspect ratio to <image1>."
LightX2V APP
A native macOS app for local image generation with Qwen-Image-2.1-Turbo on Apple Silicon. It uses LightX2V for image inference and llama.cpp for optional prompt enhancement, with a simple interface for text-to-image and image-to-image creation.
Download LightX2V APP and try local inference with Qwen-Image-2.1-Turbo and prompt enhancement (PE) on your MacBook!
LightX2V APP is open source—we welcome you to explore and build upon LightX2V APP and LightX2V, and appreciate your feedback and contributions.
Run lightx2v/Qwen-Image-2.1-PE-I2I-GGUF-Q8_0 with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models