Qwen-Image GGUF Guide to ComfyUI Setup and Quantization

To use Qwen-Image GGUF in ComfyUI, install city96's ComfyUI-GGUF loader and load a converted image model alongside the required text encoder and VAE. The conversion card supplies downloads, folder locations, and an example workflow. These files represent Alibaba Qwen's 20B image model in GGUF format. Conversion card Qwen repository

What are the key facts about Qwen-Image GGUF?

Start with the conversion publisher's model card, because it names the associated components and links an example graph. A generic GGUF tutorial may describe a different image model or a language-model workflow.

How does Qwen-Image GGUF quantization work?

ComfyUI-GGUF provides support for storing compatible diffusion-transformer weights with lower-bit quantization. Its purpose is to make another weight representation available within ComfyUI, where users can test memory and quality tradeoffs using their existing image-generation workflow. Loader README

The Qwen conversion card describes a specific treatment for several quantizations, including Q5_K_M, Q4_K_M, and lower-bit variants: the first and last layers are retained at higher precision. This is a detail of the published conversion method, so do not assume that every layer uses a single uniform precision from the filename. Conversion card

The publisher supplies a Qwen-specific workflow with a GGUF image loader, Qwen text-encoder selection, and the Qwen VAE. That gives you a concrete starting graph to inspect before experimenting with different conversion files. Example workflow

A useful evaluation includes a simple illustration, a face, a textured object, and a short text-bearing image. Choose examples relevant to your work and inspect the same features across candidate quantizations. These are suggested test cases, not a claim that any particular quantization has passed them.

What are the limits of Qwen-Image GGUF in ComfyUI?

The conversion card labels its displayed output as a single sample that is not necessarily representative. It does not publish a universal GPU-memory minimum or a fixed image-generation time. Treat the sample as evidence that the illustrated workflow exists, then measure the workload you intend to run. Conversion card

Downloading the GGUF transformer alone does not complete the pipeline. The model card separately requires a Qwen2.5-VL-7B text encoder and Qwen-Image VAE. A smaller image-model file therefore does not by itself establish the memory use of the full graph. Conversion card

The generic ComfyUI-GGUF README calls the project a work in progress and describes LoRA loading as experimental. If an adapter is part of your intended workflow, verify that combination separately after establishing a working baseline. Loader README

The Qwen conversion card places its image model in models/diffusion_models; the generic ComfyUI-GGUF README uses models/unet. Follow the Qwen-specific layout for the supplied graph and select the downloaded file in its loader. Conversion card Loader README

How do you install and load Qwen-Image GGUF in ComfyUI?

Update ComfyUI, then install ComfyUI-GGUF in the Python environment that actually runs the application. From the ComfyUI installation directory, the normal Git and Python installation can be written as follows, adapting the folder placement in the loader's README. Loader README

git clone https://github.com/city96/ComfyUI-GGUF custom_nodes/ComfyUI-GGUF
python -m pip install --upgrade gguf

For a Windows portable installation, use the bundled Python executable and the portable commands in the official loader README. Installing a dependency into a different system Python does not configure the environment named by those commands. Loader README

Download one GGUF image-model file from the city96 Qwen repository. Put it in ComfyUI/models/diffusion_models, the Qwen encoder in ComfyUI/models/text_encoders, and qwen_image_vae.safetensors in ComfyUI/models/vae. The conversion card links both standard and GGUF text-encoder options. Conversion card

Import the example workflow linked from the card. Its UnetLoaderGGUF selects the image model, while its encoder loaders specify qwen_image as the model type. The graph includes both ordinary and GGUF encoder-loading options; inspect which path is connected and select the actual file you downloaded. Example workflow

Use the graph's settings for an initial run before adding LoRAs or replacing other nodes. Save the workflow and the exact conversion filename with the output. Then change only the image-model quantization and compare spelling, outlines, textures, runtime, and memory behavior against the baseline.

If you need help identifying the original components, see the sibling native Qwen-Image ComfyUI guide. The sibling GPU planning guide explains why encoder, transformer, and VAE residency should be considered separately.

How does Qwen-Image GGUF compare with native and Nunchaku setups?

These routes require their own documented loaders. The ComfyUI complete guide provides the broader graph concepts needed to compare them without losing track of which components changed.

What should you check before using Qwen-Image GGUF?

What does Qwen-Image GGUF quantize?

The city96 Qwen-Image GGUF repository provides a direct conversion of Qwen's image model, whose underlying architecture is 20B. The conversion changes weight representation, and the pipeline still needs a separately loaded text encoder and VAE. Conversion card Qwen repository

Which ComfyUI loader supports Qwen-Image GGUF?

The published Qwen-Image GGUF workflow uses ComfyUI-GGUF's UnetLoaderGGUF for the image transformer. Install that integration, import the supplied graph, and select the converted file in the GGUF loader. Conversion card Example workflow

Does Qwen-Image GGUF need a text encoder and VAE?

Qwen-Image GGUF requires a Qwen2.5-VL-7B text encoder and Qwen-Image VAE alongside the converted image model. The city96 model card links standard and GGUF encoder options and provides a separate VAE download. Conversion card

Which Qwen-Image GGUF quantization should I choose?

Compare Qwen-Image GGUF files on the prompts, image dimensions, and hardware you intend to use. The publisher labels its displayed output as a single sample, so evaluate spelling, detail, speed, and complete-pipeline memory use before choosing a quantization. Conversion card

Sources

• city96 Qwen-Image GGUF model card
• ComfyUI-GGUF installation and usage
• city96 Qwen-Image GGUF example workflow
• Qwen-Image model card
• Qwen-Image official repository and release history
• ComfyUI official Qwen-Image workflow guide
• Nunchaku Qwen-Image model card

Related guides on PromptZone

• Local LLMs 2026: Run Llama, Mistral, Qwen on Your Hardware