Lumina-Image 2.0 is Alpha-VLLM's text-to-image model built around a flow-based diffusion transformer. Its weights and inference code are available through Hugging Face and GitHub; use the documented Lumina2Pipeline to generate a local baseline. Model card Repository
Its practical appeal is a reproducible local experiment: download a known checkpoint, run a documented pipeline, and retain the settings with the output.
What are the key facts about Lumina-Image 2.0?
| Field | Verified detail |
|---|---|
| Developer | Alpha-VLLM; the repository lists collaborating universities and Shanghai AI Laboratory. Repository |
| Released | January 25, 2025, according to the release log. Repository |
| Type | Flow-based diffusion transformer for text-to-image generation. Card |
| Size or parameters | The model card says 2B; the repository's model-zoo table lists 2.6B. Card Repository |
| License and access | Apache-2.0 for the published model/repository; the Gemma dependency has its own access requirements. Card Repository |
| Where it runs | Local Diffusers and ComfyUI workflows; an official demo is also linked. Diffusers ComfyUI package |
The published parameter descriptions differ. Keep that discrepancy visible instead of turning either figure into a claim about total runtime memory. Record the actual checkpoint and component versions used in your experiment.
How does Lumina-Image 2.0 process text and image tokens?
Lumina's release includes inference and fine-tuning code. The repository also identifies a Gemma text encoder and a separate VAE, making the pipeline's major components inspectable. Repository
The Diffusers documentation describes joint processing of text and image tokens and a captioning approach intended to improve semantic alignment. These are research design choices, not guarantees that every prompt will succeed. Diffusers
For evaluation, write prompts with checkable relationships: an object beside another object, a named material, or a specific lighting direction. Compare each output with those requirements before judging its overall appearance.
A landscape can look convincing while placing the sun on the wrong side. A product scene can have attractive lighting while changing the requested material. Separate those failures in your notes.
The published Diffusers pipeline gives you a practical baseline for that process. Preserve the initial settings until you can generate and save an image successfully, then explore one change at a time. Model example
For installation-focused reading, see the sibling Lumina download guide. This page concentrates on understanding the architecture and establishing a comparison baseline.
What affects Lumina-Image 2.0 memory use and model loading?
A parameter count is not a full hardware requirement. The published pipeline includes a transformer, text encoder, and VAE; plan around the whole workflow rather than the headline model size. Pipeline documentation
The model card demonstrates CPU offloading to reduce GPU-memory pressure. That is a supported option, but the example does not establish a universal minimum GPU or a fixed generation time. Model card
Do not assume every file in the model repository uses the same loader. The original repository supports its checkpoint format, while Diffusers documents its pipeline and transformer-loading interfaces. Repository Diffusers
Also separate base generation from additional research projects. The release log links further work for editing and controllable generation; those capabilities should not be assumed from a basic text-to-image call. Repository
Before adopting an optimization, save a baseline output and its settings. Compare the optimized result with the original using the same subject and acceptance criteria, including any detail that matters to the final asset.
How do you run a Lumina-Image 2.0 baseline locally?
- Prepare a Python environment with PyTorch and the dependencies required by Diffusers.
- Install or update
diffusers,transformers, andaccelerate, as shown on the model page. Card - Load
Alpha-VLLM/Lumina-Image-2.0withLumina2Pipeline. - Generate a baseline image and save it alongside the prompt.
The following adapts the official model-card example with an original prompt. Its settings are an example configuration, not a speed or memory guarantee. Card
import torch
from diffusers import Lumina2Pipeline
pipe = Lumina2Pipeline.from_pretrained(
"Alpha-VLLM/Lumina-Image-2.0",
torch_dtype=torch.bfloat16,
)
pipe.enable_model_cpu_offload()
image = pipe(
"A glass vase beside a folded linen cloth, soft side lighting",
height=1024, width=1024,
guidance_scale=4.0, num_inference_steps=50,
cfg_trunc_ratio=0.25, cfg_normalization=True,
generator=torch.Generator("cpu").manual_seed(0),
).images[0]
image.save("lumina-baseline.png")
Run this in a suitable PyTorch environment after the model dependencies are available. Separate download and setup time from generation time when recording your first result.
If a run fails, first identify its stage: dependency installation, model download, loading, sampling, or saving. Changing the prompt is unlikely to help with an installation or file-loading problem.
For ComfyUI, Comfy-Org publishes repackaged files and folder locations. Its card distinguishes a combined checkpoint from separate diffusion-model, text-encoder, and VAE files. ComfyUI package
The official example page provides a workflow image you can load in ComfyUI. Follow that workflow's component layout instead of combining loader instructions from unrelated model families. Workflow example
Use the ComfyUI pillar for the surrounding workflow concepts. Keep the Lumina-specific filenames and loader choices anchored to the official example.
Once the baseline works, create a small review sheet with the prompt, seed, dimensions, steps, and output filename. Add a plain-language note about what the image got right and what needs another attempt.
How does Lumina-Image 2.0 differ from Janus-Pro?
Janus-Pro is a useful architectural contrast. Its model card describes a unified autoregressive system for image understanding and generation; Lumina's standard pipeline is focused on text-to-image diffusion. Janus-Pro card
| Requirement | Relevant starting point |
|---|---|
| A local text-to-image diffusion experiment | Lumina-Image 2.0 |
| Image questions and image generation in one model family | Janus-Pro |
| Inspecting a graphical image-generation pipeline | Lumina's documented ComfyUI example |
This distinction concerns workflow and task coverage. It does not establish which model produces a better image for your prompt, so use matched briefs if comparing visual results.
What else should you know about Lumina-Image 2.0?
Who developed Lumina-Image 2.0?
Lumina-Image 2.0 is an Alpha-VLLM research release. The repository credits collaborating academic institutions and Shanghai AI Laboratory. Repository
Is Lumina-Image 2.0 a 2B or 2.6B model?
Lumina-Image 2.0 is described as 2B in its model card and 2.6B in its repository table. Identify which source you are using rather than presenting an unexplained total. Card Repository
Can I run it in ComfyUI?
Lumina-Image 2.0 runs in ComfyUI using the files published by Comfy-Org. The separate ComfyUI examples page provides a loadable workflow image; follow its loader arrangement and the model card's file placement. ComfyUI package Workflow
Is its release date the technical-report date?
Lumina-Image 2.0's repository records its model release on January 25, 2025 and a later technical-report announcement. Use the model release entry when dating availability of the original release. Repository
Sources
- Alpha-VLLM model card
- Alpha-VLLM project repository
- Diffusers Lumina2 documentation
- Comfy-Org repackaged model
- Official ComfyUI Lumina example
- DeepSeek Janus-Pro model card
Top comments (0)