Research2026-09-29

Researchers introduced PixelUMM, a model for image and video understanding and generation. It works directly in pixel space without a separate visual encoder. Images are represented as spatial patches and videos as spatiotemporal tubelets. A Mixture-of-Transformers architecture supports both understanding and generation tasks. The model jointly handles text prediction and pixel-space flow matching. Experiments show competitive performance across image and video tasks. The paper studies decoder design and spatial-temporal patch size choices. A project page accompanies the work.

What it unlocks

Building a single model that handles both image and video tasks without a separate visual encoder.

Sources

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.