PAN 2
An open-source world model from MBZUAI IFM with a dual-core architecture combining an LLM planner and a 29B diffusion Transformer generator. It predicts the consequences of actions in video form, supports a rollout window of approximately 20 seconds, and is released under the Apache 2.0 license.
Timeline (last 90 days)
The MBZUAI Institute of Foundation Models (IFM) has open-sourced the PAN 2 world model.
The generator component of PAN 2 is a 29B-parameter diffusion Transformer.
PAN 2 adopts a cascaded structure: an LLM-based planner decomposes a task into an action sequence, and the diffusion generator then renders the action sequence into future frames in video form.
PAN 2 can simulate action outcomes of up to about 20 seconds.
PAN 2 is open-sourced under the Apache 2.0 license.
A 20-second rollout window is sufficient to cover the complete closed loop of common manipulation tasks such as grasping, moving and placing.
The two-stage structure of PAN 2 introduces the risk of cascading error: planner deviations will cause the generator to roll out the future of an incorrect action sequence, and video rollout itself may introduce physical inconsistencies.
Choosing Apache 2.0 rather than a research-only license indicates that IFM hopes PAN 2 will enter commercial and engineering practice.
All Facts (8)
Choosing Apache 2.0 rather than a research-only license indicates that IFM hopes PAN 2 will enter commercial and engineering practice.
50%UnverifiedThe generator component of PAN 2 is a 29B-parameter diffusion Transformer.
50%UnverifiedPAN 2 adopts a cascaded structure: an LLM-based planner decomposes a task into an action sequence, and the diffusion generator then renders the action sequence into future frames in video form.
50%UnverifiedPAN 2 can simulate action outcomes of up to about 20 seconds.
50%UnverifiedPAN 2 is open-sourced under the Apache 2.0 license.
50%UnverifiedA 20-second rollout window is sufficient to cover the complete closed loop of common manipulation tasks such as grasping, moving and placing.
50%UnverifiedThe two-stage structure of PAN 2 introduces the risk of cascading error: planner deviations will cause the generator to roll out the future of an incorrect action sequence, and video rollout itself may introduce physical inconsistencies.
50%UnverifiedThe MBZUAI Institute of Foundation Models (IFM) has open-sourced the PAN 2 world model.
50%