WorldGuide: Goal-Directed Video World Model for Procedural Task Execution

Ankan Deria, Komal Kumar, Hisham Cholakkal, Fahad Shahbaz Khan, Salman Khan

Mohamed bin Zayed University of Artificial Intelligence

Official checkpoints for WorldGuide. Method details, results and training code are on the project page and on GitHub.

Checkpoints

WorldGuide-Ckpt/
├── transformer/          # WorldGuide Video DiT        → --action_ckpt
└── text_encoder/llm/     # WorldGuide ContextPlanner   → --planner_model_path

Usage

git clone https://github.com/mbzuai-oryx/WorldGuide.git
cd WorldGuide
pip install -r requirements.txt

# Download this repository and all other required components into ./ckpts
python download_models.py --hf_token <your_hf_token>

# Run closed-loop inference
bash scripts/inference/run_v5_qwen_closed_loop_memory.sh

Citation

@article{deria2026worldguide,
  title={WorldGuide: Goal-Directed Video World Model for Procedural Task Execution},
  author={Deria, Ankan and Kumar, Komal and Cholakkal, Hisham and Khan, Fahad Shahbaz and Khan, Salman},
  journal={arXiv preprint arXiv:2610.12459},
  year={2026}
}