background pattern

Physics-Guided Vision-Language World Models for Agentic 4D Scene Understanding

This project develops a unified framework for physically grounded world modelling that combines video-based temporal prediction with Gaussian Splatting for photorealistic 3D representation. A Physics Vision-Language Model translates natural-language instructions into transformations that respect physical constraints, enabling interpretable and goal-directed control in dynamic scenes. By integrating perception, prediction, and action in a Vision-Language-Action loop, the research aims to advance agentic AI systems capable of transparent, physics-aware reasoning—supporting applications in robotics, simulation, and education.

People

Portrait of Emanuele Aiello

Emanuele Aiello

Researcher

Portrait of Benjamin  Busam

Benjamin Busam

Professor

Technische Universität München

Portrait of Hyunjun Jung

Hyunjun Jung

Post Doctoral Researcher

Technische Universität München

Portrait of Mert  Kiray

Mert Kiray

PhD Student

Technische Universität München

Portrait of Sarah Parisot

Sarah Parisot

Principal Researcher

Portrait of Sergio Valcarcel Macua

Sergio Valcarcel Macua

Senior Research Scientist

Portrait of Dani Velikova

Dani Velikova

Post Doctoral Researcher

Technische Universität München