European Conference On Computer Vision (ECCV), 2024
Vision & Language for
Autonomous AI
Advancing theoretical foundations and practical applications of computer vision and natural language processing for embodied systems.
About VL4AI Research
Towards Intelligent Embodied AI
VL4AI advances intelligent embodied AI for real-world robotic and autonomous systems. We study how multi-sensor and multimodal models can perceive, understand, reason, and act in complex dynamic environments, with a strong emphasis on interpretable, trustworthy, auditable, and safe embodied intelligence.
- Multimodal and multi-sensor perception, including 2D vision, 3D vision, sensor fusion, and embodied scene understanding.
- 3D reconstruction, semantic mapping, and world modelling for dynamic embodied environments.
- Compositional and neuro-symbolic reasoning for visual grounding, multimodal understanding, and decision making.
- Agentic embodied systems for planning, navigation, search, tracking, and mission-level autonomy.
Our goal is to build embodied AI systems that do more than perceive the world: they can reason over it, act within it, and support reliable real-world deployment through interpretable, trustworthy, and safe intelligence.
Research highlight
2D Visual Perception
Impact
Seminal Works
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
Unifying Flow, Stereo and Depth Estimation
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
GMFlow: Learning Optical Flow via Global Matching
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
JRDB: A Dataset and Benchmark of Egocentric Robot Visual Perception of Humans in Built Environments
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regression
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints
Advances in Neural Information Processing Systems (NeurIPS), 2019
Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networks
Thirty-First AAAI Conference on Artificial Intelligence (AAAI), 2017
Online multi-target tracking using recurrent neural networks
IEEE international conference on computer vision (ICCV), 2015
Joint probabilistic data association revisited
Updates
Latest Publications
VIEW2SPACE: Studying Multi-View Visual Reasoning from Sparse Observations
European Conference On Computer Vision (ECCV), 2026
Sample-Efficient Learning from Agent Experience
Arxiv, 2026
What We Talk About When We Talk About LLM Planning: Evidence for Two Distinct Planning Abilities
Arxiv, 2026
PING: A Physics-Informed Neuro-Symbolic Generator for Continuous-Time Planning
International Conference on Automated Planning and Scheduling (ICAPS), 2026
VQ-VA World: Towards High-Quality Visual Question-Visual Answering
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026
An Empirical Study on How Video-LLMs Answer Video Questions
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026