VISION & LEARNING FOR AUTONOMOUS AI LAB


2024


TFS-NeRF: Template-Free NeRF for Semantic 3D Reconstruction of Dynamic Scene

Sandika Biswas, Qianyi Wu, Biplab Banerjee, Hamid Rezatofighi

Advances in Neural Information Processing Systems (NeurIPS), 2024


Hi-SLAM: Scaling-up Semantics in SLAM with a Hierarchically Categorical Gaussian Splatting

Boying Li, Zhixi Cai, Yuan-Fang Li, Ian Reid, Hamid Rezatofighi

Arxiv, 2024


NEUSIS: A Compositional Neuro-Symbolic Framework for Autonomous Perception, Reasoning, and Planning in Complex UAV Search Missions

Zhixi Cai, Cristian Rojas Cardenas, Kevin Leo, Chenyuan Zhang, Kal Backman, Hanbing Li, Boying Li, Mahsa Ghorbanali, Stavya Datta, Lizhen Qu, Julian Gutierrez Santiago, Alexey Ignatiev, Yuan-Fang Li, Mor Vered, Peter J Stuckey, Maria Garcia de la Banda, Hamid Rezatofighi

Arxiv, 2024


HYDRA: A Hyper Agent for Dynamic Compositional Visual Reasoning

Fucai Ke, Zhixi Cai, Simindokht Jahangard, Weiqing Wang, Pari Delir Haghighi, Hamid Rezatofighi

European Conference On Computer Vision (ECCV), 2024


DifFUSER: Diffusion Model for Robust Multi-Sensor Fusion in 3D Object Detection and BEV Segmentation

Duy-Tho Le, Hengcan Shi, Jianfei Cai, Hamid Rezatofighi

European Conference On Computer Vision (ECCV), 2024


Multi-objective multi-agent planning for discovering and tracking multiple mobile objects

Hoa Van Nguyen, Ba-Ngu Vo, Ba-Tuong Vo, Hamid Rezatofighi, Damith C Ranasinghe

IEEE Transactions on Signal Processing, 2024


DrVideo: Document Retrieval Based Long Video Understanding

Ziyu Ma, Chenhui Gou, Hengcan Shi, Bin Sun, Shutao Li, Hamid Rezatofighi, Jianfei Cai

arxiv, 2024


JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups

Simindokht Jahangard, Zhixi Cai, Shiki Wen, Hamid Rezatofighi

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024


JRDB-PanoTrack: An Open-world Panoptic Segmentation and Tracking Robotic Dataset in Crowded Human Environments

Duy-Tho Le, Chenhui Gou, Stavya Datta, Hengcan Shi, Ian Reid, Jianfei Cai, Hamid Rezatofighi

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024


Series2Vec: Similarity-based Self-supervised Representation Learning for Time Series Classification

Navid Mohammadi Foumani, Chang Wei Tan, Geoffrey I Webb, Hamid Rezatofighi, Mahsa Salehi

Data Mining and Knowledge Discovery, 2023


Social-MAE: Social Masked Autoencoder for Multi-person Motion Representation Learning

Mahsa Ehsanpour, Ian Reid, Hamid Rezatofighi

arxiv, 2024


Improving Visual Perception of a Social Robot for Controlled and In-the-wild Human-robot Interaction

Wangjie Zhong, Leimin Tian, Duy Tho Le, Hamid Rezatofighi

ACM/IEEE International Conference on Human-Robot Interaction (HRI24)


2023


ConservationBots: Autonomous Aerial Robot for Fast Robust Wildlife Tracking in Complex Terrains

Fei Chen, Hoa Van Nguyen, David A. Taggart, Katrina Falkner, S. Hamid Rezatofighi, Damith C. Ranasinghe

Journal of Field Robotics, 2023


Reply to: Artificial intelligence as a door opener for a new era of human reproduction

F Horta, M Salih, C Austin, R Warty, V Smith, DL Rolnik, S Reddy, H Rezatofighi, B Vollenhoven

Human Reproduction Open, 2023


Unifying Flow, Stereo and Depth Estimation

Haofei Xu, Jing Zhang, Jianfei Cai, Hamid Rezatofighi, Fisher Yu, Dacheng Tao, Andreas Geiger

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023


JRDB-Traj: A Dataset and Benchmark for Trajectory Forecasting in Crowds

Saeed Saadatnejad, Yang Gao, Hamid Rezatofighi, Alexandre Alahi

arXiv preprint arXiv:2311.02736, 2023


Energy-based Self-Training and Normalization for Unsupervised Domain Adaptation

Samitha Herath, Basura Fernando, Ehsan Abbasnejad, Munawar Hayat, Shahram Khadivi, Mehrtash Harandi, Hamid Rezatofighi, Gholamreza Haffari

IEEE/CVF International Conference on Computer Vision, 2023


Physically Plausible 3D Human-Scene Reconstruction from Monocular RGB Image using an Adversarial Learning Approach

Sandika Biswas, Kejie Li, Biplab Banerjee, Subhasis Chaudhuri, Hamid Rezatofighi

IEEE Robotics and Automation Letters (RA-L), 2023


Exploring the utility of artificial intelligence of intrapartum cardiotocography: a systematic review

Mohamed Salih, Ritesh Rikain Warty, Hamsaveni Kalina Murday, Arjun Kaushik, Yuxin Zhang, Fabrizzio Horta, Sandeep Reddy, Beverley Vollenhoven, Hamid Rezatofighi, Wenlong Cheng, Vinayak Smith

Research Square, 2023


Real-time Trajectory-based Social Group Detection

Simindokht Jahangard, Munawar Hayat, Hamid Rezatofighi

International Conference on Intelligent Robots and Systems (IROS), 2023


Tracking Different Ant Species: An Unsupervised Domain Adaptation Framework and a Dataset for Multi-object Tracking

Chamath Abeysinghe, Chris Reid, Hamid Rezatofighi, Bernd Meyer

International Joint Conference on Artificial Intelligence (IJCAI), 2023


Embryo selection through artificial intelligence versus embryologists: a systematic review

M. Salih, C. Austin, R.R. Warty, C. Tiktin, D.L. Rolnik, M. Momeni, H. Rezatofighi, S. Reddy, V. Smith, B. Vollenhoven, F. Horta

Human Reproduction Open, 2023


JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Tracking

Edward Vendrow, Duy Tho Le, Jianfei Cai, Hamid Rezatofighi

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023


Knowledge Combination to Learn Rotated Detection Without Rotated Annotation

Tianyu Zhu, Bryce Ferenczi, Pulak Purkait, Tom Drummond, Hamid Rezatofighi, Anton van den Hengel

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023


ProtoCon: Pseudo-label Refinement via Online Clustering and Prototypical Consistency for Efficient Semi-supervised Learning

Islam Nassar, Munawar Hayat, Ehsan Abbasnejad, Hamid Rezatofighi, Gholamreza Haffari

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023

Spotlight Presentation (2.5% of submissions)


MARLIN: Masked Autoencoder for facial video Representation LearnINg

Zhixi Cai, Shreya Ghosh, Kalin Stefanov, Abhinav Dhall, Jianfei Cai, Hamid Rezatofighi, Reza Haffari, Munawar Hayat

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023


Accurate and Real-time 3D Pedestrian Detection Using an Efficient Attentive Pillar Network

Duy Tho Le, Hengcan Shi, Hamid Rezatofighi, Jianfei Cai

IEEE Robotics and Automation Letters (RA-L), 2023


How trustworthy are the existing performance evaluations for basic vision tasks?

Hamid Rezatofighi*, Tran Thien Dat Nguyen*, Ba-Ngu Vo, Ba-Tuong Vo, Silvio Savarese, Ian Reid

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2023


LAVA: Label-efficient Visual Learning and Adaptation

I Nassar, M Hayat, E Abbasnejad, H Rezatofighi, M Harandi, G Haffari

IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023


2022


Looking Beyond Two Frames: End-to-End Multi-Object Tracking Using Spatial and Temporal Transformers

Tianyu Zhu, Markus Hiller, Mahsa Ehsanpour, Rongkai Ma, Tom Drummond, Ian Reid, Hamid Rezatofighi

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022


Predicting Topological Maps for Visual Navigation in Unexplored Environments

H Zhan, H Rezatofighi, I Reid

arXiv preprint arXiv:2211.12649, 2022


ActiveRMAP: Radiance Field for Active Mapping And Planning

H Zhan, J Zheng, Y Xu, I Reid, H Rezatofighi

arXiv preprint arXiv:2211.12656, 2022



SoMoFormer: Multi-Person Pose Forecasting with Transformers

Edward Vendrow, Satyajit Kumar, Ehsan Adeli, Hamid Rezatofighi

arXiv preprint arXiv:2208.14023, 2022


JRDB-Act: A Large-scale Multi-modal Dataset for Spatio-temporal Action, Social Group and Activity Detection

Mahsa Ehsanpour, Fatemeh Saleh, Silvio Savarese, Ian Reid, Hamid Rezatofighi

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022


GMFlow: Learning Optical Flow via Global Matching

Haofei Xu, Jing Zhang, Jianfei Cai, Hamid Rezatofighi, Dacheng Tao

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022

Oral Presentation


Learning of Global Objective for Network Flow in Multi-Object Tracking

Shuai Li, Yu Kong, Hamid Rezatofighi

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022


Multi-Objective Multi-Agent Planning for Discovering and Tracking Unknown and Varying Number of Mobile Objects

Hoa Van Nguyen, Ba-Ngu Vo, Ba-Tuong Vo, Hamid Rezatofighi, Damith C Ranasinghe

arXiv preprint arXiv:2203.04551, 2022


2021


Learn to predict sets using feed-forward neural networks

Hamid Rezatofighi, Tianyu Zhu, Roman Kaskman, Farbod T Motlagh, Qinfeng Shi, Anton Milan, Daniel Cremers, Laura Leal-Taixé, Ian Reid

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021


Guided-GAN: Adversarial Representation Learning for Activity Recognition with Wearables

Alireza Abedin, Hamid Rezatofighi, Damith C. Ranasinghe

arXiv preprint arXiv:2110.05732, 2021


ODAM: Object Detection, Association, and Mapping using Posed RGB Video

Kejie Li, Daniel DeTone, Steven Chen, Minh Vo, Ian Reid, Hamid Rezatofighi, Chris Sweeney, Julian Straub, Richard Newcombe

IEEE international conference on computer vision (ICCV), 2021

Oral Presentation


TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild

Vida Adeli, Mahsa Ehsanpour, Ian Reid, Juan Carlos Niebles, Silvio Savarese, Ehsan Adeli, Hamid Rezatofighi

IEEE international conference on computer vision (ICCV), 2021


Distributed Multi-object Tracking under Limited Field of View Sensors

Hoa Van Nguyen, Hamid Rezatofighi, Ba-Ngu Vo, Damith C Ranasinghe

IEEE Transactions on Signal Processing (TSP), 2021


Unsupervised Image Segmentation by Mutual Information Maximization and Adversarial Regularization

S. Ehsan Mirsadeghi, Ali Royat, Hamid Rezatofighi

IEEE Robotics and Automation Letters (RA-L) & International Conference on Intelligent Robots and Systems (IROS), 2021


JRDB: A Dataset and Benchmark of Egocentric Robot Visual Perception of Humans in Built Environments

Roberto Martín-Martín*, Mihir Patel*, Hamid Rezatofighi*, Abhijeet Shenoi, JunYoung Gwak, Eric Frankel, Amir Sadeghian, Silvio Savarese

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021


Probabilistic Tracklet Scoring and Inpainting for Multiple Object Tracking

Fatemeh Saleh, Sadegh Aliakbarian, Hamid Rezatofighi, Mathieu Salzmann, Stephen Gould

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021

Oral Presentation


Attend And Discriminate: Beyond the State-of-the-Art for Human Activity Recognition using Wearable Sensors

Alireza Abedin, Mahsa Ehsanpour, Qinfeng Shi, Hamid Rezatofighi, Damith C Ranasinghe

The Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2021


MO-LTR: Multiple Object Localization, Tracking, and Reconstruction from Monocular RGB Videos

Kejie Li, Hamid Rezatofighi, Ian Reid

IEEE Robotics and Automation Letters (RA-L) & International Conference on Robotics and Automation (ICRA), 2021


2020


Towards Deep Clustering of Human Activities from Wearables

Alireza Abedin, Farbod Motlagh, Qinfeng Shi, S. Hamid Rezatofighi, Damith C. Ranasinghe

The ACM international joint conference on pervasive and ubiquitous computing (UBICOMP/ISWC), 2020


Joint learning of Social Groups, Individuals Action and Sub-group Activities in Videos

Mahsa Ehsanpour, Alireza Abedin, Fatemeh Saleh, Javen Shi, Ian Reid, Hamid Rezatofighi

European Conference On Computer Vision (ECCV), 2020


Socially and contextually aware human motion and pose forecasting

Vida Adeli, Ehsan Adeli, Ian Reid, Juan Carlos Niebles, Hamid Rezatofighi

IEEE Robotics and Automation Letters (RA-L) & International Conference on Intelligent Robots and Systems (IROS), 2020


LAVAPilot: Lightweight UAV Trajectory Planner with Situational Awareness for Embedded Autonomy to Track and Locate Radio-tags

Hoa Van Nguyen, Fei Chen, Joshua Chesser, Hamid Rezatofighi, Damith Ranasinghe

International Conference on Intelligent Robots and Systems (IROS), 2020


JRMOT: A Real-Time 3D Multi-Object Tracker and a New Large-Scale Dataset

Abhijeet Shenoi, Mihir Patel, JunYoung Gwak, Patrick Goebel, Amir Sadeghian, Hamid Rezatofighi, Roberto Martín-Martín, Silvio Savarese

International Conference on Intelligent Robots and Systems (IROS), 2020


Meta Learning with Differentiable Closed-form Solver for Fast Video Object Segmentation

Yu Liu, Lingqiao Liu, Haokui Zhang, Hamid Rezatofighi, Ian Reid

International Conference on Intelligent Robots and Systems (IROS), 2020


Mot20: A benchmark for multi object tracking in crowded scenes

Patrick Dendorfer, Hamid Rezatofighi, Anton Milan, Javen Shi, Daniel Cremers, Ian Reid, Stefan Roth, Konrad Schindler, Laura Leal-Taixé

arXiv preprint arXiv:2008.03533, 2020


Multi-Objective Multi-Agent Planning for Jointly Discovering and Tracking Mobile Object

Hoa Van Nguyen, Hamid Rezatofighi, Ba-Ngu Vo, Damith C. Ranasinghe

Thirty-Forth AAAI Conference on Artificial Intelligence (AAAI), 2020


2019


Approximating the Permanent by Sampling from Adaptive Partitions

Jonathan Kuck, Tri Dao, Hamid Rezatofighi, Ashish Sabharwal, Stefano Ermon

Advances in Neural Information Processing Systems (NeurIPS), 2019


Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networks

Vineet Kosaraju, Amir Sadeghian, Roberto Martín-Martín, Ian Reid, S Hamid Rezatofighi, Silvio Savarese

Advances in Neural Information Processing Systems (NeurIPS), 2019


Online UAV path planning for joint detection and tracking of multiple radio-tagged objects

Hoa Van Nguyen, Hamid Rezatofighi, Ba-Ngu Vo, Damith C. Ranasinghe

IEEE Transactions on Signal Processing (TSP), 2019


SparseSense: Human Activity Recognition from Highly Sparse Sensor Data-streams Using Set-based Neural Networks

Alireza Abedin, S Hamid Rezatofighi, Qinfeng Shi, Damith C. Ranasinghe

International Joint Conference on Artificial Intelligence (IJCAI), 2019


Model-Free Tracker for Multiple Objects Using Joint Appearance and Motion Inference

Chongyu Liu, Rui Yao, S. Hamid Rezatofighi, Ian Reid, Qinfeng Shi

IEEE Transactions on Image Processing (TIP), 2019


TrackerBots - Autonomous unmanned aerial vehicle for real-time localization and tracking of multiple radio-tagged

Hoa Van Nguyen, Michael Chesser, Lian Pin Koh, Hamid Rezatofighi, Damith C. Ranasinghe

Journal of Field Robotics (JoFR), 2019


Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regression

Hamid Rezatofighi, Nathan Tsoi, JunYoung Gwak, Amir Sadeghian, Ian Reid, Silvio Savarese

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019

The top 7 highly cited CVPR 2019 paper. (Source: Google Scholar/Metrics)


TopNet: Structural Point Cloud Decoder

Lyne P. Tchapmi, Vineet Kosaraju, Hamid Rezatofighi, Ian Reid, Silvio Savarese

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019


SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints

Amir Sadeghian, Vineet Kosaraju, Ali Sadeghian, Noriaki Hirose, Hamid Rezatofighi, Silvio Savarese

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019


2015-2018


Deep Auto-Set: A Deep Auto-Encoder-Set Network for Activity Recognition Using Wearables

Alireza Abedin Varamin, Ehsan Abbasnejad, Qinfeng Shi, Damith C. Ranasinghe, Hamid Rezatofighi

EAI International Conference on Mobile and Ubiquitous Systems. Computing, Networking and Services, 2018


Autonomous UAV sensor system for searching and locating VHF radio-tagged wildlife

Hoa Van Nguyen, Michael Chesser, Fei Chen, S Hamid Rezatofighi, Damith C. Ranasinghe

ACM Conference on Embedded Networked Sensor Systems, 2018


Deep perm-set net: Learn to predict sets with unknown permutation and cardinality using deep neural networks

S Hamid Rezatofighi, Roman Kaskman, Farbod T Motlagh, Qinfeng Shi, Daniel Cremers, Laura Leal-Taixé, Ian Reid

arXiv preprint arXiv:1805.00613, 2018


Joint Learning of Set Cardinality and State Distribution

S Hamid Rezatofighi, Anton Milan, Qinfeng Shi, Anthony Dick, Ian Reid

Thirty-Second AAAI Conference on Artificial Intelligence (AAAI), 2018


Data-driven approximations to NP-hard problems

Anton Milan, S. Hamid Rezatofighi, Ravi Garg, Anthony Dick, Ian Reid

Thirty-First AAAI Conference on Artificial Intelligence (AAAI), 2017

Oral Presentation


Multi-object model-free tracking with joint appearance and motion inference

Chongyu Liu, Rui Yao, S. Hamid Rezatofighi, Ian Reid, Qinfeng Shi

International Conference on Digital Image Computing. Techniques and Applications (DICTA), 2017


DeepSetNet: Predicting Sets With Deep Neural Networks

S. Hamid Rezatofighi, BG Kumar, Anton Milan, Ehsan Abbasnejad, Anthony Dick, Ian Reid

IEEE International Conference on Computer Vision (ICCV), 2017

Spotlight Presentation


Online multi-target tracking using recurrent neural networks

Anton Milan, S. Hamid Rezatofighi, Anthony Dick, Ian Reid, Konrad Schindler

Thirty-First AAAI Conference on Artificial Intelligence (AAAI), 2017

One of the most influential AAAI papers in 2017


Joint probabilistic matching using m-best solutions

S. Hamid Rezatofighi, Anton Milan, Zhen Zhang, Qinfeng Shi, Anthony Dick, Ian Reid

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016

Oral Presentation


Efficient point process inference for large-scale object detection

Trung T. Pham, S. Hamid Rezatofighi, Ian Reid, Tat-Jun Chin

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016


Multi-target tracking with time-varying clutter rate and detection profile. Application to time-lapse cell microscopy sequences

S. Hamid Rezatofighi, Stephen Gould, Ba Tuong Vo, Ba-Ngu Vo, Katarina Mele, Richard Hartley

IEEE Transactions on Medical Imaging (TMI), 2015


Joint probabilistic data association revisited

S. Hamid Rezatofighi, Anton Milan, Zhen Zhang, Qinfeng Shi, Anthony Dick, Ian Reid

IEEE international conference on computer vision (ICCV), 2015

Between the top 150 ICCV papers in 2015-2020 (Source: Google Scholar/Metrics)