Paper

The RoboDrive Challenge: Drive Anytime Anywhere in Any Condition

Wang, Tiancai, Zhang, Hui, Shang, Wentao, Li, Ming, Ma, Yuexin, Lu, Hao, Chu, Cunxi, Wang, Hongming, Zhang, Jing, Tian, Yubo, Kang, Caixin, Li, Shilong, Dong, Yinpeng, Zhang, Bingyang, Huang, Xingliang, Wei Tsang Ooi, Qin, Zihan, Wang, Ziyan, Fan, Jia, Ren, Yi, Xie, Shaoyuan, Chen, Hai, Fu, Dongyi, Liu, Fangsheng, Niu, Yaru, Wang, Yubo, Xiaoshuai Hao, Kong, Lingdong, Cottereau, Benoit R, Liu, Xianming, Jiang, Junjun, Ding, Dianlei, Liu, Wentao, Hu, Hanjiang, Ying-Cong, Chen, Lin, Yongchun, Luo, Lun, Sun, Jianhang, Chen, Peng, Yang, Bo, Kou, Genghua, Mao, Yifan, Luo, Yadan, Chengyang Ying, Mengchuan Wei, Wang, Lizhong, Cao, Xu, Pan, Liang, Zuo, Yiwei, Li, Haiwen, Zhou, Bin, Cao, Zhe, Xu, Jialei, Yuan, Chendong, Li, Jinke, Zhao, Lirong, Tian, Yu, Liu, Wenjie, Yang, Xiao, Cheng, Xiaoqiang, Liu, Jian, Ma, Zeliang, Zhang, Chi, Liu, Ziwei, Yang, Songyue, Wu, Xun, Xu, Yong, Wei, Xingxing, Zhang, Wei, Yang, Huitong, Ye, Nanfei, Zhao, Wenbo, Liu, Yingfei, Zhao, Haimei, Ji, Dengyi, Li, Yunfan, Li, Chiwei, Li, Ying, Qiu, Weichao, Li, Haoang, Zhang, Wenwei, Yang, Yifan, Jiang, Shengyin, Chen, Kai, Zhou, Xinning, Zhou, Yi, Cheng, Xianjing, Yan, Yixiang, Liu, Jiayang, He, X

2024

Overview

In the realm of autonomous driving, robust perception under out-of-distribution conditions is paramount for the safe deployment of vehicles. Challenges such as adverse weather, sensor malfunctions, and environmental unpredictability can severely impact the performance of autonomous systems. The 2024 RoboDrive Challenge was crafted to propel the development of driving perception technologies that can withstand and adapt to these real-world variabilities. Focusing on four pivotal tasks -- BEV detection, map segmentation, semantic occupancy prediction, and multi-view depth estimation -- the competition laid down a gauntlet to innovate and enhance system resilience against typical and atypical disturbances. This year's challenge consisted of five distinct tracks and attracted 140 registered teams from 93 institutes across 11 countries, resulting in nearly one thousand submissions evaluated through our servers. The competition culminated in 15 top-performing solutions, which introduced a range of innovative approaches including advanced data augmentation, multi-sensor fusion, self-supervised learning for error correction, and new algorithmic strategies to enhance sensor robustness. These contributions significantly advanced the state of the art, particularly in handling sensor inconsistencies and environmental variability. Participants, through collaborative efforts, pushed the boundaries of current technologies, showcasing their potential in real-world scenarios. Extensive evaluations and analyses provided insights into the effectiveness of these solutions, highlighting key trends and successful strategies for improving the resilience of driving perception systems. This challenge has set a new benchmark in the field, providing a rich repository of techniques expected to guide future research in this field.

• Publisher: Cornell University Library, arXiv.org
• Subject: Data augmentation / Error correction / Machine learning / Multisensor fusion / Perception / Resilience / Self-supervised learning / Sensors