Loading Events

« All Events

Virtual Event Virtual Event
  • This event has passed.

Webinar: Collaborative and Adversarial 3D Perception for Autonomous Driving

May 19 @ 12:00 pm - 1:00 pm

Virtual Event Virtual Event

Robust and reliable perception systems serve as the “eyes” of autonomous vehicles. LiDAR is a widely applied perception sensor in autonomous vehicles for capturing 3D geometry information of the environment. However, LiDAR-based perception faces many challenges such as data sparsity, occlusions, and motion distortion. In this talk, I will show how we design novel 3D deep learning algorithms from two aspects, collaborative and adversarial, in order to improve the robustness of LiDAR-based 3D perception. For effective and efficient collaborative perception, we propose DiscoNet. It uses a dynamic directed graph with matrix-valued edge weight for an ego-vehicle to adaptively retrieve the most important complementary information from its neighboring vehicles, which could improve its own perception performance and robustness. Besides collaborative perception, we also study the adversarial robustness of LiDAR-based perception, and reveal an often-overlooked vulnerability that lies in the LiDAR motion correction process. We show that spoofing of a vehicle’s trajectory estimation with small adversarial perturbations can jeopardize LiDAR perception. We hope our collaborative and adversarial 3D perception research can help improve the robustness and safety of autonomous driving systems.

Speaker Biography: Yiming Li is a Ph.D. candidate in AI4CE Lab at New York University (NYU) with the Dean’s PhD Fellowship. His research interest primarily lies in robot vision and learning, with its applications in cyber-physical systems, autonomous driving, and human-robot interaction. More specifically, he is interested in collaborative and adversarial perception, egocentric vision, multi-modal perception, and embodied AI. His works have been published in top-tier conferences including NeurIPS, CVPR, ICCV, ICRA, and IROS. During his first Ph.D. year, he visited MARS Lab in Institute for Interdisciplinary Information Sciences (IIIS) at Tsinghua University, MediaBrain Group in School of Electronic Information and Electrical Engineering at Shanghai Jiao Tong University (SJTU), and Institute for AI Industry Research (AIR) at Tsinghua University. He obtained a bachelor degree in mechatronics, manufacture, and automation from Tongji University at Shanghai with honors.

Details

Date:
May 19
Time:
12:00 pm - 1:00 pm
https://nyu.zoom.us/webinar/register/WN_L6pu-9s4THech1FVcSgwNw

Organizer

C2SMART
Phone:
6469973811
Email:
c2smart@nyu.edu
View Organizer Website