GRC-Net: Fusing GAT-Based 4D Radar and Camera for 3D Object Detection
The fusion of multi-modal perception in autonomous driving plays a pivotal role in vehicle behavior decision-making. However, much of the previous research has predominantly focused on the fusion of Lidar and cameras. Although Lidar offers an ample supply of point cloud data, its high cost and the substantial volume of point cloud data can lead to computational delays. Consequently, investigating perception fusion under the context of 4D millimeter-wave radar is of paramount importance for cost reduction and enhanced safety. Nevertheless, 4D millimeter-wave radar faces challenges including sparse point clouds, limited information content, and a lack of fusion strategies. In this paper, we introduce, for the first time, an approach that leverages Graph Neural Networks to assist in expressing features from 4D millimeter-wave radar point clouds. This approach effectively extracts unstructured point cloud features, addressing the loss of object detection due to sparsity. Additionally, we propose the Multi-Modal Fusion Module (MMFM), which aligns and fuses features from graphs, radar pseudo-images generated from Pillars, and camera images within a geometric space. We validate our model using the View-of-Delft (VoD) dataset. Experimental results demonstrate that the proposed method efficiently fuses camera and 4D radar features, resulting in enhanced 3D detection performance.
- Record URL:
-
Availability:
- Find a library where document is available. Order URL: http://worldcat.org/issn/01487191
-
Supplemental Notes:
- Abstract reprinted with permission of SAE International.
-
Authors:
- Fan, Lili
- Zeng, Changxian
- Li, Yunjie
- Wang, Xu
- Cao, Dongpu
-
Conference:
- SAE 2023 Intelligent Urban Air Mobility Symposium
- Location: Hangzhou , China
- Date: 2023-10-20 to 2023-10-21
- Publication Date: 2023-12-31
Language
- English
Media Info
- Media Type: Web
- Features: References;
-
Serial:
- SAE Technical Paper
- Publisher: Society of Automotive Engineers (SAE)
- ISSN: 0148-7191
- EISSN: 2688-3627
- Serial URL: http://papers.sae.org/
Subject/Index Terms
- TRT Terms: Autonomous vehicles; Laser radar; Neural networks; Radar; Visualization
- Subject Areas: Highways; Vehicles and Equipment;
Filing Info
- Accession Number: 01905296
- Record Type: Publication
- Source Agency: SAE International
- Report/Paper Numbers: 2023-01-7088
- Files: TRIS, SAE
- Created Date: Jan 22 2024 3:43PM