Published April 14, 2023 | Version v0.1
Software Open

RadarGNN: Transformation Invariant Graph Neural Network for Radar-based Perception

  • 1. Technical University of Munich

Description

A reliable perception has to be robust against challenging environmental conditions. Therefore, recent efforts focused on the use of radar sensors in addition to camera and lidar sensors for perception applications. However, the sparsity of radar point clouds and the poor data availability remain challenging for current perception methods. To address these challenges, a novel graph neural network is proposed that does not just use the information of the points themselves but also the relationships between the points. The model is designed to consider both point features and point-pair features, embedded in the edges of the graph. Furthermore, a general approach for achieving transformation invariance is proposed which is robust against unseen scenarios and also counteracts the limited data availability. The transformation invariance is achieved by an invariant data representation rather than an invariant model architecture, making it applicable to other methods. The proposed RadarGNN model outperforms all previous methods on the RadarScenes dataset. In addition, the effects of different invariances on the object detection and semantic segmentation quality are investigated.

Files

model_01.zip

Files (18.5 MB)

Name Size Download all
md5:3cc98181532f2f4ab50b64a76bdedc57
4.3 MB Preview Download
md5:97271c1dde0a196513da2e11559dc24e
4.6 MB Preview Download
md5:f29bb1523f1a946e3a0484451bc17458
4.6 MB Preview Download
md5:82a2f4828a40575613a869ba46908c48
4.6 MB Preview Download
md5:64038bb609b087f2818fd61ba1074853
529.7 kB Preview Download

Additional details

Related works

Is published in
Preprint: 10.48550/arXiv.2304.06547 (DOI)