Detecting Darting Out Pedestrians With Occlusion Aware Sensor Fusion of Radar and Stereo Camera

Early and accurate detection of crossing pedestrians is crucial in automated driving in order to perform timely emergency manoeuvres. However, this is a difficult task in urban scenarios where pedestrians are often occluded (not visible) behind objects, e.g., other parked vehicles. The authors propose an occlusion aware fusion of stereo camera and radar sensors to address scenarios with crossing pedestrians behind such parked vehicles. The authors' proposed method adapts both the expected rate and properties of detections in different areas according to the visibility of the sensors. In the authors' experiments on a real-world dataset, the authors show that the proposed occlusion aware fusion of radar and stereo camera detects the crossing pedestrians on average 0.26 seconds earlier than using the camera alone, and 0.15 seconds earlier than fusing the sensors without occlusion information. The authors' dataset containing 501 relevant recordings of pedestrians behind vehicles will be publicly available on their website for non-commercial, scientific use.


  • English

Media Info

Subject/Index Terms

Filing Info

  • Accession Number: 01884262
  • Record Type: Publication
  • Files: TRIS
  • Created Date: May 31 2023 10:58AM