An Augmented around View Monitor System Fusing Depth and Image Information during the Reversing Process

The around view monitor (AVM) system for vehicles usually suffers from the distortion of surrounding objects caused by incomplete rectification and stitching, which seriously affects the driver's judgment of the surrounding environment during the reversing process. In response to solve this problem, an augmented around view monitor (AAVM) system fusing image and depth information is proposed, which highlights the point clouds of persons or vehicles at the rear of the vehicle. First, an around view image is generated from four fisheye cameras. Then, the calibration of multi TOF cameras is conducted to improve their accuracy of depth estimation and obtain extrinsic camera positions. Next, the 2D-driven object point cloud detection method is proposed to localize and segment object point clouds like vehicles or persons. Finally, the around view image, the object point clouds, and the car model are unified in the same vehicle-centric coordinate system, which will be projected at a suitable angle of view so as to easy to observe. The field experiments are conducted using a passenger car with 4 fisheye cameras and 3 TOF cameras. The results show that the AAVM can help the driver to effectively judge the real environment behind the vehicle during the reversing process.

• Record URL:
  https://doi.org/10.4271/2020-01-0095
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/01487191
• Supplemental Notes:
  • Abstract reprinted with permission of SAE International.
• Authors:
  • Li, Wei
  • Wang, Wenbo
  • Jiang, Lu
  • Xiao, Dongjie
  • Cao, Libo
• Conference:
  • WCX SAE World Congress Experience
  • Location: Detroit Michigan, United States
  • Date: 2020-4-21 to 2020-4-23
• Publication Date: 2020-4-14

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Serial:
  • SAE Technical Paper
  • Publisher: Society of Automotive Engineers (SAE)
  • ISSN: 0148-7191
  • EISSN: 2688-3627
  • Serial URL: http://papers.sae.org/

Subject/Index Terms

• TRT Terms: Backing (Driving); Cameras; Data quality; Field of vision; Optical devices; Vehicle electronics; Visual perception
• Subject Areas: Design; Highways; Safety and Human Factors; Vehicles and Equipment;

Filing Info

• Accession Number: 01740513
• Record Type: Publication
• Source Agency: SAE International
• Report/Paper Numbers: 2020-01-0095
• Files: TRIS, SAE
• Created Date: May 26 2020 10:22AM