The left-behind human detection and tracking system based on vision with multi-model fusion and microwave radar inside the bus

Left-behind humans inside the car or bus have caused a lot of accidents, so it is essential to detect the humans in vehicle. Current human detection methods rely on wearable devices, oxygen sensors, and special seat designs in vehicles, but those sensors cannot adapt to ever-changing environments. To solve those problems and especially to improve passengers’ safety on the bus, the authors propose a method to accomplishing human detection by fusion vision and microwave radar information in various environments in vehicle. For vision information, the authors use different networks to extract human and human face features, and fusion of the detection results in different models to improve human detection accuracy. The human detection model is MobileNet-V2, and the human face detection model is MTCNN. A new matching schedule and tracking objects management rule based on the Kernelized Correlation Filter tracker are designed to track the human and human face detection boxes. The microwave radar information is used to detect moving objects. Finally, the fusion vision and microwave radar detection results are implemented. Experiments show that the authors' method has improved the human detection accuracy in vehicle, and this method can be used for detection of left-behind children on the school bus.

• Record URL:
  • https://doi.org/10.1177/0954407020912137
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/09544070
• Supplemental Notes:
  • © IMechE 2020.
• Authors:
  • Liao, Jiacai
  • 0000-0001-8422-9264
  • Xiang, Guoliang
  • Cao, Libo
  • Xia, Jiahao
  • Yue, Luyao
• Publication Date: 2020-8

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Pagination: pp 2342-2354
• Serial:
  • Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering
  • Volume: 234
  • Issue Number: 9
  • Publisher: Sage Publications Limited
  • ISSN: 0954-4070
  • EISSN: 2041-2991
  • Serial URL: http://pid.sagepub.com/content/current

Subject/Index Terms

• TRT Terms: Detection and identification; Face; Human beings; Human factors; Intelligent vehicles; Machine vision; Microwave detectors; Moving target indicators; Radar; Sensors
• Subject Areas: Highways; Safety and Human Factors; Vehicles and Equipment;

Filing Info

• Accession Number: 01745648
• Record Type: Publication
• Files: TRIS
• Created Date: Jul 22 2020 2:40PM