Layered Object Recognition System for Pedestrian Sensing
There is a significant need to develop innovative technologies to detect pedestrians or other vulnerable road users at designated crossing locations and midblock/unexpected areas and to determine potential collisions with pedestrians. An in-vehicle pedestrian sensing system was developed to address this specific problem. The research team used stereo vision cameras and developed three key innovations, namely, the detection and recognition of multiple roadway objects; the use of multiple cues (depth, motion, shape, and appearance) to detect, track, and classify pedestrians; and the use of contextual information to reject a majority of the typical false positives that plague vision-based pedestrian detection systems. This report describes the approach and tabulates representative results of experiments conducted on multiple video sequences captured over the course of the project. The conclusion derived from these results is that the developed system is state of the art when compared to the best approaches published in literature. The false positive rates are still higher than desired for the system to be ready for commercialization. This report also provides steps that can be taken to improve the performance in this regard. A real-time system was developed and demonstrated in a test vehicle.
- Record URL:
- Record URL:
-
Corporate Authors:
Sarnoff Corporation
201 Washington Road
Princeton, NJ United States 08543Federal Highway Administration
Exploratory Advanced Research Program
6300 Georgetown Pike
McLean, VA United States 22101-2296 -
Authors:
- Eledath, Jayan
- Matei, Bogdan
- Bansal, Mayank
- Jung, Sang-Hack
- Sawhney, Harpreet
- Publication Date: 2012-10
Language
- English
Media Info
- Media Type: Digital/other
- Edition: Final Report
- Features: Figures; Photos; References; Tables;
- Pagination: 116p
Subject/Index Terms
- TRT Terms: Detection and identification systems; Pedestrian movement; Pedestrian safety; Pedestrian vehicle interface; Real time information; State of the art; Test vehicles
- Uncontrolled Terms: Stereo vision
- Subject Areas: Highways; Pedestrians and Bicyclists; Safety and Human Factors; Vehicles and Equipment; I85: Safety Devices used in Transport Infrastructure; I90: Vehicles;
Filing Info
- Accession Number: 01453914
- Record Type: Publication
- Report/Paper Numbers: FHWA-HRT-11-056
- Contract Numbers: DTFH61-07-H-00039
- Files: NTL, TRIS, ATRI, USDOT
- Created Date: Nov 15 2012 12:32PM