Accelerating Rural Road Safety Using Artificial Intelligence to Unlock Predictive Insights from Videolog Data
Roadway safety, especially in rural areas, is one of the most critical components in transportation planning. In collaboration with North Carolina Department of Transportation (NCDOT), UNC Highway Safety Research Center (HSRC), and DOT Volpe National Transportation Systems Center, UNC Renaissance Computing Institute (RENCI) developed a roadside feature detection solution leveraging multiple convolutional neural networks (CNNs). The solution uses an iterative active learning (AL) computer vision model training pipeline integrated into an artificial intelligence (AI) tool to detect safety features such as guardrails and utility poles in geographically distributed NC rural roads. The RENCI team utilized transfer learning by adopting the Xception neural network architecture as the feature extraction backbone which was then used in an iterative AL process supported by a web-based annotation tool. The annotation tool not only allows for the collection of annotations through an iterative AL process for multiple safety features, but it also enables visual analysis and assessment of model prediction performance in the geospatial context. AL techniques were used to direct human annotators to label images that would most effectively improve the model aimed at minimizing the number of required training labels while maximizing the model’s performance. The iterative AL process combined with a common feature extraction backbone allowed fast model inference on millions of images in the AL sampling space. This enabled a rapid transition between AL rounds while also reducing the computing requirements for each round. Model feature extraction weights were then fine-tuned in the last round of AL to obtain the best accuracy. Since only about 2.7% of 2.6 million unlabeled images in the AL sampling space contain guardrails, there is a significant class imbalance problem that had to be addressed in the AL sampling strategies for the guardrail classification model. The AI tool can be used to detect roadside safety features and be extended to also locate them for assessing roadside hazards.
- Record URL:
-
Supplemental Notes:
- Cover title: Accelerating Rural Road Safety Using AI to Unlock Predictive Insights from Videolog Data.
-
Corporate Authors:
Renaissance Computing Institute
Chapel Hill, NC United StatesVolpe National Transportation Systems Center
Cambridge, MA United States 02142University of North Carolina, Chapel Hill
Highway Safety Research Center
Chapel Hill, NC United States 27599North Carolina Department of Transportation
Research and Development Unit
Raleigh, NC United StatesFederal Highway Administration
1200 New Jersey Avenue, SE
Washington, DC United States 20590 -
Authors:
- Yi, Hong
- Bizon, Chris
- Borland, David
- Watson, Matthew
- Satusky, Matt
- Rittmuller, Robert
- Radwan, Randa
- Srinivasan, Raghavan
- Krishnamurthy, Ashok
- Publication Date: 2021-11
Language
- English
Media Info
- Media Type: Digital/other
- Edition: Final Report
- Features: Figures; Photos; References;
- Pagination: 14p
Subject/Index Terms
- TRT Terms: Artificial intelligence; Guardrails; Highway safety; Image analysis; Rural highways; Video
- Subject Areas: Data and Information Technology; Design; Highways; Safety and Human Factors;
Filing Info
- Accession Number: 01838677
- Record Type: Publication
- Report/Paper Numbers: RP2021-20
- Contract Numbers: NCDOT RP2021-20; USDOT FAIN 69A34520501070620
- Files: NTL, TRIS, ATRI, USDOT, STATEDOT
- Created Date: Mar 16 2022 10:19AM