Development of Railroad Trespassing Database Using Artificial Intelligence

The Federal Railroad Administration (FRA) sponsored a research team from Rutgers University to develop a proof-of-concept Trespassing Database using Artificial Intelligence (AI) technology to automatically process large volumes of live or recorded video data. The team used the Rutgers AI algorithm to analyze over 27,000 hours of live video data and 1,176 hours of recorded video data from right-of-ways and grade crossings at 11 locations in 6 states. The AI algorithm collected trespassing-related data, including traffic, rail signal activations, train events, and trespass events. Trespass event data were automatically collected for each trespasser, including date, time, type (e.g., person, car, truck, bus, motorcycle), weather, trespasser’s path, and a video clip. The team manually validated all trespass event detection results to ensure that accurate data were included in the database. Over 29,000 trespass events were detected by the AI algorithm across all studied locations in this research. This report also presents two year-long, in-depth case studies of one grade crossing in New Jersey (21,202 trespass events) and one right-of-way (ROW) location in North Carolina (476 trespass events). This report provides temporal and spatial analyses of trespass events and discusses AI-informed mitigation strategies.


  • English

Media Info

  • Media Type: Digital/other
  • Edition: Final Report; Technical Report
  • Features: Appendices; Figures; Photos; References; Tables;
  • Pagination: 80p

Subject/Index Terms

Filing Info

  • Accession Number: 01908349
  • Record Type: Publication
  • Report/Paper Numbers: DOT/FRA/ORD-24/09
  • Contract Numbers: 693JJ620C000009
  • Files: NTL, TRIS, USDOT
  • Created Date: Feb 18 2024 4:02PM