Robust Automatic Detection of Traffic Activity

The advent of autonomous vehicles has driven the need for high-performance traffic environment perception systems. In this context, streaming perception, which involves detecting and tracking objects in a video stream simultaneously, is a fundamental technique that significantly impacts autonomous driving decision-making. Notably, the fast-changing scale of traffic objects due to vehicle motion can lead to conflicts in the receptive field when detecting both large and small objects. Moreover, real-time perception is an ill-posed problem that heavily depends on motion consistency context and historical data. Consequently, two major challenges in real-time perception are: (1) adaptively handling rapidly changing object scales, and (2) accurately and efficiently learning long-term motion consistency. In this report, the authors have developed two systems for enhancing traffic safety. The first system focuses on road activity detection, which identifies the activities of vehicles. The authors discuss the first system, Argus++, in Chapter 2. Further, the authors integrated the models in their video analysis framework Argus++ to enable the real-time processing of traffic footage, including vehicle tracking. The authors introduce it in Chapter 4. Immediate notification could be provided on traffic density and speed estimation, and traffic incident detection. The second system focuses on streaming perception, which enhances the safety of autonomous driving. For this system, the authors introduce the models and algorithms in Chapter 3. Further, in Chapter 5, the authors discuss how to train a powerful model for their systems, especially training vision-language transformers from captions. The authors showed that this model could enhance the vehicle detection task.


  • English

Media Info

  • Media Type: Digital/other
  • Edition: Final Research Report
  • Features: Appendices; Figures; Glossary; Photos; References; Tables;
  • Pagination: 73p

Subject/Index Terms

Filing Info

  • Accession Number: 01887420
  • Record Type: Publication
  • Contract Numbers: 69A3551747111
  • Created Date: Jul 17 2023 9:13AM