Rain Removal in Traffic Surveillance: Does it Matter?
Varying weather conditions, including rainfall and snowfall, are generally regarded as a challenge for computer vision algorithms. One proposed solution to the challenges induced by rain and snowfall is to artificially remove the rain from images or video using rain removal algorithms. It is the promise of these algorithms that the rain-removed image frames will improve the performance of subsequent segmentation and tracking algorithms. However, rain removal algorithms are typically evaluated on their ability to remove synthetic rain on a small subset of images. Currently, their behavior is unknown on real-world videos when integrated with a typical computer vision pipeline. In this paper, the authors review the existing rain removal algorithms and propose a new dataset that consists of 22 traffic surveillance sequences under a broad variety of weather conditions that all include either rain or snowfall. They propose a new evaluation protocol that evaluates the rain removal algorithms on their ability to improve the performance of subsequent segmentation, instance segmentation, and feature tracking algorithms under rain and snow. If successful, the de-rained frames of a rain removal algorithm should improve segmentation performance and increase the number of accurately tracked features. The results show that a recent single-frame-based rain removal algorithm increases the segmentation performance by 19.7% on their proposed dataset, but it eventually decreases the feature tracking performance and showed mixed results with recent instance segmentation methods. However, the best video-based rain removal algorithm improves the feature tracking accuracy by 7.72%.
- Record URL:
- Find a library where document is available. Order URL: http://worldcat.org/oclc/41297384
- Copyright © 2019, IEEE.
- Bahnsen, Chris H
- Moeslund, Thomas B
- Publication Date: 2019-8
- Media Type: Digital/other
- Features: Figures; References; Tables;
- Pagination: pp 2802-2819
- IEEE Transactions on Intelligent Transportation Systems
- Volume: 20
- Issue Number: 8
- Publisher: Institute of Electrical and Electronics Engineers (IEEE)
- ISSN: 1524-9050
- Serial URL: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6979
- TRT Terms: Algorithms; Image processing; Rain; Snow; Traffic; Traffic surveillance; Video imaging detectors
- Subject Areas: Data and Information Technology; Environment; Highways; Operations and Traffic Management;
- Accession Number: 01715788
- Record Type: Publication
- Files: TLIB, TRIS
- Created Date: Aug 1 2019 1:57PM