Semantic Scene Labeling via Deep Nested Level Set

Semantic scene labeling plays a very important role in intelligent transportation tasks, such as autonomous driving and advanced driver assistance. Recently, thanks to the advances of deep learning, significant improvements have been achieved for this pixel-wise labeling task. Although effective, current methods lack of explicitly modeling the boundary of objects, resulting in inaccurate labeling results. Meanwhile, traditional level set based methods perform better to capture the evolution of boundaries. However, they are sensitive to the model initialization. To address these issues, in this work the authors propose a novel deep learning framework, named deep nested level set (DNLS) for boundary-aware semantic scene labeling. Different from previous works, their proposed framework explicitly takes deep learned features and object boundary information into account. More specifically, their proposed framework first predicts semantic probability maps and boundary locations of objects using a bifurcated fully convolutional network (BFCN). Then, these probability maps are seamlessly integrated into a nested level set function for accurate scene labeling. As a result, their approach can automatically initialize the nested level set function, and the whole framework can be trained in an end-to-end manner, providing a new solution for accurate semantic scene parsing. Extensive experiments on public CamVid and Cityscapes datasets demonstrate that the authors' proposed framework produces high-quality predictions with clear object boundaries and spatial consistency.

• Record URL:
  http://dx.doi.org/10.1109/TITS.2020.2995730
• Record URL:
  https://ieeexplore.ieee.org/document/9112614
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/oclc/41297384
• Supplemental Notes:
  • Copyright © 2021, IEEE.
• Authors:
  • Zhang, Pingping
  • Liu, Wei
  • 0000-0002-6669-440X
  • Lei, Yinjie
  • Lu, Huchuan
• Publication Date: 2021-11

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Pagination: 6853-6865
• Serial:
  • IEEE Transactions on Intelligent Transportation Systems
  • Volume: 22
  • Issue Number: 11
  • Publisher: Institute of Electrical and Electronics Engineers (IEEE)
  • ISSN: 1524-9050
  • Serial URL: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6979

Subject/Index Terms

• TRT Terms: Artificial intelligence; Detection and identification; Image analysis; Intelligent transportation systems; Neural networks
• Subject Areas: Data and Information Technology; Highways; Vehicles and Equipment;

Filing Info

• Accession Number: 01838098
• Record Type: Publication
• Files: TRIS
• Created Date: Feb 28 2022 5:07PM