Metaverse Meets Intelligent Transportation System: An Efficient and Instructional Visual Perception Framework

The combination of the Metaverse and intelligent transportation systems (ITS) holds significant developmental promise, especially for visual perception tasks. However, the acquisition of high-quality scene data poses a challenging and expensive endeavor. Meanwhile, the visual disparity between the Metaverse and the physical world poses an impact on the practical applicability of the visual perception tasks. In this paper, a Metaverse Intelligent Traffic Visual Framework, MITVF, is developed to guide the implementation of visual perception tasks in the physical world. Firstly, a two-stage metadata optimization strategy is proposed that can efficiently provide diverse and high-quality scene data for traffic perception models. Specifically, an element reconfigurability strategy is proposed to flexibly combine dynamic and static traffic elements to enrich the data with a low cost. A diffusion model-based metadata optimization acceleration strategy is proposed to achieve efficient improvement of image resolution. Secondly, a Meta-Physical adaptive learning method is proposed, and further applied to visual perception tasks to compensate for the visual disparity between the Metaverse and the physical world. Experimental results show that MITVF achieves a 10 X acceleration in optimization speed, ensuring the image quality and reconstructing diverse. Further, MITVF is applied to the traffic object detection task to verify the effectiveness and validity. The performance of the model trained with 5k real data exceeded that of the model trained with 200k real data, with AP50 reaching 67.7%.

• Record URL:
  • https://doi.org/10.1109/TITS.2024.3398586
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/oclc/41297384
• Supplemental Notes:
  • Copyright © 2024, IEEE.
• Authors:
  • Wang, Junfan
  • Chen, Yi
  • Ji, Xiaoyue
  • Dong, Zhekang
  • Gao, Mingyu
  • Lai, Chun Sing
• Publication Date: 2024-10

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Pagination: pp 14986-15001
• Serial:
  • IEEE Transactions on Intelligent Transportation Systems
  • Volume: 25
  • Issue Number: 10
  • Publisher: Institute of Electrical and Electronics Engineers (IEEE)
  • ISSN: 1524-9050
  • Serial URL: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6979

Subject/Index Terms

• TRT Terms: Computer vision; Intelligent transportation systems; Machine learning; Metadata
• Subject Areas: Data and Information Technology; Highways; Operations and Traffic Management;

Filing Info

• Accession Number: 01942551
• Record Type: Publication
• Files: TRIS
• Created Date: Jan 15 2025 4:52PM