ProSTformer: Progressive Space-Time Self-Attention Model for Short-Term Traffic Flow Forecasting

Traffic flow forecasting is essential and challenging to intelligent city management and public safety. In this paper, the authors attempt to use a pure self-attention method in traffic flow forecasting. However, when dealing with input sequences, including large-scale regions’ historical records, it is difficult for the self-attention mechanism to focus on the most relevant ones for forecasting. To address this issue, we design a progressive space-time self-attention mechanism named ProSTformer, which can reduce self-attention computation times from thousands to tens. The authors' design is based on two pieces of prior knowledge in the traffic flow forecasting literature: (i) spatiotemporal dependencies can be factorized into spatial and temporal dependencies; (ii) adjacent regions have more influences than distant regions, and temporal characteristics of closeness, period and trend are more important than crossed relations between them. The authors' ProSTformer has two characteristics. First, each block in ProSTformer highlights the unique dependencies, ProSTformer progressively focuses on spatial dependencies from local to global regions, on temporal dependencies from closeness, period and trend to crossed relations between them, and on external dependencies such as weather conditions, temperature and day-of-week. Second, the authors use the Tensor Rearranging technique to force the model to compute self-attention only to adjacent regions and to the unique temporal characteristic. Then, the authors use the Patch Merging technique to greatly reduce self-attention computation times to distant regions and crossed temporal relations. The authors evaluate ProSTformer on two traffic datasets and find that it performs better than sixteen baseline models. The code is available at https://github.com/yanxiao1930/ProSTformer_code/tree/main.

• Record URL:
  • https://doi.org/10.1109/TITS.2024.3367754
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/oclc/41297384
• Supplemental Notes:
  • Copyright © 2024, IEEE.
• Authors:
  • Yan, Xiao
  • Gan, Xianghua
  • Tang, Jingjing
  • Zhang, Dapeng
  • Wang, Rui
• Publication Date: 2024-9

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Pagination: pp 10802-10816
• Serial:
  • IEEE Transactions on Intelligent Transportation Systems
  • Volume: 25
  • Issue Number: 9
  • Publisher: Institute of Electrical and Electronics Engineers (IEEE)
  • ISSN: 1524-9050
  • Serial URL: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6979

Subject/Index Terms

• TRT Terms: Machine learning; Predictive models; Traffic flow; Traffic forecasting; Transformers
• Geographic Terms: New York (New York)
• Subject Areas: Data and Information Technology; Highways; Planning and Forecasting;

Filing Info

• Accession Number: 01938197
• Record Type: Publication
• Files: TRIS
• Created Date: Nov 27 2024 1:42PM