Dynamic scheduling of flexible bus services with hybrid requests and fairness: Heuristics-guided multi-agent reinforcement learning with imitation learning

Flexible bus is a class of demand-responsive transit that provides door-to-door service. It is gaining popularity now but also encounters many challenges, such as high dynamism, immediacy requirements, and financial sustainability. Scientific literature designs flexible bus services only for reservation demand, overlooking the potential market for immediate demand that can improve ride pooling and financial sustainability. The increasing availability of historical travel demand data provides opportunities for leveraging future demand prediction in optimizing fleet utilization. This study investigates prediction failure risk-aware dynamic scheduling flexible bus services with hybrid requests allowing for both reservation and immediate demand. Equity in request waiting time for immediate demand is emphasized as a key objective. The authors model this problem as a multi-objective Markov decision process to jointly optimize vehicle routing, timetable, holding control and passenger assignment. To solve this problem, the authors develop a novel heuristics-guided multi-agent reinforcement learning (MARL) framework entailing three salient features: 1) incorporating the demand forecasting and prediction error correction modules into the MARL framework; 2) combining the benefits of MARL, local search algorithm, and imitation learning (IL) to improve solution quality; 3) incorporating an improved strategy in action selection with time-related information about spatio-temporal relationships between vehicles and passengers to enhance training efficiency. These enhancements are general methodological contributions to the artificial intelligence and operations research communities. Numerical experiments show that the authors' proposed method is comparable to prevailing benchmark methods both with respect to training stability and solution quality. The benefit of demand prediction is significant even when the prediction is imperfect. The authors' model and algorithm are applied to a real-world case study in Guangzhou, China. Managerial insights are also provided.

• Record URL:
  • https://doi.org/10.1016/j.trb.2024.103069
• Record URL:
  • http://www.sciencedirect.com/science/article/pii/S0191261524001930
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/01912615
• Supplemental Notes:
  • © 2024 Elsevier Ltd. All rights are reserved, including those for text and data mining, AI training, and similar technologies. Abstract reprinted with permission of Elsevier.
• Authors:
  • Wu, Weitiao
  • Zhu, Yanchen
  • Liu, Ronghui
• Publication Date: 2024-12

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Pagination: 103069
• Serial:
  • Transportation Research Part B: Methodological
  • Volume: 190
  • Issue Number: 0
  • Publisher: Elsevier
  • ISSN: 0191-2615
  • Serial URL: http://www.sciencedirect.com/science/journal/01912615

Subject/Index Terms

• TRT Terms: Bus transit; Fleet management; Forecasting; Machine learning; Scheduling; Travel demand
• Geographic Terms: Guangzhou (China)
• Subject Areas: Data and Information Technology; Planning and Forecasting; Public Transportation;

Filing Info

• Accession Number: 01933959
• Record Type: Publication
• Files: TRIS
• Created Date: Oct 17 2024 9:15AM