Why did the AI make that decision? Towards an explainable artificial intelligence (XAI) for autonomous driving systems

User trust has been identified as a critical issue that is pivotal to the success of autonomous vehicle (AV) operations where artificial intelligence (AI) is widely adopted. For such integrated AI-based driving systems, one promising way of building user trust is through the concept of explainable artificial intelligence (XAI) which requires the AI system to provide the user with the explanations behind each decision it makes. Motivated by both the need to enhance user trust and the promise of novel XAI technology in addressing such need, this paper seeks to enhance trustworthiness in autonomous driving systems through the development of explainable Deep Learning (DL) models. First, the paper casts the decision-making process of the AV system not as a classification task (which is the traditional process) but rather as an image-based language generation (image captioning) task. As such, the proposed approach makes driving decisions by first generating textual descriptions of the driving scenarios, which serve as explanations that humans can understand. To this end, a novel multi-modal DL architecture is proposed to jointly model the correlation between an image (driving scenario) and language (descriptions). It adopts a fully Transformer-based structure and therefore has the potential to perform global attention and imitate effectively, the learning processes of human drivers. The results suggest that the proposed model can and does generate legal and meaningful sentences to describe a given driving scenario, and subsequently to correctly generate appropriate driving decisions in autonomous vehicles (AVs). It is also observed that the proposed model significantly outperforms multiple baseline models in terms of generating both explanations and driving actions. From the end user’s perspective, the proposed model can be beneficial in enhancing user trust because it provides the rationale behind an AV’s actions. From the AV developer’s perspective, the explanations from this explainable system could serve as a “debugging” tool to detect potential weaknesses in the existing system and identify specific directions for improvement.

• Record URL:
  https://doi.org/10.1016/j.trc.2023.104358
• Record URL:
  http://www.sciencedirect.com/science/article/pii/S0968090X23003480
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/0968090X
• Supplemental Notes:
  • © 2023 Elsevier Ltd. All rights reserved. Abstract reprinted with permission of Elsevier.
• Authors:
  • Dong, Jiqian
  • Chen, Sikai
  • 0000-0002-5931-5619
  • Miralinaghi, Mohammad
  • Chen, Tiantian
  • Li, Pei
  • Labi, Samuel
• Publication Date: 2023-11

Language

• English

Media Info

• Media Type: Web
• Features: Figures; References; Tables;
• Pagination: 104358
• Serial:
  • Transportation Research Part C: Emerging Technologies
  • Volume: 156
  • Issue Number: 0
  • Publisher: Elsevier
  • ISSN: 0968-090X
  • Serial URL: http://www.sciencedirect.com/science/journal/0968090X

Subject/Index Terms

• TRT Terms: Artificial intelligence; Autonomous vehicles; Computer vision; Decision making; Field of vision; Machine learning
• Subject Areas: Data and Information Technology; Highways; Operations and Traffic Management; Vehicles and Equipment;

Filing Info

• Accession Number: 01897093
• Record Type: Publication
• Files: TRIS
• Created Date: Oct 23 2023 4:52PM