A V2G-oriented reinforcement learning framework and empirical study for heterogeneous electric vehicle charging management

Vehicle-to-grid (V2G) technology is a promising solution to energy supply security issues associated with future electric grids. A decisive factor to successful V2G is effective electric vehicle (EV) charging management aimed at meeting travel demands with minimal charging costs, especially how to account for uncertainties and EV heterogeneity. In this study, a deep Q-network (DQN)-based reinforcement learning (RL) method is proposed to learn the optimal EV charging strategy considering empirical travel pattern heterogeneities and unpredictable electricity prices. The effectiveness and generalizability of the proposed DQN-based RL method was validated using actual five-million-km driving data in typical Chinese cities. In particular, EVs can save over 98% of the electricity cost without future electricity price information via the proposed method compared to the charging as-soon-as-possible method. The empirical experimental results also reveal that V2G-oriented charging management is sensitive to the charging/discharging power rate, electricity-price fluctuation frequency and range, and departure-time. The authors quantified the sensitivity with value of information (VOI) and found that: (1) Knowing the departure-time information can significantly reduce charging costs in most cases (average VOI: 5.4 CNY per charging/discharging session); (2) More historical data does not always lead to a higher electricity price VOI, and prices with sudden surges may even have a negative VOI.

• Record URL:
  https://doi.org/10.1016/j.scs.2022.104345
• Record URL:
  http://www.sciencedirect.com/science/article/pii/S2210670722006497
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/22106707
• Supplemental Notes:
  • © 2022 Elsevier Ltd. All rights reserved. Abstract reprinted with permission of Elsevier.
• Authors:
  • Hao, Xu
  • Chen, Yue
  • 0000-0002-7594-7587
  • Wang, Hewu
  • Wang, Han
  • Meng, Yu
  • 0000-0002-7351-9570
  • Gu, Qing
• Publication Date: 2023-2

Language

• English

Media Info

• Media Type: Web
• Features: Figures; References; Tables;
• Pagination: 104345
• Serial:
  • Sustainable Cities and Society
  • Volume: 89
  • Issue Number: 0
  • Publisher: Elsevier
  • ISSN: 2210-6707
  • Serial URL: http://www.sciencedirect.com/science/journal/22106707?sdc=2

Subject/Index Terms

• TRT Terms: Cities; Costs; Electric vehicle charging; Grids (Transmission lines); Machine learning; Vehicle to infrastructure communications
• Geographic Terms: China
• Subject Areas: Energy; Finance; Highways; Terminals and Facilities; Vehicles and Equipment;

Filing Info

• Accession Number: 01871065
• Record Type: Publication
• Files: TRIS
• Created Date: Jan 24 2023 9:30AM