UAV Trajectory Planning in Wireless Sensor Networks for Energy Consumption Minimization by Deep Reinforcement Learning

Unmanned aerial vehicles (UAVs) have emerged as a promising candidate solution for data collection of large-scale wireless sensor networks (WSNs). In this paper, the authors investigate a UAV-aided WSN, where cluster heads (CHs) receive data from their member nodes, and a UAV is dispatched to collect data from CHs. The authors aim to minimize the total energy consumption of the UAV-WSN system in a complete round of data collection. Toward this end, the authors formulate the energy consumption minimization problem as a constrained combinatorial optimization problem by jointly selecting CHs from clusters and planning the UAV's visiting order to the selected CHs. The formulated energy consumption minimization problem is NP-hard, and hence, hard to solve optimally. To tackle this challenge, the authors propose a novel deep reinforcement learning (DRL) technique, pointer network-A* (Ptr-A*), which can efficiently learn the UAV trajectory policy for minimizing the energy consumption. The UAV's start point and the WSN with a set of pre-determined clusters are fed into the Ptr-A*, and the Ptr-A* outputs a group of CHs and the visiting order of CHs, i.e., the UAV's trajectory. The parameters of the Ptr-A* are trained on small-scale clusters problem instances for faster training by using the actor-critic algorithm in an unsupervised manner. Simulation results show that the trained models based on 20-clusters and 40-clusters have a good generalization ability to solve the UAV's trajectory planning problem in WSNs with different numbers of clusters, without retraining the models. Furthermore, the results show that the authors' proposed DRL algorithm outperforms two baseline techniques.

• Record URL:
  http://dx.doi.org/10.1109/TVT.2021.3102161
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/00189545
• Supplemental Notes:
  • Copyright © 2021, IEEE.
• Authors:
  • Zhu, Botao
  • Bedeer, Ebrahim
  • Nguyen, Ha H
  • Barton, Robert
  • Henry, Jerome
• Publication Date: 2021-9

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Pagination: pp 9540-9554
• Serial:
  • IEEE Transactions on Vehicular Technology
  • Volume: 70
  • Issue Number: 9
  • Publisher: Institute of Electrical and Electronics Engineers (IEEE)
  • ISSN: 0018-9545
  • Serial URL: http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=25

Subject/Index Terms

• TRT Terms: Drones; Energy consumption; Machine learning; Trajectory control; Wireless sensor networks
• Subject Areas: Aviation; Data and Information Technology; Energy; Vehicles and Equipment;

Filing Info

• Accession Number: 01782808
• Record Type: Publication
• Files: TRIS
• Created Date: Sep 24 2021 10:21AM