Toward End-to-End Control for UAV Autonomous Landing via Deep Reinforcement Learning

R. Polvara, M. Patacchiola, Sanjay Sharma, J. Wan, A. Manning, R. Sutton, A. Cangelosi

Research output: Chapter in Book/Published conference outputConference publication

Abstract

The autonomous landing of an unmanned aerial vehicle (UAV) is still an open problem. Previous work focused on the use of hand-crafted geometric features and sensor-data fusion for identifying a fiducial marker and guide the UAV toward it. In this article we propose a method based on deep reinforcement learning that only requires low-resolution images coming from a down looking camera in order to drive the vehicle. The proposed approach is based on a hierarchy of Deep Q-Networks (DQNs) that are used as high-end control policy for the navigation in different phases. We implemented various technical solutions, such as the combination of vanilla and double DQNs trained using a form of prioritized buffer replay that separates experiences in multiple containers. The optimal control policy is learned without any human supervision, providing the agent with a sparse reward feedback indicating the success or failure of the landing. The results show that the quadrotor can autonomously land on a large variety of simulated environments and with relevant noise, proving that the underline DQNs are able to generalise effectively on unseen scenarios. Furthermore, it was proved that in some conditions the network outperformed human pilots.
Original languageEnglish
Title of host publication2018 International Conference on Unmanned Aircraft Systems (ICUAS)
PublisherIEEE
Pages115-123
ISBN (Electronic)9781538613542
DOIs
Publication statusPublished - 3 Sept 2018
Event2018 International Conference on Unmanned Aircraft Systems - Dallas, United States
Duration: 12 Jun 201815 Jun 2018

Conference

Conference2018 International Conference on Unmanned Aircraft Systems
Abbreviated titleICUAS
Country/TerritoryUnited States
CityDallas
Period12/06/1815/06/18

Fingerprint

Dive into the research topics of 'Toward End-to-End Control for UAV Autonomous Landing via Deep Reinforcement Learning'. Together they form a unique fingerprint.

Cite this