Skip to main navigation Skip to search Skip to main content

Reinforcement Learning for Scheduling Wireless Powered Sensor Communications

  • Kai Li
  • , Wei Ni
  • , Mehran Abolhasan
  • , Eduardo Tovar

Research output: Contribution to journal › Article › peer-review

Abstract

In a wireless powered sensor network, a base station transfers power to sensors by using wireless power transfer (WPT). Inadequately scheduling WPT and data transmission causes fast battery drainage and data queue overflow of some sensors who could have potentially gained high data reception. In this paper, scheduling WPT and data transmission is formulated as a Markov decision process (MDP) by jointly considering sensors' energy consumption and data queue. In practical scenarios, the prior knowledge about battery level and data queue length in MDP is not available at the base station. We study reinforcement learning at the sensors to find a transmission scheduling strategy, minimizing data packet loss. An optimal scheduling strategy with full-state information is also investigated, assuming that the complete battery level and data queue information are well known by the base station. This presents the lower bound of the data packet loss in wireless powered sensor networks. Numerical results demonstrate that the proposed reinforcement learning scheduling algorithm significantly reduces network packet loss rate by 60%, and increases network goodput by 67%, compared to existing non-MDP greedy approaches. Moreover, comparing the optimal solutions, the performance loss due to the lack of sensors' full-state information is less than 4.6%.
Original languageEnglish
Pages (from-to)264-274
JournalIEEE Transactions on Green Communications and Networking
Volume3
Issue number2
DOIs
Publication statusPublished - 1 Jun 2019

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 7 - Affordable and Clean Energy
    SDG 7 Affordable and Clean Energy

Fingerprint

Dive into the research topics of 'Reinforcement Learning for Scheduling Wireless Powered Sensor Communications'. Together they form a unique fingerprint.

Cite this