A reinforcement learning approach for user preference-aware energy sharing systems

Ashutosh Timilsina, Atieh R. Khamesi, Vincenzo Agate, Simone Silvestri

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Energy Sharing Systems (ESS) are envisioned to be the future of power systems. In these systems, consumers equipped with renewable energy generation capabilities are able to participate in an energy market to sell their energy. This paper proposes an ESS that, differently from previous works, takes into account the consumers' preference, engagement, and bounded rationality. The problem of maximizing the energy exchange while considering such user modeling is formulated and shown to be NP-Hard. To learn the user behavior, two heuristics are proposed: 1) a Reinforcement Learning-based algorithm, which provides a bounded regret and 2) a more computationally efficient heuristic, named BPT- K, with guaranteed termination and correctness. A comprehensive experimental analysis is conducted against state-of-the-art solutions using realistic datasets. Results show that including user modeling and learning provides significant performance improvements compared to state-of-the-art approaches. Specifically, the proposed algorithms result in 25% higher efficiency and 27% more transferred energy. Furthermore, the learning algorithms converge to a value less than 5% of the optimal solution in less than 3 months of learning.

Original languageEnglish
Article number9424189
Pages (from-to)1138-1153
Number of pages16
JournalIEEE Transactions on Green Communications and Networking
Volume5
Issue number3
DOIs
StatePublished - Sep 2021

Bibliographical note

Funding Information:
Manuscript received December 3, 2020; revised April 9, 2021; accepted April 27, 2021. Date of publication May 5, 2021; date of current version August 19, 2021. This work was supported in part by the National Institute for Food and Agriculture (NIFA) under Grant 2017-67008-26145; in part by NSF under Grant EPCN 1936131; and in part by NSF CAREER under Grant CPS-1943035. (Corresponding author: Ashutosh Timilsina.) Ashutosh Timilsina, Atieh R. Khamesi, and Simone Silvestri are with the Department of Computer Science, University of Kentucky, Lexington, KY 40506 USA (e-mail: ashutosh.timilsina@uky.edu; atieh.khamesi@uky.edu; simone.silvestri@uky.edu).

Publisher Copyright:
© 2017 IEEE.

Keywords

  • Energy sharing systems
  • reinforcement learning
  • user preference
  • virtual power plants

ASJC Scopus subject areas

  • Renewable Energy, Sustainability and the Environment
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'A reinforcement learning approach for user preference-aware energy sharing systems'. Together they form a unique fingerprint.

Cite this