Enabling peer-to-peer User-Preference-Aware Energy Sharing Through Reinforcement Learning

Vincenzo Agate, Atieh R. Khamesi, Simone Silvestri, Salvatore Gaglio

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

12 Scopus citations


Renewable, heterogeneous and distributed energy resources are the future of power systems, as envisioned by the recent paradigm of Virtual Power Plants (VPPs). Residential electricity generation, e.g., through photovoltaic panels, plays a fundamental role in this paradigm, where users are able to participate in an energy sharing system and exchange energy resources among each other. In this work, we study energy sharing systems and, differently from previous approaches, we consider realistic user behaviors by taking into account the user preferences and level of engagement in the energy trades. We formulate the problem of matching energy resources while contemplating the user behavior as a Mixed Integer Linear Programming (MILP) problem, and show that the problem is NPHard. Since the solution of such problem requires the knowledge of the user behavioral model, we propose an heuristic based on reinforcement learning with bounded regret to learn such model while optimizing the system performance. Comparison with the state-of-the-art approaches using realistic simulations based on real traces shows that our method outperforms existing schemes in several efficiency metrics. Besides, the results reveal that increasing the amount of produced energy improves the learning ability of the system even in a short period. It gives practical insights for implementation of energy sharing systems.

Original languageEnglish
Title of host publication2020 IEEE International Conference on Communications, ICC 2020 - Proceedings
ISBN (Electronic)9781728150895
StatePublished - Jun 2020
Event2020 IEEE International Conference on Communications, ICC 2020 - Dublin, Ireland
Duration: Jun 7 2020Jun 11 2020

Publication series

NameIEEE International Conference on Communications
ISSN (Print)1550-3607


Conference2020 IEEE International Conference on Communications, ICC 2020

Bibliographical note

Publisher Copyright:
© 2020 IEEE.


  • Energy Sharing
  • Reinforcement Learning
  • Virtual Power Plant

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Electrical and Electronic Engineering


Dive into the research topics of 'Enabling peer-to-peer User-Preference-Aware Energy Sharing Through Reinforcement Learning'. Together they form a unique fingerprint.

Cite this