Prospect Theory-inspired Automated P2P Energy Trading with Q-learning-based Dynamic Pricing

Ashutosh Timilsina, Simone Silvestri

Research output: Contribution to journalConference articlepeer-review

4 Scopus citations

Abstract

The widespread adoption of distributed energy resources, and the advent of smart grid technologies, have allowed traditionally passive power system users to become actively involved in energy trading. Recognizing the fact that the traditional centralized grid-driven energy markets offer minimal profitability to these users, recent research has shifted focus towards decentralized peer-to-peer (P2P) energy markets. In these markets, users trade energy with each other, with higher benefits than buying or selling to the grid. However, most researches in P2P energy trading largely overlook the user perception in the trading process, assuming constant availability, participation, and full compliance. As a result, these approaches may result in negative attitudes and reduced engagement over time. In this paper, we design an automated P2P energy market that takes user perception into account. We employ prospect theory to model the user perception and formulate an optimization framework to maximize the buyer's perception while matching demand and production. Given the non-linear and non-convex nature of the optimization problem, we propose Differential Evolution-based Algorithm for Trading Energy called DEbATE. Additionally, we introduce a risk-sensitive Q-learning algorithm, named Pricing mechanism with Q-learning and Risk-sensitivity (PQR), which learns the optimal price for sellers considering their perceived utility. Results based on real traces of energy consumption and production, as well as realistic prospect theory functions, show that our approach achieves a 26% higher perceived value for buyers and generates 7% more reward for sellers, compared to a recent state of the art approach.

Original languageEnglish
Pages (from-to)4836-4841
Number of pages6
JournalProceedings - IEEE Global Communications Conference, GLOBECOM
DOIs
StatePublished - 2022
Event2022 IEEE Global Communications Conference, GLOBECOM 2022 - Virtual, Online, Brazil
Duration: Dec 4 2022Dec 8 2022

Bibliographical note

Publisher Copyright:
© 2022 IEEE.

Funding

ACKNOWLEDGMENT This work is supported by the NSF grant EPCN-1936131 and NSF CAREER grant CPS-1943035.

FundersFunder number
National Science Foundation (NSF)EPCN-1936131, CPS-1943035

    Keywords

    • Peer-to-peer energy trading
    • Q-learning
    • differential evolution
    • dynamic pricing
    • prospect theory
    • prosumer

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Networks and Communications
    • Hardware and Architecture
    • Signal Processing

    Fingerprint

    Dive into the research topics of 'Prospect Theory-inspired Automated P2P Energy Trading with Q-learning-based Dynamic Pricing'. Together they form a unique fingerprint.

    Cite this