Multi-scenario operation optimization of electric-thermal coupling renewable energy system based on deep reinforcement learning

Geyi Wu; Yuanchao Yang; Wenjing An

doi:10.1117/12.3015117

6 February 2024 Multi-scenario operation optimization of electric-thermal coupling renewable energy system based on deep reinforcement learning

Geyi Wu, Yuanchao Yang, Wenjing An

Author Affiliations +

Proceedings Volume 12979, Ninth International Conference on Energy Materials and Electrical Engineering (ICEMEE 2023); 129792V (2024) https://doi.org/10.1117/12.3015117
Event: 9th International Conference on Energy Materials and Electrical Engineering (ICEMEE 2023), 2023, Guilin, China

Abstract

Within the electric-heat coupling renewable energy system, the complex coupling relationship between electric energy and heat energy, integrated with large-scale of uncertainties in renewable energy and load demand, brings about significant challenges to the real-time economic dispatch of the power system. In view of this, this paper establishes an electric-heat coupling renewable energy optimization model including pumped storage power station and combined heat and power unit which is equipped with heat storage device, and a modified proximal policy optimization (MPPO) algorithms was proposed. First, a vast of electric-heat coupling renewable energy system optimal scheduling problems are expressed as Markov decision processes under the framework of deep reinforcement learning, and then the reward function mechanism is designed to guide the algorithm to generate the best dispatching plan. Next, the collection and sampling method of training samples, as well as the updating mechanism of network parameters and strategies are established. Finally, a case study is carried out with the typical power system, and the simulation results of the electric-heat coupling renewable energy system indicate that the proposed algorithm can effectively reduce the training cost, and the algorithm can handle with varieties of operating situations real-time scheduling of the electric-heat coupling renewable energy system.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Geyi Wu, Yuanchao Yang, and Wenjing An "Multi-scenario operation optimization of electric-thermal coupling renewable energy system based on deep reinforcement learning", Proc. SPIE 12979, Ninth International Conference on Energy Materials and Electrical Engineering (ICEMEE 2023), 129792V (6 February 2024); https://doi.org/10.1117/12.3015117

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available