Collaborative Optimization of Multi-microgrids System with Shared Energy Storage Based on Multi-agent Stochastic Game and Reinforcement Learning

Yijian Wang, Yang Cui, Yang Li, Yang Xu
6/19/2023
eess.SYcs.LG

No confident code implementation found for this paper.

Abstract

Achieving the economical and stable operation of Multi-microgrids (MMG) systems is vital. However, there are still some challenging problems to be solved. Firstly, from the perspective of stable operation, it is necessary to minimize the energy fluctuation of the main grid. Secondly, the characteristics of energy conversion equipment need to be considered. Finally, privacy protection while reducing the operating cost of an MMG system is crucial. To address these challenges, a Data-driven strategy for MMG systems with Shared Energy Storage (SES) is proposed. The Mixed-Attention is applied to fit the conditions of the equipment, additionally, Multi-Agent Soft Actor-Critic(MA-SAC) and (Multi-Agent Win or Learn Fast Policy Hill-Climbing)MA-WoLF-PHC are proposed to solve the partially observable dynamic stochastic game problem. By testing the operation data of the MMG system in Northwest China, following conclusions are drawn: the R-Square (R2) values of results reach 0.999, indicating the neural network effectively models the nonlinear conditions. The proposed MMG system framework can reduce energy fluctuations in the main grid by 1746.5kW in 24 hours and achieve a cost reduction of 16.21% in the test. Finally, the superiority of the proposed algorithms is verified through their fast convergence speed and excellent optimization performance.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm

88% match2023

Policy Optimization and Multi-agent Reinforcement Learning for Mean-variance Team Stochastic Games

83% match2025

A Reinforcement Learning Approach for Optimal Control in Microgrids

82% match2025

Multi-agent Reinforcement Learning for Energy Saving in Multi-Cell Massive MIMO Systems

81% match2024

MAHTM: A Multi-Agent Framework for Hierarchical Transactive Microgrids

81% match1 repo102023

A Multiobjective Reinforcement Learning Framework for Microgrid Energy Management

80% match2023

Cite this paper

@article{wang2023collaborative,
  title  = {Collaborative Optimization of Multi-microgrids System with Shared Energy Storage Based on Multi-agent Stochastic Game and Reinforcement Learning},
  author = {Yijian Wang and Yang Cui and Yang Li and Yang Xu},
  year   = {2023},
  eprint = {2306.10754},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2306.10754v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2306.10754.svg)](https://codeofpaper.com/paper/2306.10754)

Discussion