Journal Article

Deep Reinforcement Learning Based on Proximal Policy Optimization for the Maintenance of a Wind Farm with Multiple Crews

Pinciroli, Luca, Ballabio, Guido, Baraldi, Piero, Compare, Michele, Zio, Enrico

2021

Overview

The life cycle of wind turbines depends on the operation and maintenance policies adopted. With the critical components of wind turbines being equipped with condition monitoring and Prognostics and Health Management (PHM) capabilities, it is feasible to significantly optimize operation and maintenance (O&M) by combining the (uncertain) information provided by PHM with the other factors influencing O&M activities, including the limited availability of maintenance crews, the variability of energy demand and corresponding production requests, and the long-time horizons of energy systems operation. In this work, we consider the operation and maintenance optimization of wind turbines in wind farms woth multiple crews. A new formulation of the problem as a sequential decision problem over a long-time horizon is proposed and solved by deep reinforcement learning based on proximal policy optimization. The proposed method is applied to a wind farm of 50 turbines, considering the availability of multiple maintenance crews. The optimal O&M policy found outperforms other state-of-the-art strategies, regardless of the number of available maintenance crews.

• Publisher: MDPI AG,MDPI
• Subject: Algorithms / Decision making / Deep learning / deep reinforcement learning / Energy / Failure / imitation learning / Maintenance costs / operation and maintenance / Optimization / Physics / Preventive maintenance / prognostics and health management / proximal policy optimization / Random variables / Wind farms / Wind power / wind turbines