Reference : Multi-agent deep reinforcement learning based Predictive Maintenance on parallel machines
Scientific journals : Article
Engineering, computing & technology : Computer science
Computational Sciences
http://hdl.handle.net/10993/54345
Multi-agent deep reinforcement learning based Predictive Maintenance on parallel machines
English
Ruiz Rodriguez, Marcelo Luis mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal >]
Kubler, Sylvain mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal >]
de Giorgio, Andrea mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal]
Cordy, Maxime mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal >]
Robert, Jérémy mailto [Cebi Luxembourg S.A.]
Le Traon, Yves mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal >]
2022
Robotics and Computer-Integrated Manufacturing
Elsevier
Yes
[en] Predictive Maintenance ; Scheduling ; Reinforcement learning ; Multi-agent systems ; Industry 4.0
[en] In the context of Industry 4.0, companies understand the advantages of performing Predictive Maintenance (PdM). However, when moving towards PdM, several considerations must be carefully examined. First, they need to have a sufficient number of production machines and relative fault data to generate maintenance predictions. Second, they need to adopt the right maintenance approach, which, ideally, should self-adapt to the machinery, priorities of the organization, technician skills, but also to be able to deal with uncertainty. Reinforcement learning (RL) is envisioned as a key technique in this regard due to its inherent ability to learn by interacting through trials and errors, but very few RL-based maintenance frameworks have been proposed so far in the literature, or are limited in several respects. This paper proposes a new multi-agent approach that learns a maintenance policy performed by technicians, under the uncertainty of multiple machine failures. This approach comprises RL agents that partially observe the state of each machine to coordinate the decision-making in maintenance scheduling, resulting in the dynamic assignment of maintenance tasks to technicians (with different skills) over a set of machines. Experimental evaluation shows that our RL-based maintenance policy outperforms traditional maintenance policies (incl., corrective and preventive ones) in terms of failure prevention and downtime, improving by ≈75% the overall performance.
Researchers ; Professionals ; Students ; General public
http://hdl.handle.net/10993/54345
10.1016/j.rcim.2022.102406
FnR ; FNR16756339 > Yves Le Traon > UPTIME4.0 > Robust Predictive Maintenance For Industry 4.0 > 01/03/2022 > 28/02/2025 > 2021

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Open access
1-s2.0-S0736584522000928-main.pdfPublisher postprint2.22 MBView/Open

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.