Building effective database backup and recovery monitoring using elastic stack

The data produced at CERN is critical for both physics and administrative purposes. These data must be reachable and available at every moment. To ensure its availability, the CERN IT-DB group implements a full backup and recovery system to protect data against a loss and be able to recover it.                    

In order to monitor the backup and recovery activities and be able to detect eventual errors, a huge number of logs are generated. Those logs must be analyzed to provide us knowledge about the health of the system.

In this project, we would like to test the Elastic stack solution to analyze the generated logs so as to monitor the backup and recovery system.

In this report, we outline the process we followed to test the Elastic stack solution in the CERN case after defining some theoretical concepts about backup and recovery system and about log analysis.