KPIs Dashboard for Invenio-Related Services

The purpose of this report is to document the project I was working on for nine weeks during the summer of 2018. As part of the CERN openlab Summer Student Program 2018 I had the opportunity to work with the Digital Repositories (IT-CDA-DR) section at CERN on developing a harvester in Python. The harvester’s job was to collect key performance indicators from different services that the IT-CDA-DR section is running. The key performance indicators collected were selected based on how much value they would be to the section in order to evaluate how well the services were running.
Developing the harvester involved learning how to use the task scheduler Celery and developing clean, extendable and testable code. The final objective was to learn how deployments with containers work by using Docker with Kubernetes. The harvester was later deployed to the OpenShift platform. The collected data was visualized using the Grafana platform to give an intuitive and easy-to-use interface to the collected data.