Mantik: A Workflow Platform for the Development of Artificial Intelligence on High-Performance Computing Infrastructures

Mantik is an open-source cloud platform that simplifies the development of and collaboration on ML models on high-performance computing facilities, and enhances reproducibility by supporting data and code versioning as well as experiment tracking. The users are able to develop their applications in the environment they are most comfortable with – their local machine. Usage of the best-choice IDE and most recent software versions allow to leverage the full potential of the software stack for their research. Using Mantik’s remote file service allows for simple management of data in remote storages and keeping track of it. As soon as an application is ready for training or inference, users can immediately submit it to an HPC cluster. During application development, users can train and/or evaluate their models on HPC clusters via CLI on their local machine or our browser-based Mantik cloud platform. The latter only requires an internet browser such that e.g., ML training from your phone becomes feasible. Once training or inference has begun, a user is able to monitor the application in real time on the Mantik cloud platform.