Conference paper Open Access
Bringing AI pipelines onto cloud-HPC: setting a baseline for accuracy of COVID-19 diagnosis
Iacopo Colonnelli;
Barbara Cantalupo;
Concetto Spampinato;
Matteo Pennisi;
Marco Aldinucci
HPC is an enabling platform for AI. The introduction of AI workloads in the HPC applications basket has non-trivial consequences both on the way of designing AI applications and on the way of providing HPC computing. This is the leitmotif of the convergence between HPC and AI. The formalized definition of AI pipelines is one of the milestones of HPC-AI convergence. If well conducted, it allows, on the one hand, to obtain portable and scalable applications. On the other hand, it is crucial for the reproducibility of scientific pipelines. In this work, we advocate the StreamFlow Workflow Management System as a crucial ingredient to define a parametric pipeline, called “CLAIRE COVID-19 Universal Pipeline”, which is able to explore the optimization space of methods to classify COVID-19 lung lesions from CT scans, compare them for accuracy, and therefore set a performance baseline. The universal pipeline automatizes the training of many different Deep Neural Networks (DNNs) and many different hyperparameters. It, therefore, requires a massive computing power, which is found in traditional HPC infrastructure thanks to the portability-by-design of pipelines designed with StreamFlow. Using the universal pipeline, we identified a DNN reaching over 90% accuracy in detecting COVID-19 lesions in CT scans.
| Name | Size | |
|---|---|---|
|
21_AI-pipelines_ENEA-COVID19.pdf
md5:baa3d7be552c20c6db588ac5b382f660 |
600.7 kB | Download |
| All versions | This version | |
|---|---|---|
| Views | 449 | 449 |
| Downloads | 79 | 79 |
| Data volume | 47.5 MB | 47.5 MB |
| Unique views | 439 | 439 |
| Unique downloads | 77 | 77 |
- Publication date:
- June 1, 2021
- DOI:
-
- ISBN:
- 978-88-8286-415-6
- Published in:
- ENEA CRESCO in the fight against COVID-19, ENEA, Virtual, pp. 66-73 (978-88-8286-415-6).
- Grants:
-
European Commission:
- DeepHealth - Deep-Learning and HPC to Boost Biomedical Applications for Health (825111)
- Meeting:
- ENEA CRESCO in the fight against COVID-19, Virtual, Jan.26th – Feb. 23rd 2021
- Communities:
- License (for files):
- Creative Commons Attribution 4.0 International