Conference paper Open Access

The 2021 ImageCLEF Benchmark: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications

Bogdan Ionescu; Henning Müller; Renaud Péteri; Asma Ben Abacha; Dina Demner-Fushman; Sadid A. Hasan; Mourad Sarrouti; Obioma Pelka; Christoph M. Friedrich; Alba G. Seco de Herrera; Janadhip Jacutprakart; Vassili Kovalev; Serge Kozlovski; Vitali Liauchuk; Yashin Dicente Cid; Jon Chamberlain; Adrian Clark; Antonio Campello; Hassan Moustahfid; Thomas Oliver; Abigail Schulz; Paul Brie; Raul Berari; Dimitri Fichou; Andrei Tauteanu; Mihai Dogariu; Liviu Daniel Stefan; Mihai Gabriel Constantin; Jérôme Deshayes; Adrian Popescu

This paper presents the ideas for the 2021 ImageCLEF lab that will be organized as part of the Conference and Labs of the Evaluation Forum—CLEF Labs 2021 in Bucharest, Romania. ImageCLEF is an ongoing evaluation initiative (active since 2003) that promotes the evaluation of technologies for annotation, indexing and retrieval of visual data with the aim of providing information access to large collections of images in various usage scenarios and domains. In 2021, the 19th edition of ImageCLEF will organize four main tasks: (i) a Medical task addressing visual question answering, a concept annotation and a tuberculosis classification task, (ii) a Coral task addressing the annotation and localisation of substrates in coral reef images, (iii) a DrawnUI task addressing the creation of websites from either a drawing or a screenshot by detecting the different elements present on the design and a new (iv) Aware task addressing the prediction of real-life consequences of online photo sharing. The strong participation in 2020, despite the COVID pandemic, with over 115 research groups registering and 40 submitting over 295 runs for the tasks shows an important interest in this benchmarking campaign. We expect the new tasks to attract at least as many researchers for 2021.

Files (10.3 MB)
Name Size
10.3 MB Download
Views 90
Downloads 117
Data volume 1.2 GB
Unique views 66
Unique downloads 111


Cite as