Conference paper Open Access

The 2021 ImageCLEF Benchmark: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications

Bogdan Ionescu; Henning Müller; Renaud Péteri; Asma Ben Abacha; Dina Demner-Fushman; Sadid A. Hasan; Mourad Sarrouti; Obioma Pelka; Christoph M. Friedrich; Alba G. Seco de Herrera; Janadhip Jacutprakart; Vassili Kovalev; Serge Kozlovski; Vitali Liauchuk; Yashin Dicente Cid; Jon Chamberlain; Adrian Clark; Antonio Campello; Hassan Moustahfid; Thomas Oliver; Abigail Schulz; Paul Brie; Raul Berari; Dimitri Fichou; Andrei Tauteanu; Mihai Dogariu; Liviu Daniel Stefan; Mihai Gabriel Constantin; Jérôme Deshayes; Adrian Popescu

This paper presents the ideas for the 2021 ImageCLEF lab that will be organized as part of the Conference and Labs of the Evaluation Forum—CLEF Labs 2021 in Bucharest, Romania. ImageCLEF is an ongoing evaluation initiative (active since 2003) that promotes the evaluation of technologies for annotation, indexing and retrieval of visual data with the aim of providing information access to large collections of images in various usage scenarios and domains. In 2021, the 19th edition of ImageCLEF will organize four main tasks: (i) a Medical task addressing visual question answering, a concept annotation and a tuberculosis classification task, (ii) a Coral task addressing the annotation and localisation of substrates in coral reef images, (iii) a DrawnUI task addressing the creation of websites from either a drawing or a screenshot by detecting the different elements present on the design and a new (iv) Aware task addressing the prediction of real-life consequences of online photo sharing. The strong participation in 2020, despite the COVID pandemic, with over 115 research groups registering and 40 submitting over 295 runs for the tasks shows an important interest in this benchmarking campaign. We expect the new tasks to attract at least as many researchers for 2021.

Files (10.3 MB)
Name Size
UPB-ECIR2021-v2.pdf
md5:cf03f732f57d91aefca3d023763cd654
10.3 MB Download
19
15
views
downloads
Views 19
Downloads 15
Data volume 136.2 MB
Unique views 11
Unique downloads 11

Share

Cite as