Published March 23, 2022 | Version 1.0
Conference paper Open

A Task Category Space for User-Centric Comparative Multimedia Search Evaluations

  • 1. Charles University Prague
  • 3. HTW Berlin
  • 4. Dublin City University
  • 5. University of Basel
  • 6. IT University of Copenhagen
  • 7. University of Zurich
  • 8. Klagenfurt University
  • 9. ISTI CNR
  • 10. Centre for Research and Technology Hellas
  • 11. City University of Hong Kong


In the last decade, user-centric video search competitions have facilitated the evolution of interactive video search systems. So far, these competitions focused on a small number of search task categories, with few attempts to change task category configurations. Based on our extensive experience with interactive video search contests, we have \mbox{analyzed} the spectrum of possible task categories and  propose a list of individual axes that define a large space of possible task categories. Using this concept of category space, new user-centric video search competitions can be designed to benchmark video search systems from different perspectives. We further analyse the three task categories considered so far at the Video Browser Showdown and discuss possible (but sometimes challenging) shifts within the task category space.



Files (399.7 kB)

Name Size Download all
399.7 kB Preview Download

Additional details


AI4Media – A European Excellence Centre for Media, Society and Democracy 951911
European Commission