A Task Category Space for User-Centric Comparative Multimedia Search Evaluations
Creators
- 1. Charles University Prague
- 2. JOANNEUM RESEARCH
- 3. HTW Berlin
- 4. Dublin City University
- 5. University of Basel
- 6. IT University of Copenhagen
- 7. University of Zurich
- 8. Klagenfurt University
- 9. ISTI CNR
- 10. Centre for Research and Technology Hellas
- 11. City University of Hong Kong
Description
In the last decade, user-centric video search competitions have facilitated the evolution of interactive video search systems. So far, these competitions focused on a small number of search task categories, with few attempts to change task category configurations. Based on our extensive experience with interactive video search contests, we have \mbox{analyzed} the spectrum of possible task categories and propose a list of individual axes that define a large space of possible task categories. Using this concept of category space, new user-centric video search competitions can be designed to benchmark video search systems from different perspectives. We further analyse the three task categories considered so far at the Video Browser Showdown and discuss possible (but sometimes challenging) shifts within the task category space.
Files
user_centric_video_search.pdf
Files
(399.7 kB)
Name | Size | Download all |
---|---|---|
md5:edd26f74c5c493be51a005e334eb5f3d
|
399.7 kB | Preview Download |