Conference paper Open Access

Query and Keyframe Representations for Ad-hoc Video Search

Markatopoulou, Foteini; Galanopoulos, Damianos; Mezaris, Vasileios; Patras, Ioannis

This paper presents a fully-automatic method that combines video concept detection and textual query analysis in order to solve the problem of ad-hoc video search. We present a set of NLP steps that cleverly analyse different parts of the query in order to convert it to related semantic concepts, we propose a new method for transforming concept-based keyframe and query representations into a common semantic embedding space, and we show that our proposed combination of concept-based representations with their corresponding semantic embeddings results to improved video search accuracy. Our experiments in the TRECVID AVS 2016 and the Video Search 2008 datasets show the effectiveness of the proposed method compared to other similar approaches.

Files (777.0 kB)
Name Size
777.0 kB Download
Views 197
Downloads 138
Data volume 107.2 MB
Unique views 184
Unique downloads 137


Cite as