Conference paper Open Access

Query and Keyframe Representations for Ad-hoc Video Search

Markatopoulou, Foteini; Galanopoulos, Damianos; Mezaris, Vasileios; Patras, Ioannis

This paper presents a fully-automatic method that combines video concept detection and textual query analysis in order to solve the problem of ad-hoc video search. We present a set of NLP steps that cleverly analyse different parts of the query in order to convert it to related semantic concepts, we propose a new method for transforming concept-based keyframe and query representations into a common semantic embedding space, and we show that our proposed combination of concept-based representations with their corresponding semantic embeddings results to improved video search accuracy. Our experiments in the TRECVID AVS 2016 and the Video Search 2008 datasets show the effectiveness of the proposed method compared to other similar approaches.

Files (777.0 kB)
Name Size
icmr17_1_preprint.pdf md5:2b78b66b9f9e9b178be9ae8d9f58654a 777.0 kB Download


Cite as