Conference paper Open Access

Query and Keyframe Representations for Ad-hoc Video Search

Markatopoulou, Foteini; Galanopoulos, Damianos; Mezaris, Vasileios; Patras, Ioannis

This paper presents a fully-automatic method that combines video concept detection and textual query analysis in order to solve the problem of ad-hoc video search. We present a set of NLP steps that cleverly analyse different parts of the query in order to convert it to related semantic concepts, we propose a new method for transforming concept-based keyframe and query representations into a common semantic embedding space, and we show that our proposed combination of concept-based representations with their corresponding semantic embeddings results to improved video search accuracy. Our experiments in the TRECVID AVS 2016 and the Video Search 2008 datasets show the effectiveness of the proposed method compared to other similar approaches.

Files (777.0 kB)
Name Size
777.0 kB Download
Views 247
Downloads 175
Data volume 136.0 MB
Unique views 219
Unique downloads 173


Cite as