Conference paper Open Access

Multimodal Video Annotation for Retrieval and Discovery of Newsworthy Video in a News Verication Scenario

Nixon, Lyndon; Apostolidis, Evlampios; Markatopoulou, Foteini; Patras, Ioannis; Mezaris, Vasileios

This paper describes the combination of advanced technologies for social-media-based story detection, story-based video retrieval and concept-based video (fragment) labeling under a novel approach for multimodal video annotation. This approach involves textual metadata, structural information and visual concepts - and a multimodal analytics dashboard that enables journalists to discover videos of news events, posted to social networks, in order to verify the details of the events shown. It outlines the characteristics of each individual method and describes how these techniques are blended to facilitate the content-based retrieval, discovery and summarization of (parts of) news videos. A set of case-driven experiments conducted with the help of journalists, indicate that the proposed multimodal video annotation mechanism - combined with a professional analytics dashboard which presents the collected and generated metadata about the news stories and their visual summaries - can support journalists in their content discovery and verication work.

Files (777.9 kB)
Name Size
mmm19_lncs11295_3_preprint.pdf
md5:ebce7141cb0c9f1890bbf711668ba3ab
777.9 kB Download
13
12
views
downloads
Views 13
Downloads 12
Data volume 9.3 MB
Unique views 11
Unique downloads 8

Share

Cite as