Kenzo Milleville
Alec Van den broeck
Rony Vissers
Bart Magnus
Nastasia Vanderperren
Astrid Vergauwe
Ellen Van Keer
Tom Ruette
Steven Verstockt
2022-05-04
<p>This demonstrator focuses on one of the end results of the FAME project [1]. The main focus of this project is the development of a generic open-source face recognition pipeline that can be applied on a broad variety of cultural heritage video/image archives, the performing arts collection of the Flanders Arts Institute [2] being one of them. Performing arts images/videos are among the most challenging types of video for face recognition given their dynamic and heterogeneous nature and the variety of domains they span. If it will work on this type of content, it will most probably also work on other types of archived content. </p>
<p>Due to the lack of accurate shot-level metadata, the searchability of performing art videos is still rather limited. Mostly they can only be queried based on some global metadata. Retrieving the exact shot(s) where an actor or dancer appears in the video, for example, is currently impossible. The shots can of course be manually annotated, but this is an error-prone and labour-intensive process, definitely when it needs to be performed on a large collection. Within the FAME project, we address this issue and proposes a video content annotation tool for the automatic annotation of faces in performing art videos. The resulting JSON metadata (which contains the Wikidata IDs of the recognized people and the timestamps when they appear in the video) is used in a video browser web application which allows to query the video based on the recognized performers and find the shots they appear in.</p>
https://doi.org/10.5281/zenodo.6517242
oai:zenodo.org:6517242
eng
Zenodo
https://zenodo.org/communities/dhbenelux2022
https://doi.org/10.5281/zenodo.6517241
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
DH Benelux 2022 - ReMIX: Creationand alterationin DH (hybrid), Belval Campus, Esch-sur-Alzette, Luxembourgand online, 1st - 3rd June 2022
demonstrator
face detection
video browser
metadata
FAME video browser – face recognition based metadata generation for performing art videos
info:eu-repo/semantics/conferencePaper