Published April 30, 2024 | Version v1
Conference paper Open

Face Recognition In Harsh Conditions: An Acoustic Based Approach

  • 1. ROR icon Nanyang Technological University
  • 1. ROR icon Alibaba Group (China)
  • 2. ROR icon Hong Kong University of Science and Technology
  • 3. University at Buffalo, SUNY

Description

This project develops an innovative acoustic-based facial recognition system that is designed to maintain robust performance even in situations where facial masks obstruct visibility. The system operates through two key components: a signal processing module that translates raw acoustic signals into explicit 3D facial representations, and a deep learning model for recognition and discrimination, ensuring high accuracy even when facial masks are present. 

The uploaded codebase accompanying this paper provides a full-stack implementation of the proposed system, comprising the signal processing code for extracting facial spectrums and the implementation of the deep learning model for spectrum recognition. Additionally, this artifact includes a self-constructed dataset, enabling evaluation of system performance across various usage scenarios. 

Please access and download the dataset with this link: https://mega.nz/folder/hwA23I7Y

Files

AcFace.zip

Files (2.4 GB)

Name Size Download all
md5:4b0e33de0a2e4fec70a7bc270c027fb2
2.4 GB Preview Download

Additional details

Dates

Accepted
2024-05-01

Software

Repository URL
https://mega.nz/folder/hwA23I7Y
Programming language
Python, MATLAB, Vim Script