Published October 15, 2022 | Version v1
Journal article Open

Illumination-Aware Image Fusion for Around-The-Clock Human Detection in Adverse Environments from Unmanned Aerial Vehicle

  • 1. School of Computing, Engineering and Physical Sciences, University of the West of Scotland, United Kingdom

Description

This study proposes a novel illumination-aware image fusion technique and a Convolutional Neural Network (CNN) called BlendNet to significantly enhance the robustness and real-time performance of small human objects detection from Unmanned Aerial Vehicles (UAVs) in harsh and adverse operation environments. The proposed solution is particular useful for missioncritical public safety applications such as search and rescue operations in rural areas. The operation environments of such missions are featured with poor illumination condition and complex background such as dense vegetation and undergrowth in diverse weather conditions, and the missions have to address the challenges of detecting humans from UAVs at high altitudes, with a moving platform and from various viewing angles. To overcome these challenges, the proposed solution register and fuse the images using Enhanced Correlation Coefficient (ECC) and arithmetic image addition with customized weights techniques. The result of this fusion is fuelled with our new BlendNet AI model achieving 95.01 % of accuracy with 42.2 Frames Per Second (FPS) on Titan X GPU with input size of 608 pixels. The effectiveness of the proposed fusion method has been evaluated and compared with other methods using the KAIST public dataset. The experimental results show competitive performance of BlendNet in terms of both visual quality as well as quantitative assessment of high detection accuracy at high speed.

Files

Illumination_aware_Image_Fusion_in_UAV_UWS.pdf

Files (17.0 MB)

Name Size Download all
md5:b1550120751c9c13a96ec67b92df08fc
17.0 MB Preview Download

Additional details

Funding

European Commission
5G-INDUCE – Open cooperative 5G experimentation platforms for the industrial sector NetApps 101016941