Journal article Open Access

Analysis of the Fuzziness of Image Caption Generation Models due to Data Augmentation Techniques

Kota Akshith Reddy; Satish C. J; Polsani Jahnavi; Chintapalli Teja Naveen; Gangapatnam Sai Ananya

Sponsor(s)
Blue Eyes Intelligence Engineering & Sciences Publication (BEIESP)

Automatic Image Caption Generation is one of the core problems in the field of Deep Learning. Data Augmentation is a technique which helps in increasing the amount of data at hand and this is done by augmenting the training data using various techniques like flipping, rotating, Zooming, Brightening, etc. In this work, we create an Image Captioning model and check its robustness on all the major types of Image Augmentation techniques. The results show the fuzziness of the model while working with the same image but a different augmentation technique and because of this, a different caption is produced every time a different data augmentation technique is employed. We also show the change in the performance of the model after applying these augmentation techniques. Flickr8k dataset is used for this study along with BLEU score as the evaluation metric for the image captioning model. 

Files (618.0 kB)
Name Size
C64390910321.pdf
md5:bfcfcbf2e69ea3834abd15268b68742d
618.0 kB Download
12
10
views
downloads
Views 12
Downloads 10
Data volume 6.2 MB
Unique views 10
Unique downloads 10

Share

Cite as