Journal article Open Access

Analysis of the Fuzziness of Image Caption Generation Models due to Data Augmentation Techniques

Kota Akshith Reddy; Satish C. J; Polsani Jahnavi; Chintapalli Teja Naveen; Gangapatnam Sai Ananya

Blue Eyes Intelligence Engineering & Sciences Publication (BEIESP)

Automatic Image Caption Generation is one of the core problems in the field of Deep Learning. Data Augmentation is a technique which helps in increasing the amount of data at hand and this is done by augmenting the training data using various techniques like flipping, rotating, Zooming, Brightening, etc. In this work, we create an Image Captioning model and check its robustness on all the major types of Image Augmentation techniques. The results show the fuzziness of the model while working with the same image but a different augmentation technique and because of this, a different caption is produced every time a different data augmentation technique is employed. We also show the change in the performance of the model after applying these augmentation techniques. Flickr8k dataset is used for this study along with BLEU score as the evaluation metric for the image captioning model. 

Files (618.0 kB)
Name Size
618.0 kB Download
Views 40
Downloads 44
Data volume 27.2 MB
Unique views 32
Unique downloads 44


Cite as