Journal article Open Access

Vis Quelle: Visual Question-based Elementary Learning Companion a system to Facilitate Learning Word-Object Associations

Sandhya Vidyashankar; Rakshit Vahi; Yash Karkhanis; Gowri Srinivasa

Sponsor(s)
Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP)

We present an automated, visual question answering based companion – Vis Quelle - to facilitate elementary learning of word-object associations. In particular, we attempt to harness the power of machine learning models for object recognition and the understanding of combined processing of images and text data from visual-question answering to provide variety and nuance in the images associated with letters or words presented to the elementary learner. We incorporate elements such as gamification to motivate the learner by recording scores, errors, etc., to track the learner’s progress. Translation is also provided to reinforce word-object associations in the user’s native tongue, if the learner is using Vis Quelle to learn a second language. Keywords: Visual question answering; object recognition; question generation; question answering; word-object association.

Files (855.7 kB)
Name Size
A95991111121.pdf
md5:8e484b58cadca5ddd29f723f937aae47
855.7 kB Download
41
25
views
downloads
Views 41
Downloads 25
Data volume 21.4 MB
Unique views 40
Unique downloads 25

Share

Cite as