Published June 8, 2022 | Version v1
Conference paper Open

Consider the Head Movements! Saccade Computation in Mobile Eye-Tracking

  • 1. Technische Universität Wien/ Geoinformation/ 120.2

Description

Saccadic eye movements are known to serve as a suitable proxy for tasks prediction. In mobile eye-tracking, saccadic events are strongly influenced by head movements. Common attempts to compensate for head-movement effects either neglect saccadic events altogether or fuse gaze and head-movement signals measured by IMUs in order to simulate the gaze signal at head-level. Using image processing techniques, we propose a solution for computing saccades based on frames of the scene-camera video. In this method, fixations are first detected based on gaze positions specified in the coordinate system of each frame, and then respective frames are merged. Lastly, pairs of consecutive fixations –forming a saccade- are projected into the coordinate system of the stitched image using the homography matrices computed by the stitching algorithm. The results show a significant difference in length between projected and original saccades, and approximately 37% of error introduced by employing saccades without head-movement consideration.

Notes

This is the implementation of the proposed algorithm in Python. A sample data is also provided to run the code.

Files

4bwCZ9awAx_unfamiliar.csv

Files (25.4 MB)

Name Size Download all
md5:6e10c5224fe679c1dc85df826f76ecd5
18.6 MB Preview Download
md5:752e4f11060ea98ccc1bf897c1dfd44d
2.8 MB Preview Download
md5:cf58f24216d9395bd49eaa2401f0953b
7.3 kB Download
md5:e7287e59debf6f4a76d9e03d39dc3c93
3.6 kB Download
md5:6e26a1b9f63b493e37305b08e08e41b5
1.7 kB Preview Download
md5:5ea6bc04ccd27c09c47ec12836b2581e
4.0 MB Preview Download