Published July 24, 2017 | Version v1
Technical note Open

The MAMEM Project - A dataset for multimodal human-computer interaction using biosignals and eye tracking information

  • 1. Center of Research and Technology Hellas
  • 2. 1. Center of Research and Technology Hellas, 2.Aristotle University of Thessaloniki, School of Sciences, Department of Informatics, Greece
  • 3. Institute for Web Science and Technologies, University of Koblenz-Landau, Germany
  • 4. 3rd University Department of Neurology, Aristotle University of Thessaloniki, Greece
  • 5. Department of Neurology, Hippokration General Hospital, Thessaloniki, Greece,
  • 6. Department of Neurological Rehabilitation, Chaim Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel
  • 7. Center of Advanced Technologies in Rehabilitation, Chaim Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel
  • 8. 1. Department of Neurological Rehabilitation, Chaim Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel, 2 Center of Advanced Technologies in Rehabilitation, Chaim Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel
  • 9. Human-Technology Interaction, Eindhoven University of Technology, The Netherlands
  • 10. Muscular Dystrophy Association, MDA Hellas, Greece
  • 11. EB Neuro S.p.A, Italy
  • 12. Senso Motoric Instruments - SMI, Germany

Description

In this report we present a dataset that combines multimodal biosignals and eye tracking
information gathered under a human-computer interaction framework. The dataset was developed in the
vein of the MAMEM project that aims to endow people with motor disabilities with the ability to edit and
author multimedia content through mental commands and gaze activity. The dataset includes EEG,
eye-tracking, and physiological (GSR and Heart rate) signals along with demographic, clinical and
behavioral data collected from 36 individuals (18 able-bodied and 18 motor-impaired). Data were
collected during the interaction with specifically designed interface for web browsing and multimedia
content manipulation and during imaginary movement tasks. Alongside these data we also include
evaluation reports both from the subjects and the experimenters as far as the experimental procedure and
collected dataset are concerned. We believe that the presented dataset will contribute towards the
development and evaluation of modern human-computer interaction systems that would foster the
integration of people with severe motor impairments back into society.

Files

MAMEM_Phase_I_Dataset_FullTechnicalReport(1).pdf

Files (867.2 kB)

Name Size Download all
md5:25a762db652039898f4b8d6d030fe942
867.2 kB Preview Download

Additional details

Funding

MAMEM – Multimedia Authoring and Management using your Eyes and Mind 644780
European Commission