D4.1: Natural Multimodal Interaction Baseline

The present report describes the work carried out in the first project year regarding Natural Multimodal Interaction. It summarizes the Deliverable D4.1: “Natural Multimodal Interaction Baseline”. We defined a new formalism for the specification of dialogue policies that combines dialogue rules, knowledge representation and dialogue history in a unique way. We developed the first version of an ontology which specifies the data structures to be used by the dialogue specifications, dialogue history, and information state, and adapted our reasoning components, so that this knowledge source can be used efficiently once the formalism specification is fully implemented. We implemented a prototype for the experiments in year 1, which provide us with interaction data that can be used later to develop and evaluate the components in this work package.