Published November 19, 2022 | Version v1
Video/Audio Open

Limitations of Audiovisual Speech on Robots for Second Language Pronunciation Learning

  • 1. The University of Electro-Communications
  • 2. Ghent University

Description

Additional material accompanying the HRI'23 publication found at https://doi.org/10.1145/3568162.3578633.

Simulations showing the audiovisual speech performed by Furhat during the second language tutoring experiment.

Each video consists of the Furhat saying a Dutch word, followed by saying the Japanese translation twice.

Videos M1-M10 correspond to the Matched condition, M11-M20 to Mismatched, and M21-M30 to the Computer-generated lip movement.

In the experiment, participants interacted with a physical Furhat, but as it is difficult to make video recordings of the Furhat, simulations are shown here to allow for high-fidelity comparison between conditions.

Files

M10_Trim.mp4

Files (18.1 MB)

Name Size Download all
md5:641d4341c6c4e7e9a1b436b1efab367c
513.2 kB Preview Download
md5:eb000f5e67d7756be98855516e156143
505.0 kB Preview Download
md5:ef0b6de3b53ef5e226d7e74a309f1ef3
453.4 kB Preview Download
md5:433f2581f10944816598b93a381928fe
467.3 kB Preview Download
md5:0ff7816939eb70760f878bf1866f3ff2
664.5 kB Preview Download
md5:24295c1981b79eea24c1a1fbfd62b4c0
718.2 kB Preview Download
md5:aed831a2729d9ca9fcd60bf09797bd44
737.8 kB Preview Download
md5:6a15f8133a857d099cded3fec5202b99
743.4 kB Preview Download
md5:5a0714fecf8c90122b03afaa2730590f
488.2 kB Preview Download
md5:2463845096672dda3c6b911b98d71a13
511.1 kB Preview Download
md5:905106fad11bf08ba00be17808a9027a
495.4 kB Preview Download
md5:781cd1be92dc0733d386351a9c8f4b5d
615.6 kB Preview Download
md5:01eb49f8909cc564c136e1336ab94fb9
386.2 kB Preview Download
md5:2ddb3c1c2177e44ca15d162b12087828
483.6 kB Preview Download
md5:736eac8c0b7052115ba6fb46c95ddb2e
534.5 kB Preview Download
md5:f9096847a9067156279f3d047389102e
599.2 kB Preview Download
md5:b84608b3ab6c043d6daf9f2eaf2eb451
662.6 kB Preview Download
md5:e8cf2f326ba554574149c1216f7aab9e
660.3 kB Preview Download
md5:9eb679aa913d25ac4029195f32aa76fb
614.3 kB Preview Download
md5:5342f5d9a239a1c9f36866bc6e85b54e
601.8 kB Preview Download
md5:065f1bf57b5c536d73adbc5159ae22ea
561.9 kB Preview Download
md5:6c6576ec71be8116600e53143441fd85
489.7 kB Preview Download
md5:1b90bdbc93c14b0c808285601f9d9d3d
620.3 kB Preview Download
md5:5328fe158e66334682b80d959ad91e7a
519.8 kB Preview Download
md5:b362f1a76cac1bcd3040894c8a2fcd8b
764.5 kB Preview Download
md5:a947f0ee22fc8fcd3ddd98a9fa9109fe
697.8 kB Preview Download
md5:708f57862d3a0f7c416f38014c7db506
794.7 kB Preview Download
md5:34829a7a5e8d19934eec769c7a5f6282
684.3 kB Preview Download
md5:ab0d51e327304afab721c63a4a921cdd
794.5 kB Preview Download
md5:628b877e9eeba66c459c909e4da98b22
668.2 kB Preview Download

Additional details

Related works

Is supplement to
Conference paper: 10.1145/3568162.3578633 (DOI)