Limitations of Audiovisual Speech on Robots for Second Language Pronunciation Learning
Authors/Creators
- 1. The University of Electro-Communications
- 2. Ghent University
Description
Additional material accompanying the HRI'23 publication found at https://doi.org/10.1145/3568162.3578633.
Simulations showing the audiovisual speech performed by Furhat during the second language tutoring experiment.
Each video consists of the Furhat saying a Dutch word, followed by saying the Japanese translation twice.
Videos M1-M10 correspond to the Matched condition, M11-M20 to Mismatched, and M21-M30 to the Computer-generated lip movement.
In the experiment, participants interacted with a physical Furhat, but as it is difficult to make video recordings of the Furhat, simulations are shown here to allow for high-fidelity comparison between conditions.
Files
M10_Trim.mp4
Files
(18.1 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:641d4341c6c4e7e9a1b436b1efab367c
|
513.2 kB | Preview Download |
|
md5:eb000f5e67d7756be98855516e156143
|
505.0 kB | Preview Download |
|
md5:ef0b6de3b53ef5e226d7e74a309f1ef3
|
453.4 kB | Preview Download |
|
md5:433f2581f10944816598b93a381928fe
|
467.3 kB | Preview Download |
|
md5:0ff7816939eb70760f878bf1866f3ff2
|
664.5 kB | Preview Download |
|
md5:24295c1981b79eea24c1a1fbfd62b4c0
|
718.2 kB | Preview Download |
|
md5:aed831a2729d9ca9fcd60bf09797bd44
|
737.8 kB | Preview Download |
|
md5:6a15f8133a857d099cded3fec5202b99
|
743.4 kB | Preview Download |
|
md5:5a0714fecf8c90122b03afaa2730590f
|
488.2 kB | Preview Download |
|
md5:2463845096672dda3c6b911b98d71a13
|
511.1 kB | Preview Download |
|
md5:905106fad11bf08ba00be17808a9027a
|
495.4 kB | Preview Download |
|
md5:781cd1be92dc0733d386351a9c8f4b5d
|
615.6 kB | Preview Download |
|
md5:01eb49f8909cc564c136e1336ab94fb9
|
386.2 kB | Preview Download |
|
md5:2ddb3c1c2177e44ca15d162b12087828
|
483.6 kB | Preview Download |
|
md5:736eac8c0b7052115ba6fb46c95ddb2e
|
534.5 kB | Preview Download |
|
md5:f9096847a9067156279f3d047389102e
|
599.2 kB | Preview Download |
|
md5:b84608b3ab6c043d6daf9f2eaf2eb451
|
662.6 kB | Preview Download |
|
md5:e8cf2f326ba554574149c1216f7aab9e
|
660.3 kB | Preview Download |
|
md5:9eb679aa913d25ac4029195f32aa76fb
|
614.3 kB | Preview Download |
|
md5:5342f5d9a239a1c9f36866bc6e85b54e
|
601.8 kB | Preview Download |
|
md5:065f1bf57b5c536d73adbc5159ae22ea
|
561.9 kB | Preview Download |
|
md5:6c6576ec71be8116600e53143441fd85
|
489.7 kB | Preview Download |
|
md5:1b90bdbc93c14b0c808285601f9d9d3d
|
620.3 kB | Preview Download |
|
md5:5328fe158e66334682b80d959ad91e7a
|
519.8 kB | Preview Download |
|
md5:b362f1a76cac1bcd3040894c8a2fcd8b
|
764.5 kB | Preview Download |
|
md5:a947f0ee22fc8fcd3ddd98a9fa9109fe
|
697.8 kB | Preview Download |
|
md5:708f57862d3a0f7c416f38014c7db506
|
794.7 kB | Preview Download |
|
md5:34829a7a5e8d19934eec769c7a5f6282
|
684.3 kB | Preview Download |
|
md5:ab0d51e327304afab721c63a4a921cdd
|
794.5 kB | Preview Download |
|
md5:628b877e9eeba66c459c909e4da98b22
|
668.2 kB | Preview Download |
Additional details
Related works
- Is supplement to
- Conference paper: 10.1145/3568162.3578633 (DOI)