Investigating syntactic priming cumulative effects in MT-human interaction
Authors/Creators
- 1. School of Computing, Adapt Centre, Dublin City University, Dublin, Ireland
Description
Background: A question that deserves to be explored is whether the interaction between English language learners and the popular Google neural machine translation (GNMT) system could result in learning and increased production of a challenging syntactic structure in English that differs in word order between speakers first language and second language.
Methods: In this paper, we shed light on this issue by testing 30 Brazilian Portuguese L2 English speakers in order to investigate whether they tend to describe an image in English with a relation of possession between nouns using a prepositional noun phrase (e.g. the cover of the book is red) or re-use the alternative syntactic structure seen in the output of the GNMT (e.g. the book cover is red), thus manifesting syntactic priming effects. In addition, we tested whether, after continuous exposure to the challenging L2 structure through Google Translate output, speakers would adapt to that structure in the course of the experiment, thus manifesting syntactic priming cumulative effects.
Results: Our results show a robust syntactic priming effect as well as a robust cumulative effect.
Conclusions: These results suggest that GNMT can influence L2 English learners linguistic behaviour and that L2 English learners unconsciously learn from the GNMT with continuous exposure to its output.
Files
openreseurope-1-14986.pdf
Files
(2.0 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:1ff9bc346366e0653ef578510c4b886c
|
2.0 MB | Preview Download |
Additional details
References
- McCulloch WS, Pitts W (1943). A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys. doi:10.1007/BF02478259
- Collins AM, Loftus EF (1975). A spreading-activation theory of semantic processing. Psychol Rev. doi:10.1037/0033-295X.82.6.407
- Smith R (null). Russia 2018: the Google Translate World Cup.
- Groves M, Mundt K (2015). Friend or foe? Google Translate in language for academic purposes. English for Specific Purposes. doi:10.1016/j.esp.2014.09.001
- Garcia I, Pena MI (2011). Machine translation-assisted language learning: writing for beginners. Comput Assist Lang Learn. doi:10.1080/09588221.2011.582687
- Clifford J, Merschel L, Munné J (2013). Surveying the Landscape: What is the Role of Machine Translation in Language Learning?. Revista d'innovacio educativa. doi:10.7203/attic.10.2228
- Tin TB (2013). Exploring the Development of 'Interest' in Learning English as a Foreign/Second Language. RELC Journal. doi:10.1177/0033688213488388
- Seidlhofer B (2005). English as a lingua franca. ELT Journal. doi:10.1093/elt/cci064
- Weber K, Luther L, Indefrey P (2016). Overlap and Differences in Brain Networks Underlying the Processing of Complex Sentence Structures in Second Language Users Compared with Native Speakers. Brain Connect. doi:10.1089/brain.2015.0383
- Gass S, Mackey A, Ross-Feldman L (2005). Task-Based Interactions in Classroom and Laboratory Settings. Lang Learn. doi:10.1111/j.0023-8333.2005.00318.x
- Bock JK, Kroch AS (1989). The Isolability of Syntactic Processing. doi:10.1007/978-94-009-2729-2_5
- Bock JK (1986). Meaning, sound, and syntax: Lexical priming in sentence production. J Exp Psychol Learn Mem Cogn. doi:10.1037/0278-7393.12.4.575
- Bock JK (1986). Syntactic persistence in language production. Cogn Psychol. doi:10.1016/0010-0285(86)90004-6
- Bock K, Loebell H, Morey R (1992). From conceptual roles to structural relations: Bridging the syntactic cleft. Psychol Rev. doi:10.1037/0033-295x.99.1.150
- Heyselaar E, Hagoort P, Segaert K (2017). How social opinion influences syntactic processing-An investigation using virtual reality. PLoS One. doi:10.1371/journal.pone.0174405
- Heyselaar E, Hagoort P, Segaert K (2017). In dialogue with an avatar, language behavior is identical to dialogue with a human partner. Behav Res Methods. doi:10.1371/journal.pone.0174405
- Florian Jaeger T, Snider N (2007). Implicit Learning and Syntactic Persistence: Surprisal and Cumulativity. University of Rochester Working Papers in the Language Sciences.
- Cowan BR, Branigan HP, Obregón M (2015). Voice anthropomorphism, interlocutor modelling and alignment effects on syntactic choices in human−computer dialogue. Int J Hum Comput Stud. doi:10.1016/j.ijhcs.2015.05.008
- Resende N, Cowan B, Way A (2020). MT syntactic priming effects on L2 English speakers.
- Shin JA, Christianson K (2012). Structural Priming and Second Language Learning. Lang Learn. doi:10.1111/j.1467-9922.2011.00657.x
- Resende N, Way A (2021). Can Google Translate Rewire Your L2 English Processing?. Digital. doi:10.3390/digital1010006
- Kopp S (2010). Social resonance and embodied coordination in face-to-face conversation with artificial interlocutors. Speech Communication. doi:10.1016/j.specom.2010.02.007
- Segaert K, Menenti L, Weber K (2011). A Paradox of Syntactic Priming: Why Response Tendencies Show Priming for Passives, and Response Latencies Show Priming for Actives. PLoS One. doi:10.1371/journal.pone.0024209
- Traxler MJ (2008). Structural priming among prepositional phrases: Evidence from eye movements. Mem Cognit. doi:10.3758/mc.36.3.659
- Schoot L, Hagoort P, Segaert K (2019). Stronger Syntactic Alignment in the Presence of an Interlocutor. Front Psychol. doi:10.3389/fpsyg.2019.00685
- Pickering MJ, Ferreira VS (2008). Structural priming: A critical review. Psychol Bull. doi:10.1037/0033-2909.134.3.427
- Hartsuiker RJ, Westenberg C (2000). Word order priming in written and spoken sentence production. Cognition. doi:10.1016/s0010-0277(99)00080-3
- Hartsuiker RJ, Kolk HH (1998). Syntactic Persistence in Dutch. Lang Speech. doi:10.1177/002383099804100202
- Heyselaar E, Segaert K, Walvoort SJ (2016). The role of procedural memory in the skill for language: Evidence from syntactic priming in patients with amnesia.
- Kim Y, McDonough K (2008). The effect of interlocutor proficiency on the collaborative dialogue between Korean as a second language learners. Lang Teach Res. doi:10.1177/1362168807086288
- McDonough K (2006). Interaction and syntactic priming: English L2 speakers' production of dative constructions. Stud Second Lang Acquis. doi:10.1017/S0272263106060098
- McDonough K, Mackey A (2008). Syntactic priming and ESL question development. Stud Second Lang Acquis. doi:10.1017/S0272263108080029
- Corley M, Scheepers C (2002). Syntactic priming in English sentence production: Categorical and latency evidence from an Internet-based study. Psychon Bull Rev. doi:10.3758/bf03196267
- Smith S, Wheeldon L (2001). Syntactic priming in spoken sentence production - an online study. Cognition. doi:10.1016/s0010-0277(00)00110-4
- Wheeldon L, Smith M (2003). Phrase structure priming: A short-lived effect. Lang Cogn Process. doi:10.1080/01690960244000063
- Oviatt S, Darves C, Coulston R (2004). Toward Adaptive Conversational Interfaces: Modeling Speech Convergence with Animated Personas. ACM Trans Comput-Hum Interact. doi:10.1145/1017494.1017498
- Branigan HP, Pickering MJ, Pearson J (2003). Syntactic alignment between computers and people: the role of belief about mental states.
- Suzuki N, Katagiri Y (2007). Prosodic alignment in human-computer interaction. Connection Science. doi:10.1080/09540090701369125
- Bergmann K, Branigan HP, Kopp S (2015). Exploring the alignment space – lexical and gestural alignment with real and virtual humans. Frontiers in ICT. doi:10.3389/fict.2015.00007
- Stoyanchev S, Stent A (2009). Lexical and syntactic priming and their impact in deployed spoken dialog systems. doi:10.3115/1620853.1620905
- van Gompel RPG, Arai M (2018). Structural priming in bilinguals. Bilingualism: Language and Cognition. doi:10.1017/S1366728917000542
- Hartsuiker RJ, Pickering MJ, Veltkamp E (2004). Is Syntax Separate or Shared between Languages? Cross-Linguistic Syntactic Priming in Spanish-English Bilinguals. Psychol Sci. doi:10.1111/j.0956-7976.2004.00693.x
- McDonough K, Kim Y (2009). Syntactic Priming, Type Frequency, and EFL Learners' Production of -Questions. The Modern Language Journal. doi:10.1111/j.1540-4781.2009.00897.x
- McDonough K, Mackey A (2006). Responses to Recasts: Repetitions, Primed Production, and Linguistic Development. Lang Learn. doi:10.1111/j.1467-9922.2006.00393.x
- Florian Jaeger T, Snider NE (2013). Alignment as a consequence of expectation adaptation: syntactic priming is affected by the prime's prediction error given both prior and recent experience. Cognition. doi:10.1016/j.cognition.2012.10.013
- Resende N (2021). Dataset MTrill project. Zenodo.
- (2011). R: A language and environment for statistical computing.
- Bates D, Mächler M, Dai B (2011). lme4: Linear Mixed-Effects Models Using S4 Classes.