<?xml version='1.0' encoding='utf-8'?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<article article-type="research-article" dtd-version="1.2" xml:lang="ru" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><front><journal-meta><journal-id journal-id-type="issn">2313-8912</journal-id><journal-title-group><journal-title>Research Result. Theoretical and Applied Linguistics</journal-title></journal-title-group><issn pub-type="epub">2313-8912</issn></journal-meta><article-meta><article-id pub-id-type="doi">10.18413/2313-8912-2023-9-1-0-7</article-id><article-id pub-id-type="publisher-id">3066</article-id><article-categories><subj-group subj-group-type="heading"><subject>COGNITIVE MECHANISMS OF TEXT COMPREHENSION</subject></subj-group></article-categories><title-group><article-title>&lt;strong&gt;Silent, but salient: gestures in simultaneous interpreting&lt;/strong&gt;</article-title><trans-title-group xml:lang="en"><trans-title>&lt;strong&gt;Silent, but salient: gestures in simultaneous interpreting&lt;/strong&gt;</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Iriskhanova</surname><given-names>Olga K.</given-names></name><name xml:lang="en"><surname>Iriskhanova</surname><given-names>Olga K.</given-names></name></name-alternatives><email>oiriskhanova@gmail.com</email><xref ref-type="aff" rid="aff1" /></contrib><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Cienki</surname><given-names>Alan</given-names></name><name xml:lang="en"><surname>Cienki</surname><given-names>Alan</given-names></name></name-alternatives><email>a.cienki@vu.nl</email><xref ref-type="aff" rid="aff2" /></contrib><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Tomskaya</surname><given-names>Maria V.</given-names></name><name xml:lang="en"><surname>Tomskaya</surname><given-names>Maria V.</given-names></name></name-alternatives><email>maria.tomskaya@mail.ru</email><xref ref-type="aff" rid="aff1" /></contrib><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Nikolayeva</surname><given-names>Alina I.</given-names></name><name xml:lang="en"><surname>Nikolayeva</surname><given-names>Alina I.</given-names></name></name-alternatives><email>alinamakoveyeva@gmail.com</email><xref ref-type="aff" rid="aff1" /></contrib></contrib-group><aff id="aff2"><institution>Vrije Universiteit Amsterdam, Amsterdam, Netherlands</institution></aff><aff id="aff1"><institution>Moscow State Linguistic University, Russia</institution></aff><pub-date pub-type="epub"><year>2023</year></pub-date><volume>9</volume><issue>1</issue><fpage>0</fpage><lpage>0</lpage><self-uri content-type="pdf" xlink:href="/media/linguistics/2023/1/Лингвистика_9_1_2023-99-114.pdf" /><abstract xml:lang="ru"><p>Salience is regarded as one of the key concepts for cognitive studies of language and communication, however there is limited research on how prominence plays out in multimodal discourse. The present study is aimed at investigating how salience comes through in gestures used by simultaneous interpreters.&amp;nbsp; To distinguish between salient and non-salient gestures by the same participant, two groups of observable parameters were chosen &amp;ndash; basic and auxiliary. An empirical study was carried out, based on simultaneous interpreting of the audio of a TED talk (English &amp;reg; &amp;nbsp;Russian). The video recordings were integrated into ELAN files and annotated for salient gestures, the functions that were realized by them, and the elementary discourse units (EDUs) that the gestures co-occurred with. It was assumed that, first, salient gestures will be observed less frequently than non-salient gestures; second, prominence in gestures will serve the function of representing various aspects of a situation more often than other functions; third, salient gestures will co-occur more often with elementary discourse units (EDU) containing verb phrases, rather than noun phrases. The hypotheses were partially confirmed via quantitative and qualitative analyses which demonstrated that&amp;nbsp; every third gesture was salient; the representative function came second after the pragmatic functions; there was no significant difference between the number of gestures used with verbal and nominal EDUs, though it was observed that salient gestures tend to co-occur with the verbs of physical actions and negation, as well as with the nouns accompanied by attributes denoting high degree of a quality.</p></abstract><trans-abstract xml:lang="en"><p>Salience is regarded as one of the key concepts for cognitive studies of language and communication, however there is limited research on how prominence plays out in multimodal discourse. The present study is aimed at investigating how salience comes through in gestures used by simultaneous interpreters.&amp;nbsp; To distinguish between salient and non-salient gestures by the same participant, two groups of observable parameters were chosen &amp;ndash; basic and auxiliary. An empirical study was carried out, based on simultaneous interpreting of the audio of a TED talk (English &amp;reg; &amp;nbsp;Russian). The video recordings were integrated into ELAN files and annotated for salient gestures, the functions that were realized by them, and the elementary discourse units (EDUs) that the gestures co-occurred with. It was assumed that, first, salient gestures will be observed less frequently than non-salient gestures; second, prominence in gestures will serve the function of representing various aspects of a situation more often than other functions; third, salient gestures will co-occur more often with elementary discourse units (EDU) containing verb phrases, rather than noun phrases. The hypotheses were partially confirmed via quantitative and qualitative analyses which demonstrated that&amp;nbsp; every third gesture was salient; the representative function came second after the pragmatic functions; there was no significant difference between the number of gestures used with verbal and nominal EDUs, though it was observed that salient gestures tend to co-occur with the verbs of physical actions and negation, as well as with the nouns accompanied by attributes denoting high degree of a quality.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>Salience</kwd><kwd>Simultaneous interpretation</kwd><kwd>Gesture</kwd><kwd>Adapter</kwd><kwd>Pragmatic gesture</kwd><kwd>Representational gesture</kwd><kwd>Deictic gesture</kwd><kwd>Beat</kwd><kwd>Elementary discourse unit</kwd></kwd-group><kwd-group xml:lang="en"><kwd>Salience</kwd><kwd>Simultaneous interpretation</kwd><kwd>Gesture</kwd><kwd>Adapter</kwd><kwd>Pragmatic gesture</kwd><kwd>Representational gesture</kwd><kwd>Deictic gesture</kwd><kwd>Beat</kwd><kwd>Elementary discourse unit</kwd></kwd-group></article-meta></front><back><ack><p>The research was carried out at Moscow State Linguistic University and supported by the Russian Science Foundation (Grant No 19-18-00357)</p></ack><ref-list><title>Список литературы</title><ref id="B1"><mixed-citation>Beattie,&amp;nbsp;G., Webster,&amp;nbsp;K. and Ross,&amp;nbsp;J. (2010). The fixation and processing of the iconic gestures that accompany talk, Journal of Language and Social Psychology, 29&amp;nbsp;(2), 1-30 https://doi.org/10.1177/0261927X09359589 (In English)</mixed-citation></ref><ref id="B2"><mixed-citation>Boutet, D. (2010). Structuration physiologique de la gestuelle: Modèle et tests, Lidil, 42, 77-96. https://doi.org/10.4000/lidil.3070 (In English)</mixed-citation></ref><ref id="B3"><mixed-citation>Boutet,&amp;nbsp;D., Morgenstern,&amp;nbsp;A. and Cienki,&amp;nbsp;A. (2016). Grammatical aspect and gesture in French: A kinesiological approach, Russian Journal of Linguistics, 20&amp;nbsp;(3), 132-151. (In English)</mixed-citation></ref><ref id="B4"><mixed-citation>Bressem,&amp;nbsp;J. (2013). A linguistic perspective on the notation of form features in gestures, in Müller,&amp;nbsp;C., Cienki,&amp;nbsp;A., Fricke,&amp;nbsp;E., Ladewig,&amp;nbsp;S., McNeill,&amp;nbsp;D. and Te&amp;szlig;endorf,&amp;nbsp;S. (eds.), Body &amp;ndash; Language &amp;ndash; Communication: An international handbook on multimodality in human interaction, Vol. 1, Mouton de Gruyter, Berlin, Germany, 1079-1098. (In English)</mixed-citation></ref><ref id="B5"><mixed-citation>Cavicchio,&amp;nbsp;F. and Kita,&amp;nbsp;S. (2013). Bilinguals switch gesture production parameters when they switch languages, Proceedings of the Tilburg Gesture Research Meeting (TIGeR 2013), Tilburg University, Netherlands, 305-309. (In English)</mixed-citation></ref><ref id="B6"><mixed-citation>Cienki,&amp;nbsp;A. (2013). Cognitive linguistics: Spoken language and gesture as expressions of conceptualization, in Müller,&amp;nbsp;C., Cienki,&amp;nbsp;A., Fricke,&amp;nbsp;E., Ladewig,&amp;nbsp;S., McNeill,&amp;nbsp;D. and Te&amp;szlig;endorf,&amp;nbsp;S. (eds.), Body &amp;ndash; Language &amp;ndash; Communication: An international handbook on multimodality in human interaction, Vol. 1, Mouton de Gruyter, Berlin, Germany, 182-201. https://doi.org/10.1515/9783110261318.182 (In English)</mixed-citation></ref><ref id="B7"><mixed-citation>Cienki,&amp;nbsp;A. (2021). From the finger lift to the palm-up open hand when presenting a point: A methodological exploration of forms and functions, Languages and Modalities, 1&amp;nbsp;(1), 17-30, https://doi.org/10.3897/lamo.1.68914 (In English)</mixed-citation></ref><ref id="B8"><mixed-citation>Cienki,&amp;nbsp;A. and Iriskhanova,&amp;nbsp;O.&amp;nbsp;K. (2020). Patterns of multimodal behavior under cognitive load: An analysis of simultaneous interpretation from L2 to L1, Voprosy Kognitivnoy Lingvistiki, 1, 5-11. https://doi.org/10.20916/1812-3228-2020-1-5-11 (In English)</mixed-citation></ref><ref id="B9"><mixed-citation>Cienki, A. and Mittelberg,&amp;nbsp;I. (2013). Creativity in the forms and functions of spontaneous gesture with speech, in Veale,&amp;nbsp;T., Feyaerts,&amp;nbsp;K.&amp;nbsp;and Forceville,&amp;nbsp;C. (eds.), The Agile Mind: A Multi-disciplinary Study of a Multi-faceted Phenomenon, Mouton de Gruyter, Berlin, Germany, 231-252. (In English)</mixed-citation></ref><ref id="B10"><mixed-citation>Cienki,&amp;nbsp;A. and Müller,&amp;nbsp;C. (2008). Metaphor, gesture and thought, in Gibbs,&amp;nbsp;R.&amp;nbsp;W.&amp;nbsp;Jr. (ed.), The Cambridge Handbook of Metaphor and Thought, Cambridge University Press, Cambridge, UK, 484-501. (In English)</mixed-citation></ref><ref id="B11"><mixed-citation>Eisenstein,&amp;nbsp;J., Barzilay,&amp;nbsp;R. and Davis,&amp;nbsp;R. (2007). Turning lectures into comic books using linguistically salient gestures, Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, Vancouver, British Columbia, Canada, 877-882. (In English)</mixed-citation></ref><ref id="B12"><mixed-citation>Fedorova,&amp;nbsp;O.&amp;nbsp;V. and Zherdev,&amp;nbsp;I.&amp;nbsp;Ju. (2019). Follow the hands of the interlocutor! (On strategies for the distribution of visual attention), Experimental Psychology, 12&amp;nbsp;(1), 98-118. https://doi.org/10.17759/exppsy.2019120108 (In English)</mixed-citation></ref><ref id="B13"><mixed-citation>Gile,&amp;nbsp;D. (1997). Conference interpreting as a cognitive management problem, in Danks,&amp;nbsp;J.&amp;nbsp;H., Fountain,&amp;nbsp;S.&amp;nbsp;B., McBeath,&amp;nbsp;M.&amp;nbsp;K. and Shreve,&amp;nbsp;G.&amp;nbsp;M. (eds.), Cognitive Processes in Translation and Interpreting, Sage Publications, Thousand Oaks, London, New Delhi, India, 196-214. (In English)</mixed-citation></ref><ref id="B14"><mixed-citation>Givon,&amp;nbsp;T. (1985). Iconicity, Isomorphism, and non-arbitrary coding in syntax, in Haiman,&amp;nbsp;J. (ed.), Iconicity in Syntax, Benjamins, Amsterdam, The Netherlands, 187-219. (In English)</mixed-citation></ref><ref id="B15"><mixed-citation>Grishina,&amp;nbsp;E.&amp;nbsp;A. (2017). Russkaya zhestikulyaciya s lingvisticheskoj tochki zreniya (korpusnye issledovaniya) [Russian gesticulation in linguistic aspect: Corpus studies], Yazyki slavyanskoj kul&amp;#39;tury, Izdatel&amp;#39;skij Dom YASK, Moscow, Russia. (In Russian)</mixed-citation></ref><ref id="B16"><mixed-citation>Gullberg, M. and Holmqvist,&amp;nbsp;K. (1999). Keeping an eye on gestures: Visual perception of gestures in face-to-face communication, Pragmatics &amp;amp; Cognition, 7&amp;nbsp;(1), 35-63. https://doi.org/10.1075/pc.7.1.04gul (In English)</mixed-citation></ref><ref id="B17"><mixed-citation>Gullberg,&amp;nbsp;M. and Holmqvist,&amp;nbsp;K. (2002). Visual attention towards gestures in face-to-face interaction vs. on screen, in Wachsmuth,&amp;nbsp;I. and Sowa,&amp;nbsp;T. (eds.), Gesture and Sign Language Based Human-Computer Interaction, Springer-Verlag, Berlin, Germany, 206-214. (In English)</mixed-citation></ref><ref id="B18"><mixed-citation>Haiman,&amp;nbsp;J. (1985). Natural Syntax, Cambridge University Press, Cambridge, UK. (In English)</mixed-citation></ref><ref id="B19"><mixed-citation>Iriskhanova,&amp;nbsp;O.&amp;nbsp;K. and Cienki,&amp;nbsp;A. (2018). The semiotics of gestures in cognitive linguistics: Contributions and challenges, Voprosy Kognitivnoy Lingvistiki, 4, 25-36. https://doi.org/10.20916/1812-3228-2018-4-25-36 (In English)</mixed-citation></ref><ref id="B20"><mixed-citation>Kendon,&amp;nbsp;A. (2004). Gesture: Visible action as utterance, Cambridge University Press, Cambridge, UK. (In English)</mixed-citation></ref><ref id="B21"><mixed-citation>Kibrik,&amp;nbsp;A.&amp;nbsp;A. and Podlesskaya,&amp;nbsp;V.&amp;nbsp;P. (eds.) (2009). Rasskazy o snovideniyakh: korpusnoye issledovaniye ustnogo russkogo diskursa [Nightdream stories: case study of Russian spoken discourse], Languages of Slavic culture, Moscow, Russia. (In Russian)</mixed-citation></ref><ref id="B22"><mixed-citation>Langacker,&amp;nbsp;R. (2000). Grammar and Conceptualization, Mouton de Gruyter, Berlin, Germany. (In English)</mixed-citation></ref><ref id="B23"><mixed-citation>Marian,&amp;nbsp;V., Blumenfield,&amp;nbsp;H.&amp;nbsp;K. and Kaushanskaya,&amp;nbsp;M. (2007). The language experience and proficiency questionnaire (LEAP-Q) assessing language profiles in bilinguals and multilinguals, Journal of Speech, Language, and Hearing Research, 50, 940-967. https://doi.org/10.1017/S1366728919000038 (In English)</mixed-citation></ref><ref id="B24"><mixed-citation>McNeill,&amp;nbsp;D. (1992). Hand and mind: What gestures reveal about thought, University of Chicago Press, Chicago, USA. (In English)</mixed-citation></ref><ref id="B25"><mixed-citation>McNeill,&amp;nbsp;D. (2005). Gesture and thought, University of Chicago Press, Chicago, USA. (In English)</mixed-citation></ref><ref id="B26"><mixed-citation>Müller,&amp;nbsp;C. (1998). Redebegleitende Gesten. Kulturgeschichte &amp;ndash; Theorie &amp;ndash; Sprachvergleich [Speech-accompanying gestures. Cultural history &amp;ndash; theory &amp;ndash; language comparison], Berlin Verlag, Berlin, Germany. (In German)</mixed-citation></ref><ref id="B27"><mixed-citation>Müller,&amp;nbsp;C. (2016). From mimesis to meaning: A systematics of gestural mimesis for concrete and abstract referential gestures, in Zlatev,&amp;nbsp;J., Sonesson,&amp;nbsp;G. and Konderak,&amp;nbsp;P. (eds.), Meaning, mind and communication: Explorations in cognitive semiotics, Peter Lang, Frankfurt am Main, Germany. (In English)</mixed-citation></ref><ref id="B28"><mixed-citation>Müller,&amp;nbsp;C. and Tag,&amp;nbsp;S. (2010). The dynamics of metaphor: Foregrounding and activating metaphoricity in conversational interaction, Cognitive Semiotics, 10&amp;nbsp;(6), 85-120. https://doi.org/10.1515/cogsem.2010.6.spring2010.85 (In English)</mixed-citation></ref><ref id="B29"><mixed-citation>O&amp;rsquo;Connor,&amp;nbsp;M. and Cienki,&amp;nbsp;A. (2022). The materiality of lines: The kinaesthetics of bodily movement uniting dance and prehistoric cave art, Frontiers in Communication, 7. https://doi.org/10.3389/fcomm.2022.956967 (In English)</mixed-citation></ref><ref id="B30"><mixed-citation>Oakley,&amp;nbsp;T. (2009). From attention to meaning: explorations in semiotics, Linguistics and Rhetoric, Peter Lang, Bern&amp;ndash;Berlin, Germany. (In English)</mixed-citation></ref><ref id="B31"><mixed-citation>Oben,&amp;nbsp;B. and Br&amp;ocirc;ne,&amp;nbsp;G. (2015). What you see is what you do: on the relationship between gaze and gesture in multimodal alignment, Language and Cognition, 7&amp;nbsp;(04), 546-562. https://doi.org/10.1017/langcog.2015.22 (In English)</mixed-citation></ref><ref id="B32"><mixed-citation>Seeber,&amp;nbsp;K.&amp;nbsp;G. (2013). Cognitive load in simultaneous interpreting, Target, 25&amp;nbsp;(1), 18-32. https://doi.org/10.1075/target.25.1.03see (In English)</mixed-citation></ref><ref id="B33"><mixed-citation>Stachowiak-Szymczak,&amp;nbsp;K. (2019). Eye movements and gestures in simultaneous and consecutive interpreting, Springer, Basel, Switzerland. (In English)</mixed-citation></ref><ref id="B34"><mixed-citation>Sweetser, E. (2007). Looking at space to study mental spaces: Co-speech gesture as a crucial data source in cognitive linguistics, in Gonzalez-Marquez,&amp;nbsp;M., Mittelberg,&amp;nbsp;I., Coulson,&amp;nbsp;S. and Spivey,&amp;nbsp;M.&amp;nbsp;J. (eds.), Methods in Cognitive Linguistics, John Benjamins, Amsterdam, Netherlands, 201-224. (In English)</mixed-citation></ref><ref id="B35"><mixed-citation>Talmy,&amp;nbsp;L. (1978). Figure and ground in complex sentences, in Greenberg,&amp;nbsp;J. (ed.), Universals of Human Language, Stanford University Press, Stanford, USA, 625-649. (In English)</mixed-citation></ref><ref id="B36"><mixed-citation>Tellier,&amp;nbsp;M., Stam,&amp;nbsp;G. and Ghio,&amp;nbsp;A. (2021). Handling language: How future language teachers adapt their gestures to their interlocutor, Gesture, 20&amp;nbsp;(1), 30-62. https://doi.org/10.1075/gest.19031.tel (In English)</mixed-citation></ref><ref id="B37"><mixed-citation>Wagner,&amp;nbsp;P., Malisz,&amp;nbsp;Z. and Kopp,&amp;nbsp;S. (2014). Gesture and speech in interaction: An overview, Speech Communication, 57, 209-232. https://doi.org/10.1016/j.specom.2013.09.008 (In English)</mixed-citation></ref></ref-list></back></article>