<?xml version='1.0' encoding='utf-8'?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<article article-type="research-article" dtd-version="1.2" xml:lang="ru" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><front><journal-meta><journal-id journal-id-type="issn">2313-8912</journal-id><journal-title-group><journal-title>Research Result. Theoretical and Applied Linguistics</journal-title></journal-title-group><issn pub-type="epub">2313-8912</issn></journal-meta><article-meta><article-id pub-id-type="doi">10.18413/2313-8912-2023-9-1-0-6</article-id><article-id pub-id-type="publisher-id">3065</article-id><article-categories><subj-group subj-group-type="heading"><subject>COGNITIVE MECHANISMS OF TEXT COMPREHENSION</subject></subj-group></article-categories><title-group><article-title>&lt;strong&gt;Numbers in simultaneous interpreting: a multimodal analysis&lt;/strong&gt;</article-title><trans-title-group xml:lang="en"><trans-title>&lt;strong&gt;Numbers in simultaneous interpreting: a multimodal analysis&lt;/strong&gt;</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Cienki</surname><given-names>Alan</given-names></name><name xml:lang="en"><surname>Cienki</surname><given-names>Alan</given-names></name></name-alternatives><email>a.cienki@vu.nl</email><xref ref-type="aff" rid="aff1" /></contrib><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Leonteva</surname><given-names>Anna V.</given-names></name><name xml:lang="en"><surname>Leonteva</surname><given-names>Anna V.</given-names></name></name-alternatives><email>lentevanja27@gmail.com</email><xref ref-type="aff" rid="aff2" /></contrib><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Agafonova</surname><given-names>Olga V.</given-names></name><name xml:lang="en"><surname>Agafonova</surname><given-names>Olga V.</given-names></name></name-alternatives><email>olga.agafonova92@gmail.com</email><xref ref-type="aff" rid="aff3" /></contrib><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Petrov</surname><given-names>Andrey A.</given-names></name><name xml:lang="en"><surname>Petrov</surname><given-names>Andrey A.</given-names></name></name-alternatives><email>petrov@linguanet.ru</email><xref ref-type="aff" rid="aff3" /></contrib></contrib-group><aff id="aff2"><institution>Moscow State Linguistic University, Institute of Linguistics, RAS, Russia</institution></aff><aff id="aff3"><institution>Moscow State Linguistic University, Russia</institution></aff><aff id="aff1"><institution>Vrije Universiteit Amsterdam, Amsterdam, Netherlands</institution></aff><pub-date pub-type="epub"><year>2023</year></pub-date><volume>9</volume><issue>1</issue><fpage>0</fpage><lpage>0</lpage><self-uri content-type="pdf" xlink:href="/media/linguistics/2023/1/Лингвистика_9_1_2023-82-98.pdf" /><abstract xml:lang="ru"><p>Simultaneous interpreting (SI) is considered to be a highly demanding cognitive task, especially in regard to elements which represent a stumbling block during SI (e.g. numbers, idiomatic expressions, etc.). The current study examines the use of numbers in SI in combination with co-speech gestures. The issue of interpreting numbers has been addressed by different scholars, however it has rarely been studied from the multimodal perspective so far. Given the known role of gesture during processes of lexical retrieval, we hypothesize that the use of co-speech manual gestures plays a significant role in the process of interpreting numbers, i.e. facilitates mental retrieval of the target number.&amp;nbsp;In addition to the hypothesis to be tested, we consider the exploratory question as to whether any gestures with numbers correlate more with an externalized or internalized function, that is: either representation of the numerical concept externally (metaphorical depiction of the quantified entity as an object or space that could be touched or pointed to) or more with self-adapters to help the interpreter manage the cognitive load/stress internally. A corpus of 10 recordings of English-to-Russian SI sessions was analyzed. The interpreting of numbers was analyzed as being correct, incorrect or absent. The analysis of the material showed that the participants mostly interpreted numbers correctly or omitted them in their speech. The results of the analysis of co-speech gestures demonstrated nearly equal use of gesture and no gesture when interpreting numbers, however, there was a significant correlation between interpreting certain number categories and gesture use. Then the following types of gesture functions were analyzed: adapters, pragmatic, representational and deictic. The results indicate that self-adapters were the most frequent gesture type used. This finding can be interpreted based on the literature showing self-adapters ease tension and anxiety and/or help one gain control of stressful situations.</p></abstract><trans-abstract xml:lang="en"><p>Simultaneous interpreting (SI) is considered to be a highly demanding cognitive task, especially in regard to elements which represent a stumbling block during SI (e.g. numbers, idiomatic expressions, etc.). The current study examines the use of numbers in SI in combination with co-speech gestures. The issue of interpreting numbers has been addressed by different scholars, however it has rarely been studied from the multimodal perspective so far. Given the known role of gesture during processes of lexical retrieval, we hypothesize that the use of co-speech manual gestures plays a significant role in the process of interpreting numbers, i.e. facilitates mental retrieval of the target number.&amp;nbsp;In addition to the hypothesis to be tested, we consider the exploratory question as to whether any gestures with numbers correlate more with an externalized or internalized function, that is: either representation of the numerical concept externally (metaphorical depiction of the quantified entity as an object or space that could be touched or pointed to) or more with self-adapters to help the interpreter manage the cognitive load/stress internally. A corpus of 10 recordings of English-to-Russian SI sessions was analyzed. The interpreting of numbers was analyzed as being correct, incorrect or absent. The analysis of the material showed that the participants mostly interpreted numbers correctly or omitted them in their speech. The results of the analysis of co-speech gestures demonstrated nearly equal use of gesture and no gesture when interpreting numbers, however, there was a significant correlation between interpreting certain number categories and gesture use. Then the following types of gesture functions were analyzed: adapters, pragmatic, representational and deictic. The results indicate that self-adapters were the most frequent gesture type used. This finding can be interpreted based on the literature showing self-adapters ease tension and anxiety and/or help one gain control of stressful situations.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>Simultaneous interpreting</kwd><kwd>Cognitive load</kwd><kwd>Multimodality</kwd><kwd>Interpreting numbers</kwd><kwd>Gestures</kwd></kwd-group><kwd-group xml:lang="en"><kwd>Simultaneous interpreting</kwd><kwd>Cognitive load</kwd><kwd>Multimodality</kwd><kwd>Interpreting numbers</kwd><kwd>Gestures</kwd></kwd-group></article-meta></front><back><ack><p>The research is financially supported by the Russian Science Foundation, Project 19-18-00357 &amp;ldquo;Verbal and co-verbal behavior under cognitive load: analyses of speech, gesture, and eye gaze&amp;rdquo; at Moscow State Linguistic University.</p></ack><ref-list><title>Список литературы</title><ref id="B1"><mixed-citation>Braun,&amp;nbsp;S. and Clarici,&amp;nbsp;A. (1996). Inaccuracy for numerals in simultaneous interpretation: Neurolinguistic and neuropsychological perspectives, The Interpreters&amp;rsquo; Newsletter, 7, 85&amp;ndash;102. (In English)</mixed-citation></ref><ref id="B2"><mixed-citation>Bylinina,&amp;nbsp;L. and Nouwen,&amp;nbsp;R. (2020). Numeral semantics, Language and Linguistics Compass, 14, e12390. https://doi.org/10.1111/lnc3.12390 (In English)</mixed-citation></ref><ref id="B3"><mixed-citation>Chu,&amp;nbsp;M. and Kita,&amp;nbsp;S. (2008). Spontaneous gestures during mental rotation tasks: Insights into the microdevelopment of the motor strategy, Journal of Experimental Psychology: General, 137, 706&amp;ndash;723. https://doi.org/10.1037/a0013157 (In English)</mixed-citation></ref><ref id="B4"><mixed-citation>Cienki,&amp;nbsp;A. and Iriskhanova,&amp;nbsp;O.&amp;nbsp;K. (2020). Patterns of multimodal behavior under cognitive load: An analysis of simultaneous interpretation from L2 to L1, Voprosy Kognitivnoy Lingvistiki [Issues in Cognitive Linguistics], 1, 5&amp;ndash;11. https://doi.org/10.20916/1812-3228-2020-1-5-11 (In English)</mixed-citation></ref><ref id="B5"><mixed-citation>https://doi.org/10.1080/0907676X.2020.1718170 (In English)</mixed-citation></ref><ref id="B6"><mixed-citation>Desmet,&amp;nbsp;B., Vandierendonck,&amp;nbsp;M. and Defrancq,&amp;nbsp;B. (2018). Simultaneous interpretation of numbers and the impact of technological support, inFantinuoli,&amp;nbsp;C. (ed.), Interpreting and technology, Language Science Press, Berlin, Germany, 13&amp;ndash;27. https://doi.org/10.5281/zenodo.1493281 (In English)</mixed-citation></ref><ref id="B7"><mixed-citation>Dressel,&amp;nbsp;D. (2020). Multimodal word searches in collaborative storytelling: On the local mobilization and negotiation of coparticipation, Journal of Pragmatics, 170, 37&amp;ndash;54. https://doi.org/10.1016/j.pragma.2020.08.010 (In English)</mixed-citation></ref><ref id="B8"><mixed-citation>Ekman,&amp;nbsp;P. and Friesen,&amp;nbsp;W.&amp;nbsp;V. (1969). The repertoire of non-verbal behavior: Categories, origins, usage, and coding, Semiotica, 1, 49&amp;ndash;98. https://doi.org/10.1515/semi.1969.1.1.49 (In English)</mixed-citation></ref><ref id="B9"><mixed-citation>Freedman,&amp;nbsp;N. (1972). The analysis of movement behavior during the clinical interview, in Siegman,&amp;nbsp;A.&amp;nbsp;W. and Pope,&amp;nbsp;B. (eds.), Studies in dyadic communication, 7, 153&amp;ndash;175. (In English)</mixed-citation></ref><ref id="B10"><mixed-citation>Fricke,&amp;nbsp;E. (2002). Origo, pointing, and speech: the impact of co-speech gestures on linguistic deixis theory,Gesture, 2&amp;nbsp;(2), 207&amp;ndash;226. https://doi.org/10.1075/gest.2.2.05fri (In English)</mixed-citation></ref><ref id="B11"><mixed-citation>Fricke,&amp;nbsp;E. (2013). Towards a unified grammar of gesture and speech: A multimodal approach, in M&amp;uuml;ller,&amp;nbsp;C., Cienki,&amp;nbsp;A., Fricke,&amp;nbsp;E., Ladewig,&amp;nbsp;S., McNeill,&amp;nbsp;D. and Tessendorf,&amp;nbsp;S. (eds.), Body &amp;ndash; Language &amp;ndash; CommunicationDe Gruyter Mouton, Berlin, Germany 733&amp;ndash;754. https://doi.org/10.1515/9783110261318.733 (In English)</mixed-citation></ref><ref id="B12"><mixed-citation>Gibbon,&amp;nbsp;D. (2005). Prerequisites for a multimodal semantics of gesture and prosody, Proceedings of the International Workshop on Computational Semantics, 6, 2&amp;ndash;15. (In English)</mixed-citation></ref><ref id="B13"><mixed-citation>Gile,&amp;nbsp;D. (1995). Fidelity assessment in consecutive interpretation: an experiment,Target. International Journal of Translation Studies, 7&amp;nbsp;(1), 151&amp;ndash;164. https://doi.org/10.1075/target.7.1.12gil (In English)</mixed-citation></ref><ref id="B14"><mixed-citation>Gile,&amp;nbsp;D. (2008). Local cognitive load in simultaneous interpreting and its implications for empirical research, FORUM. Revue internationale d&amp;rsquo;interpr&amp;eacute;tation et de traduction/International Journal of Interpretation and Translation, 6&amp;nbsp;(2), 59&amp;ndash;77. https://doi.org/10.1075/forum.6.2.04gil (In English)</mixed-citation></ref><ref id="B15"><mixed-citation>Gile,&amp;nbsp;D. (2009). Basic concepts and models for interpreter and translator training, John Benjamins, Amsterdam/Philadelphia, Netherlands/USA. https://doi.org/10.1075/btl.8 (In English)</mixed-citation></ref><ref id="B16"><mixed-citation>Gósy,&amp;nbsp;M. (2007). Disfluencies and Self-monitoring, Govor = Speech, XXIV, 91&amp;ndash;110. (In English)</mixed-citation></ref><ref id="B17"><mixed-citation>Hirrel,&amp;nbsp;L. (2018). , Doctoral dissertation, The University of New Mexico, Albuquerque, New Mexico, USA. (In English)</mixed-citation></ref><ref id="B18"><mixed-citation>Kendon,&amp;nbsp;A. (2017). Pragmatic functions of gestures: Some observations on the history of their study and their nature,Gesture, 16&amp;nbsp;(2), 157&amp;ndash;175. https://doi.org/10.1075/gest.16.2.01ken (In English)</mixed-citation></ref><ref id="B19"><mixed-citation>Kita,&amp;nbsp;S., Alibali,&amp;nbsp;M.&amp;nbsp;W. and Chu,&amp;nbsp;M. (2017). How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis, Psychological Review, 14&amp;nbsp;(3), 245-266. http://dx.doi.org/10.1037/rev0000059 (In English)</mixed-citation></ref><ref id="B20"><mixed-citation>Korpal,&amp;nbsp;P. (2017). Linguistic and psychological indicators of stress in simultaneous interpreting, Wydawnictwo Naukowe UAM, Poznan, Poland. (In English)</mixed-citation></ref><ref id="B21"><mixed-citation>Korpal,&amp;nbsp;P. and Stachowiak-Szymczak,&amp;nbsp;K. (2020). Combined problem triggers in simultaneous interpreting: Exploring the effect of delivery rate on processing and rendering numbers,Perspectives, 28&amp;nbsp;(1), 126&amp;ndash;143. https://doi.org/10.1080/0907676X.2019.1628285 (In English)</mixed-citation></ref><ref id="B22"><mixed-citation>Ladewig,&amp;nbsp;S.&amp;nbsp;H. (2014). The cyclic gesture, Body&amp;ndash;language&amp;ndash;communication: An international handbook on multimodality in human interaction, , 1605&amp;ndash;1618. (In English)</mixed-citation></ref><ref id="B23"><mixed-citation>Lakoff,&amp;nbsp;G. and N&amp;uacute;&amp;ntilde;ez,&amp;nbsp;R. (2000).Where Mathematics Comes From: How the Embodied Mind Brings Mathematics into Being, New York, NY, USA. (In English)</mixed-citation></ref><ref id="B24"><mixed-citation>Lapaire,&amp;nbsp;J.-R. (2016). From ontological metaphor to semiotic make-believe: Giving shape and substance to fictive objects of conception with the &amp;ldquo;globe gesture&amp;rdquo;, Signo, 41&amp;nbsp;(70), 29&amp;ndash;44. https://doi.org/10.17058/signo.v41i70.6413 (In English)</mixed-citation></ref><ref id="B25"><mixed-citation>Lin,&amp;nbsp;W., Orton,&amp;nbsp;I., Liu,&amp;nbsp;M. and Mahmoud,&amp;nbsp;M. (2020). Automatic detection of self-adaptors for psychological distress, 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), 371&amp;ndash;378. https://doi.org/10.1109/FG47880.2020.00032 (In English)</mixed-citation></ref><ref id="B26"><mixed-citation>Mandler,&amp;nbsp;G. and Shebo,&amp;nbsp;B.&amp;nbsp;J. (1982). Subitizing: an analysis of its component processes,Journal of experimental psychology: General, 111&amp;nbsp;(1), 1&amp;ndash;22. https://doi.org/10.1037/0096-3445.111.1.1 (In English)</mixed-citation></ref><ref id="B27"><mixed-citation>Mazza,&amp;nbsp;C. (2001). Numbers in simultaneous interpretation, The Interpreters&amp;rsquo; Newsletter, 11, 87&amp;ndash;104. (In English)</mixed-citation></ref><ref id="B28"><mixed-citation>McNeill,&amp;nbsp;D. (1985). So you think gestures are nonverbal? Psychological Review, 92&amp;nbsp;(3), 350-371. https://doi.org/10.1037/0033-295X.92.3.350 (In English)</mixed-citation></ref><ref id="B29"><mixed-citation>McNeill,&amp;nbsp;D. (1992). Hand and mind: What gestures reveal about thought, University of Chicago Press, Chicago, USA. (In English)</mixed-citation></ref><ref id="B30"><mixed-citation>Mead,&amp;nbsp;P. (2015). Numbers, in Pöchhacker,&amp;nbsp;F. (ed.), Routledge encyclopedia of interpreting studies, London/New York, UK/USA, 286&amp;ndash;288. https://doi.org/10.4324/9781315678467 (In English)</mixed-citation></ref><ref id="B31"><mixed-citation>M&amp;uuml;ller,&amp;nbsp;C. (1998). Iconicity and gesture,Oralit&amp;eacute; et gestualit&amp;eacute;. Communication multimodale, interaction, L&amp;rsquo;Harmattan, Paris, France, 321&amp;ndash;328. (In English)</mixed-citation></ref><ref id="B32"><mixed-citation>M&amp;uuml;ller,&amp;nbsp;C. (2014). Gestural modes of representation as techniques of depiction, in M&amp;uuml;ller,&amp;nbsp;C., Cienki,&amp;nbsp;A., Fricke,&amp;nbsp;E., Ladewig,&amp;nbsp;S.&amp;nbsp;H., McNeill,&amp;nbsp;D., and Bressem,&amp;nbsp;J. (eds.), Body &amp;ndash; Language &amp;ndash; Communication, Berlin, Germany 1687&amp;ndash;1702. (In English)</mixed-citation></ref><ref id="B33"><mixed-citation>Neff,&amp;nbsp;M., Toothman,&amp;nbsp;N., Bowmani,&amp;nbsp;R., Fox Tree,&amp;nbsp;J.&amp;nbsp;E. and Walker,&amp;nbsp;M.&amp;nbsp;A. (2011). Don&amp;rsquo;t scratch! Self-adaptors reflect emotional stability, in Vilhj&amp;aacute;lmsson,&amp;nbsp;H.&amp;nbsp;H., Kopp,&amp;nbsp;S., Marsella,&amp;nbsp;S. and Thorisson,&amp;nbsp;K.&amp;nbsp;R. (eds.), Intelligent Virtual Agents, IVA 2011, Lecture Notes in Computer Science, 6895, 398-411. Reykjavik, Iceland, 398&amp;ndash;411. https://doi.org/10.1007/978-3-642-23974-8_43 (In English)</mixed-citation></ref><ref id="B34"><mixed-citation>Nikolaeva, J.&amp;nbsp;V. (2017). Pragmatic gestures in Russian retellings of &amp;quot;The Pear Stories&amp;quot;, The Russian Journal of Cognitive Science, 4&amp;nbsp;(2-3), 6&amp;ndash;12. (In English)</mixed-citation></ref><ref id="B35"><mixed-citation>Pinochi,&amp;nbsp;D. (2009). Simultaneous interpretation of numbers: Comparing German and English to Italian. An experimental study, The Interpreters&amp;rsquo; Newsletter, 14, 33&amp;ndash;57. (In English)</mixed-citation></ref><ref id="B36"><mixed-citation>Poyatos,&amp;nbsp;F. (1987/2002). Nonverbal communication in simultaneous and consecutive interpretation: A theoretical model and new perspectives, in Pöchhacker,&amp;nbsp;F. and Shlesinger,&amp;nbsp;M. (eds.), The Interpreting Studies Reader, Routledge, London, UK, 235&amp;ndash;246. (In English)</mixed-citation></ref><ref id="B37"><mixed-citation>Seeber,&amp;nbsp;K. (2011). Cognitive load in simultaneous interpreting: Existing theories - New models, Interpreting, 13, 176&amp;ndash;204. https://doi.org/10.1075/intp.13.2.02see (In English)</mixed-citation></ref><ref id="B38"><mixed-citation>Seeber,&amp;nbsp;K.&amp;nbsp;G. (2012). Multimodal input in simultaneous interpreting: An eye-tracking experiment, in Zybatow,&amp;nbsp;L.&amp;nbsp;N., Petrova,&amp;nbsp;A. and Ustaszewski,&amp;nbsp;M. (eds.), Proceeding of the 1st International Conference TRANSLATA, Translation and Interpreting Research: Yesterday&amp;ndash;Today&amp;ndash;Tomorrow, Peter Lang, Frankfurt a.M., Germany, 341&amp;ndash;347. https://doi.org/10.3726/978-3-653-01625-3 (In English)</mixed-citation></ref><ref id="B39"><mixed-citation>Seeber, K.&amp;nbsp;G. (2015). Simultaneous interpreting, in Mikkelson,&amp;nbsp;H. and Jourdenais,&amp;nbsp;R. (eds.), The Routledge Handbook of Interpreting, Routledge Handbooks Online. DOI:10.4324/9781315745381.ch5 (In English)</mixed-citation></ref><ref id="B40"><mixed-citation>Slobin,&amp;nbsp;D.&amp;nbsp;I. (1987). Thinking for speaking, Proceedings of the Thirteenth Annual Meeting of the Berkeley Linguistics Society, 13, 435&amp;ndash;445. https://doi.org/10.3765/bls.v13i0.1826 (In English)</mixed-citation></ref><ref id="B41"><mixed-citation>Stachowiak-Szymczak,&amp;nbsp;K. (2019). Eye Movements and Gestures in Simultaneous and Consecutive Interpreting, Springer, New York, USA. https://doi.org/10.1007/978-3-030-19443-7 (In English)</mixed-citation></ref><ref id="B42"><mixed-citation>Streeck,&amp;nbsp;J. (2009). Forward-gesturing, Discourse Processes, 46&amp;nbsp;(2-3), 161&amp;ndash;179. https://doi.org/10.1080/01638530902728793 (In English)</mixed-citation></ref><ref id="B43"><mixed-citation>Timarová, Š. (2012). Working memory in simultaneous interpreting, PhD Thesis, University of Leuven, Leuven, Belgium. https://doi.org/10.1075/intp.16.2.01tim (In English)</mixed-citation></ref></ref-list></back></article>