Text and metatext event in the gaze behavior of impulsive and reflective readers
Experimental research testing the effects of text complexity onto gaze behavior and comprehension have revealed multiple factors which underlie the distribution of attention in reading. In the study, we explored event construal cues in text and metatext fragments in drama plays as mediating the gaze behavior of both reflective and impulsive readers. To annotate the event construal cues in text and metatext (in characters’ speech and in author’s remarks), we developed a Text Event Construal Protocol. It specifies three groups of construal cues in Referent group, Event Frame group, and Perspective group. The protocol was tested and implemented in the MultiCORText search engine and database. Cognitive semantic analysis helped identify the differences in event construal in author’s and characters’ intexts. The highest distinctions were found in perspective construal, where subjectivation cues were significantly less frequent in author’s intexts. Additionally, the differences were observed in other event construal groups, for instance in the frequency of abstract referent, activity of visual / audial perception or mental activity (thinking / understanding), and action, state or activity of space location. In the cognitive psychological study, we tested the gaze behavior of reflective and impulsive participants reading 5 one-page drama text fragments incorporating the author’s and characters’ intexts (overall, 126 areas of interest) previously annotated following the Text Event Construal Protocol. The study found evidence for significant distinctions in the gaze behavior (in First Fixation duration, Max Fixation duration) of the readers displaying different cognitive style; importantly, major effects of event construal cues were observed among the reflective readers. The results allowed to scale the effects of event construal cues in text and metatext for different groups of readers. Therefore, the data provide new evidence in the cognitive semantic research of text and metatext via the methods and instruments of cognitive psychology.
Figures
Kiose, M. I., Izmalkova, A. I., Rzheshevskaya, A. A. and Makeev, S. D. (2023). Text and metatext event in the gaze behavior of impulsive and reflective readers, Research Result. Theoretical and Applied Linguistics, 9 (1), 115-135. DOI: 10.18413/2313-8912-2023-9-1-0-8
While nobody left any comments to this publication.
You can be first.
Bergen, B. (2015). Embodiment, in Dabrowska, E. and Divjak, D. (eds.), Handbook of Cognitive Linguistics, Walter de Gruyter, Berlin, Germany, 10–30. (In English)
Blinnikova, I. and Izmalkova, A. (2017). Modeling search in web environment: the analysis of eye movement measures and patterns, in Czarnowski, I., Howlett, R. and Jain, L. (eds.), Intelligent Decision Technologies 2017, IDT 2017, Smart Innovation, Systems and Technologies, 73. Springer, Cham., 297–307. https://doi.org/10.1007/978-3-319-59424-8_28(In English)
Coventry, K. R., Lynott, D., Cangelosi, A., Monrouxe, L., Joyce, D. and Richardson, D. C. (2010). Spatial language, visual attention, and perceptual simulation, Brain and Language, 112 (3), 202–213. https://doi.org/10.1016/j.bandl.2009.06.001(InEnglish)
Demyankov, V. (1983). “Sobytie” v semantike, pragmatike i v koordinatah interpretatsii teksta [Event in semantics, pragmatics and interpretation coordinates], IzvestiyaАNUSSR. Literature and language series, 42 (4), 320–329. (In Russian)
Demyankov, V. (2019). Soglasovanie I adaptatsiya modalnostej [Modality agreement and adaptation], Cognitive Studies of Language, 39, 88–99. (In Russian)
Divjak, D., Milin, P. and Medimorec, S. (2020). Construal in language: A visual-world approach to the effects of linguistic alternations on event perception and conception, Cognitive Linguistics, 19, 37–72. https://doi.org/10.1515/cog-2018-0103(In English)
Elman, J. L. (2009). On the meaning of words and dinosaur bones: Lexical knowledge without a lexicon, Cognitive Science, 33 (4), 547–582. (In English)
Fehd, H. M. and Seiffert, A. E. (2008). Eye movements during multiple object tracking: Where do participants look?, Cognition, 108, 201–209. https://doi.org/10.1016/j.cognition.2007.11.008(In English)
Forster, S., Robertson, D., Jennings, A., Asherson, P. and Lavie, N. (2014) Plugging the attention deficit: perceptual load counters increased distraction in ADHD, Neuropsychology, 28 (1), 91–97. https://doi.org/10.1037/neu0000020(In English)
Gamer, M. and Pertzov, Y. (2018). Chapter 8 - Detecting concealed knowledge from ocular responses, in Rosenfeld, J. P. (ed.), Detecting concealed information and deception, Academic Press, 169–186. https://doi.org/10.1016/B978-0-12-812729-2.00008-2(In English)
Givoni, S. and Giora, R. (2018). Salience and Defaultness, in Liedtke, F. and Tuchen, A. (eds.), Handbuch Pragmatik, J. B. Metzler, Stuttgart, Germany, 207–213. https://doi.org/10.1007/978-3-476-04624-6_20(In English)
Iriskhanova, O. K. (2013). O ponyatii perspektivizatsii v kognitivnoj lingvistike [On perspectivization in cognitive studies], Cognitive Studies of Language, 15, 43–58. (In Russian)
Iriskhanova, O. K. (2014). Igry fokusa v yazyke [Games of focus in language], Languages of Slavic Culture, Moscow, Russia. (In Russian)
Iriskhanova, O. K. (ed.). (2021). Polimodal’nie izmerenia diskursa [Multimodal Dimensions of Discourse], Languages of Slavic Culture, Moscow, Russia. (In Russian)
Jackendoff, R. (2002). Foundations of language: Brain, meaning, grammar, evolution, Oxford University Press, Oxford, UK. (In English)
Ji, Y. and Papafragou, A. (2018). Midpoints and endpoints in event perception, in Rogers, T. T. Rau, M., Zhu, X., and Kalish, C. W. (eds.), Proceedings of the 40th Annual Conference of the Cognitive Science Society, Cognitive Science Society, Austin, TX, USA, 1874–1879. (In English)
Kagan, J. (1966). Reflection-impulsivity: The generality and dynamics of conceptual tempo, Journal of abnormal psychology, 71 (1), 17– 24. https://doi.org/10.1037/h0022886 (In English)
Kiose, M. I. and Rzheshevskaya, А. А. (2021). Interdiscourse switching in drama text. Gaze patterns and comprehension check results, Issues in Cognitive Linguistics, 4, 55–66. https://doi.org/10.20916/1812-3228-2021-4-55-66(In English)
Kiose, M. I. (2022). Event construal in text and image. Gaze behavior and discourse interpretations, RUDN Journal of Language Studies, Semiotics and Semantics, 13 (2), 396–415. https://doi.org/10.22363/2313-2299-2022-13-2-396-415(In English)
Kiose, M. I., Rzheshevskaya, A. A. and Izmalkova, A. I. (2022). Gaze behavior in single-page monomodal and cross-modal switches as affected by Event construal, Dialogue, 21, 1078–1088. https://doi.org/10.28995/2075-7182-2022-21-1087-1097(In English)
Kliegl, R., Grabner, E., Rolfs, M. and Engbert, R. (2004). Length, frequency, and predictability effects of words on eye movements in reading, European Journal of Cognitive Psychology, 16, 262–284. https://doi.org/10.1080/09541440340000213(In English)
Kubryakova, E. S. and Aleksandrova, O. V. (2008) Dramaticheskie proizvedenia kak osobyi object diskursivnogo analiza (k postanovke problemy) [Drama texts as an object of linguistic analysis, or discourse as the highest reality of language (to the problem)], Izvestiya RAS, 4, 3–10. (In Russian)
Kubryakova, E. S. and Petrova, N. Yu. (2010). Lingvokulturologicheskij status dramy (novoe v izuchenii yazyka pies) [Linguo-cultural status of drama (new insights in studying the drama language)], Issues of Cognitive Linguistics, 2, 64–73. (In Russian)
Laurinavichyute, A. K., Sekerina, I. A., Alexeeva, S., Bagdasaryan, K. and Kliegl, R. (2019). Russian Sentence Corpus: Benchmark measures of eye movements in reading in Russian, Behavior Research Methods, 51 (3), 1161–1178. https://doi.org/10.3758/s13428-018-1051-6 (In English)
Liversedge, S. P., Drieghe, D., Li, X., Yan, G., Bai, X. and Hyönä, J. (2016). Universality in eye movements and reading: A trilingual investigation, Cognition, 147, 1–20. https://doi.org/10.1016/j.cognition.2015.10.013(In English)
Litvinenko, T. E. (2008). Intertekst v aspektah lingvistiki i obshej teorii teksta [Intertext in the aspects of linguistics and general theory of text], ISLU, Irkutsk, Russia. (In Russian)
Lotman, Yu. M. (1992). Kultura i vzryv [Culture and explosion], Gnosis, Moscow, Russia. (In Russian)
Nahari, T., Lancry-Dayan, O., Ben-Shakhar, G. et al. (2019). Detecting concealed familiarity using eye movements: the role of task demands, Cogn. Research, 4, 10. https://doi.org/10.1186/s41235-019-0162-7(In English)
Nitzan-Tamar, O., Kramarski, B. and Vakil, E. (2016). Eye movement patterns characteristic of cognitive style: Holistic versus analytic, Experimental Psychology, 63 (3), 159-168. https://doi.org/10.1027/1618-3169/a000323(In English)
Nitzan-Tamar, O., Kramarski, B. and Vakil, E. (2022). The flexibility of the intermediate vs. wholistic/analytic styles – an eye tracking study, Journal of Cognitive Psychology, 1 (12). https://doi.org/10.1080/20445911.2022.2147187(In English)
Papafragou, A., Hulbert, J. and Trueswell, J. (2008). Does language guide event perception? Evidence from eye movements, Cognition, 108, 155–184. https://doi.org/10.1016/j.cognition.2008.02.007(In English)
Papenmeier, F. and Huff, M. (2010). DynAOI: A tool for matching eye-movement data with dynamic areas of interest in animation and movies, Behavior research methods, 42 (1), 179–187. https://doi.org/10.3758/BRM.42.1.179(In English)
Perinbanayagam, R. (2011). Discursive acts. Language, Signs, and Selves, Routledge, New York, USA. https://doi.org/10.4324/9780203793190(In English)
Pokhoday, M., Shtyrov, Y. and Myachykov, A. (2019). Effects of Visual Priming and Event Orientation on Word Order Choice in Russian Sentence Production, Frontiers in Psychology, 10, 1661. https://doi.org/10.3389/fpsyg.2019.01661(In English)
Pustejovsky, J. (1995). The Generative Lexicon, MIT Press, Cambridge, Massachusetts, USA. (In English)
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research, Psychological Bulletin, 124 (3), 372–422. (In English)
Rayner, K., Smith, T. J., Malcolm, G. L. and Henderson, J. M. (2009). Eye movements and visual encoding during scene perception, Psychological Science, 20, 6–10. https://doi.org/10.1111/j.1467-9280.2008.02243.x(In English)
Richmond, L. L. and Zacks, J. M. (2017). Constructing experience: Event models from perception to action, Trends in Cognitive Sciences, 21, 962−980. (In English)
Rozencwajg, P. and Corroyer, D. (2005). Cognitive Processes in the Reflective-Impulsive Cognitive Style, The Journal of genetic psychology, 166, 451-63. http://dx.doi.org/10.3200/GNTP.166.4.451-466(In English)
Rzheshevskaya, A. (2014). Yazykovye sredstva postroeniya perspektivy v diskurse konflikta (na materiale angliyiskoy dramy) [Language means of perspective setting in conflict discourse (based on English drama), Ph.D. Thesis, Moscow State Linguistic University, Moscow, Russia. (In Russian)
Siewerska, A. (2004). On the discourse basis of person agreement, in Verhagen, T. (ed.), Approaches to cognition through text and discourse, Mouton de Gruyter, Berlin, New York, Germany, USA, 33–48. (In English)
Solovyev, V. D., Solnyshkina, M. I. and McNamara, D. S. (2022). Computational linguistics and discourse complexology: Paradigms and research methods, Russian Journal of Linguistics, 26 (2), 275–316. https://doi.org/10.22363/2687-0088-31326(In English)
Talmy, L. (2000). Toward a Cognitive Semantic, Two volumes, MIT Press, Cambridge, UK. (In English)
Talmy, L. (2007). Attention phenomena, in Geeraerts, D. and Cuyckens, H. (eds.), The Oxford handbook of Cognitive Linguistics, Oxford University Press, Oxford, UK, 264−293. (In English)
Tomlin, R. S. (1987). Linguistic reflections of cognitive events, in Tomlin, R. S. (ed.), Coherence and Grounding in Discourse, Benjamins, Amsterdam, Netherlands, 455–480. (In English)
Velichkovsky, B., Joos, M., Helmert, J. R. and Pannasch, S. (2005). Two visual systems and their eye movements: evidence from static and dynamic scene perception, Proceedings of the XXVII Conference of the Cognitive Science Society, 27, 2283–2288. (In English)
Verhagen, A. (2007). Construal and perspectivization, in Geeraerts, D. and Cuyckens, H. (eds.), The Oxford Handbook of Cognitive Linguistics, Oxford University Press, Oxford, UK, 48–81. (In English)
Wårwik, B. (2004). What is foregrounded in narratives? Hypotheses for the cognitive basis of foregrounding, in Virtanen, T. (ed.), Approaches to Cognition through Text and Discourse, Mouton de Gruyter, Berlin, New York, Germany, USA, 99–122. (In English)
Zhang, L. F. and Sternberg, R. J. (2012). The nature of intellectual styles, Routledge, New York, USA. https://doi.org/10.4324/9780203053881(In English)
This research is financially supported by the Russian Science Foundation, project No. 22-28-01754 “Cognitive load economy in media texts interpretation: Multimodal Corpus of Oculographic Reactions MultiCOR” and was carried out at the Centre for SocioCognitive Discourse Studies at Moscow State Linguistic University.