Investigating between-word pause duration in Russian typed texts using mixture modeling based on keystroke data
Keystroke logging is an objective and scalable methodology that has become the gold standard in writing research for modeling writing processes. A particularly significant aspect of this analysis is the examination of features such as pause duration, as pauses are regarded as indicators of underlying cognitive processes. Traditionally, arbitrary pause thresholds that are universally applied to all writers have been established to differentiate between cognitive and non-cognitive pauses. However, this approach presents considerable limitations and fails to account for the complexity and individual variability inherent in the cognitive processes involved in text production. Furthermore, different scholars employ varying approaches to the calculation of between-word pauses. This study is the first to analyze keystroke logs of Russian typed texts utilizing Gaussian mixture models (GMM) to cluster pause duration values at between-word boundaries. By employing keystroke logs collected from 50 university students who described the views from their home windows, we conducted a cluster analysis of pause duration values before words, after words, and between words separately. It was determined that the distribution of pauses between words cannot be characterised by a single distribution. For the majority of participants, two-component distribution provided the best fit for all three types of pauses. Additionally, we observed a high degree of individual variability in the mixing proportions of different components. This paper underscores the necessity of avoiding the imposition of fixed thresholds in pause analysis that are universally applicable to all writers and advocates for individualized and holistic approach to studying the writing process.
Figures
Litvinova, T. A., Molchanova, V. A. (2024). Investigating Between-Word Pause Duration in Russian Typed Texts Using Mixture Modeling Based on Keystroke Data, Research Result. Theoretical and Applied Linguistics, 10 (4), 147-166.
While nobody left any comments to this publication.
You can be first.
Alamargot, D., Dansac, C., Chesnet, D. and Fayol, M. (2007). Parallel processing before and after pauses: A combined analysis of graphomotor and eye movements during procedural text production, in Torrance, M., Waes, L. van and Galbraith, D. (eds.). Writing and cognition: Research and applications, Elsevier Science, 13–29. (In English)
Alves, R. A. and Limpo, T. (2015). Progress in written language bursts, pauses, transcription, and written composition across schooling, Scientific Studies of Reading, 19 (5), 374–391. https://doi.org/10.1080/10888438.2015.1059838(In English)
Baaijen, V. M. and Galbraith, D. (2018). Discovery through writing: Relationships with writing processes and text quality, Cognition and Instruction, 36 (3), 199–223. https://doi.org/10.1080/07370008.2018.1456431(In English)
Baaijen, V. M., Galbraith, D. and de Glopper, K. (2012). Keystroke analysis: Reflections on procedures and measures, Written Communication, 29 (3), 246–277. https://doi.org/10.1177/0741088312451108 (In English)
Barkaoui, K. (2019). What Can L2 Writers’ Pausing Behavior Tell Us About Their L2 Writing Processes?, Studies in Second Language Acquisition, 41 (3), 529–554. DOI: 10.1017/S027226311900010X (In English)
Beauvais, C., Olive, T. and Passerault, J.-M. (2011). Why are some texts good and others not? Relationship between text quality and management of the writing process, Journal of Educational Psychology, 103 (2), 415–428. https://doi.org/10.1037/a0022545 (In English)
Chukharev-Hudilainen, E. (2014). Pauses in spontaneous written communication: A keystroke logging study, Journal of Writing Research, 6 (1), 61–84. DOI: 10.17239/jowr-2014.06.01.3 (In English)
Chukharev-Hudilainen, E., Saricaoglu, A., Torrance, M. and Feng, H.-H. (2019). Combined Deployable Keystroke Logging and Eyetracking for Investigating L2 Writing Fluency. Studies in Second Language Acquisition. 41(3), 583–604. https://doi.org/10.1017/S027226311900007X (In English)
Chukharev-Hudilainen, E. (2011). Local Discourse Structure of Chat Dialogues: Evidence from Keystroke Logging, Proceedings of the 15th Workshop on the Semantics and Pragmatics of Dialogue – Full Papers, Los Angeles, California, 104–111. (In English)
Cislaru, G., Feltgen, Q., Khoury, E., Delorme, R. and Bucci, M.P. (2024). Language Processing Units Are Not Equivalent to Sentences: Evidence from Writing Tasks, Typical and Dyslexic Children, Languages, 9 (5), 155. https://doi.org/10.3390/languages9050155 (In English)
Escorcia, D., Passerault, J.-M., Ros, C. and Pylouster, J. (2017). Profiling writers: Analysis of writing dynamics among college students, Metacognition and Learning, 12 (2), 233–273. https://doi.org/10.1007/s11409-016-9166-6 (In English)
Fraley, C., Raftery, A. E., Scrucca, L., Murphy, T. B. and Fop, M. (2020). Package “mclust” Title Gaussian Mixture Modelling for Model-Based Clustering, Classification, and Density Estimation, available at: https://mclust-org.github.io/mclust/ (accessed on 05.11.2024) (In English)
Galbraith, D. and Baaijen, V. M. (2018). The work of writing: Raiding the inarticulate, Educational Psychologist, 53 (4), 238–257. https://doi.org/10.1080/00461520.2018.1505515(In English)
Galbraith, D. and Baaijen, V. M. (2019). Aligning keystrokes with cognitive processes in writing, in Lindgren, E. and Sullivan, K. P. H. (eds.) Observing Writing: Insights from Keystroke Logging and Handwriting, Brill, 38, 306–325. https://doi.org/10.1163/9789004392526_015 (In English)
Garcés-Manzanera, A. (2024). Language bursts and text quality in digital writing by young EFL learners, Journal of New Approaches in Educational Research, 13. https://doi.org/10.1007/s44322-024-00012-x (In English)
Guo, H., Deane, P. D., van Rijn, P. W., Zhang, M. and Bennett, R. E. (2018). Modeling basic writing processes from keystroke logs, Journal of Educational Measurement, 55 (2), 194–216. https://doi.org/10.1111/jedm.12172 (In English)
Hall, S., Baaijen, V. M. and Galbraith, D. (2024). Constructing theoretically informed measures of pause duration in experimentally manipulated writing, Reading and Writing, 37, 329–357. https://doi.org/10.1007/s11145-022-10284-4(In English)
Kass, R. E. and Raftery, A. E. (1995). Bayes factors, Journal of the American statistical association, 90 (430), 773–795. (In English)
Kibrik, A. A., Korotaev, N. A. and Podlesskaya, V. I. (2020). Russian spoken discourse: Local structure and prosody. In Izre’el, S., Mello, H., Panunzi, A. and Raso, T. (Eds.). In search of basic units of spoken language: A corpus-driven approach, John Benjamins, Amsterdam, 367–382. DOI: 10.1075/scl.94.01kib(In English)
Leijten, M. and Van Waes, L. (2013). Keystroke logging in writing research: Using inputlog to analyze and visualize writing processes, Written Communication, 30 (3), 358–392. https://doi.org/10.1177/0741088313491692(In English)
Leijten, M. and Van Waes, L. (2006). Inputlog: New perspectives on the logging of online writing, in Sullivan, K. P. H. and Lindgren, E. (Eds.). Computer keystroke logging and writing: Methods and applications, Elsevier, Oxford, 73–93. (In English)
Limpo, T. and Alves, R. A. (2017). Written language bursts mediate the relationship between transcription skills and writing performance, Written Communication, 34 (3), 306–332. https://doi.org/10.1177/0741088317714234 (In English)
Little, D. R., Oehmen, R., Dunn, J. C., Hird, K. and Kirsner, K. (2012). Fluency Profiling System: An automated system for analyzing the temporal properties of speech, Behavior Research Methods, 45, 191–202. https://doi.org/10.3758/s13428-012-0222-0 (In English)
McLachlan, G. J. and Peel, D. (2000). Finite mixture models, Wiley, New York. (In English)
Medimorec, S. and Risko, E. F. (2017). Pauses in written composition: on the importance of where writers pause, Reading and Writing, 30, 1267–1285. https://doi.org/10.1007/s11145-017-9723-7 (In English)
Muthén, B. and Asparouhov, T. (2009). Multilevel regression mixture analysis, Journal of the Royal Statistical Society Series A, Royal Statistical Society, 172 (3), 639–657. (In English)
Mohsen, M. A. and Qassem, M. (2020). Analyses of L2 Learners’ Text Writing Strategy: Process-Oriented Perspective, Journal of Psycholinguistic Research, 49, 435–451. https://doi.org/10.1007/s10936-020-09693-9 (In English)
Roeser, J., Torrance, M. and Baguley, T. (2019). Advance planning in written and spoken sentence production, Journal of Experimental Psychology: Learning, Memory, and Cognition, 45 (11), 1983–2009. DOI: 10.1037/xlm0000685 (In English)
Spelman-Miller, K. (2006). The pausological study of written language production, in Sullivan, K. P. H. and Lindgren, E. (eds.). Computer keystroke logging: Methods and applications, Elsevier, 11–30. (In English)
Usoof, H. A., Leblay, C. and Caporossi, G. (2020). GenoGraphiX-Log version 2.0 user guide. Les Cahiers du GERAD, available at: https://ggxlog.net/download/User%20Guide_20230130.pdf (accessed on 05/11/2024) (In English)
Valenzuela, Á. and Castillo, R. D. (2023). The effect of communicative purpose and reading medium on pauses during different phases of the textualization process. Read Writ. 36, 881–908. https://doi.org/10.1007/s11145-022-10309-y (In English)
Van Waes, L., Leijten, M., Roeser, J., Olive, T. and Grabowski, J. (2021). Measuring and assessing typing skills in writing research, Journal of Writing Research, 13 (1), 107–153. DOI: 10.17239/jowr-2021.13.01.04 (In English)
Vandermeulen, N., Lindgren, E., Waldmann, Ch. and Levlin, M. (2024). Getting a grip on the writing process: (Effective) approaches to write argumentative and narrative texts in L1 and L2, Journal of Second Language Writing, 65. https://doi.org/10.1016/j.jslw.2024.101113(In English)
Wengelin, Å. (2006). Examining Pauses in Writing: Theory, Methods and Empirical Data, in Computer Keystroke Logging and Writing: Methods and Applications, Brill, Leiden, The Netherlands, 107–130. DOI: 10.1163/9780080460932_008 (In English)
Zhang, M., Bennett, R. E., Deane, P. and van Rijn, P. W. (2019). Are there gender differences in how students write their essays? An analysis of writing processes, Educational Measurement: Issues and Practice, 38 (2), 14–26. https://doi.org/10.1111/emip.12249 In English)
The authors acknowledge the support of the Ministry of Education of the Russian Federation (the research was supported by the Ministry of Education of the Russian Federation within the framework of the State Assignment in the field of science, topic number QRPK-2024-0011).