Lexical and syntactic features of academic Russian texts: a discriminant analysis
This article presents three mathematical models to differentiate academic texts from three subject discourses written in Russian (i.e., Philological, Mathematical, and Natural Sciences) which further enable design and automated profiling of corresponding typologies. Our models include 5 indices, one at surface level (i.e., sentence length) and 4 syntax features (i.e., mean verbs per sentence, mean adjectives per sentence, local noun overlap, and global argument overlap). We identified and validated the five statistically significant features out of 45 linguistic features extracted from our research corpus consisting of 91.185 tokens. The shortest sentence length is found in Russian language textbooks while the longest sentences are identified in Natural Science texts. The mean number of verbs, nouns, and adjectives per sentence is higher in Natural Science textbooks, whereas Mathematics discourse is characterized by the shortest word length, highest local noun overlap, and highest global argument overlap. We assign the metric differences between the three discourses to their functions: Natural Science texts are characterized by descriptions and narrative passages in contrast to Philology that is associated with opinions. Mathematical discourse operates with precise definitions, explanations and justifications thus exercising numerous overlaps. The discriminant analysis built on top of the features supports the development of text profilers targeting parametric analyses. The automation of these features and the provided formulas for classification enable the design and development of text profilers required for textbook writing and editing. Our findings are useful for professional linguists, technologists, and academic writers to select and modify texts for their target audience.
Kupriyanov, R. V., Solnyshkina, M. I., Dascalu, M. and Soldatkina, T. A. (2022). Lexical and syntactic features of academic Russian texts: a discriminant analysis, Research Result. Theoretical and Applied Linguistics, 8 (4), 105-122. DOI: 10.18413/2313-8912-2022-8-4-0-8
While nobody left any comments to this publication.
You can be first.
Andreev, V. S. (2010). Methods of quantitative style research in linguistics: a multidimensional approach, Izvestiya Smolenskogo gosudarstvennogo universiteta, 3 (11), 100–110. (In Russian)
Baayen, R. H., Halteren, H. and Tweedie, F. J. (1996). Outside the cave of shadows: using syntactic annotation to enhance authorship attribution, Literary and Linguistic Computing, 11 (3), 121–132. (In English)
Biber, D. (2006). University language: A corpus-based study of spoken and written registers, John Benjamins, Amsterdam. (In English)
Corlatescu, D., Ruseti, Ș. and Dascalu, M. (2022). ReaderBench: Multilevel analysis of Russian text characteristics, Russian Journal of Linguistics, 26, 2, 342–370, available at: URL: https://journals.rudn.ru/linguistics/article/view/31328 (Accessed 5 March 2022). https://doi.org/10.22363/2687-0088-30145(In English)
Crossley, S. A., Varner, L. K., Roscoe, R. D. and McNamara, D. S. (2013). Using Automated Indices of Cohesion to Evaluate an Intelligent Tutoring System and an Automated Writing Evaluation System, Artificial Intelligence in Education, 269–278. https://doi.org/10.1007/978-3-642-39112-5_28 (In English)
Flesch, R. (1948). A new readability yardstick, Journal of Applied Psychology, 32 (3), 221–233. (In English)
Gatiyatullina, G., Solnyshkina, M., Solovyev, V., Danilov, A., Martynova, E. and Yarmakeev, I. (2020). Computing Russian Morphological distribution patterns using RusAC Online Server, 13th International Conference on Developments in eSystems Engineering (DeSE), 393–398, available at: https://ieeexplore.ieee.org/document/9450753.Coh-Metrix (Accessed 5 March 2022). http://doi.org/10.1109/DeSE51703.2020.9450753(In English)
Graesser, A. C., McNamara, D. S., Louwerse, M. M. and Cai, Z. (2004). Coh-Metrix: Analysis of text on cohesion and language, Behavior Research Methods, Instruments, & Computers, 36 (2), 193–202. http://doi.org/10.3758/bf03195564(In English)
Holmes, D., Forsyth, R. (1995). The Federalist revisited: New directions in authorship attribution, Literary and Linguistic Computing, 10 (2), 111–127. (In English)
Kiselnikov, A. S. (2015). K probleme kharakteristik teksta: chitabel’nost’, ponyatnost’, slozhnost’, trudnost’ [To the problem of text characteristics: readability, clarity, complexity, difficulty ], Filologicheskie nauki. Voprosy teorii i praktiki, 11 (53), 79–84. (In Russian)
Malvern, D., Richards, B., Chipere, N. and Durán, P. (2004). Traditional Approaches to Measuring Lexical Diversity, Palgrave Macmillan, London, UK. https://doi.org/10.1057/9780230511804 (In English)
Martynova, E., Solnyshkina, M. I., Merzlyakova, A. and Gizatulina, D. (2020). Leksicheskie parametry uchebnogo teksta (na materiale tekstov uchebnogo korpusa russkogo yazyka) [Lexical parameters of academic text (based on the texts of Academic corpus of the Russian language)], Philology and culture, 3 (61), 72–80, available at: http://www.philology-and-culture.kpfu.ru/?q=node/2728 (Accessed 5 March 2022). (In Russian)
McNamara, D. S., Graesser, A. C. and Louwerse, M. M. (2012). Sources of text difficulty: Across genres and grades, in Sabatini, J. P., Albro, E. and O’Reilly, T. (eds.), Measuring up: Advances in how we assess reading ability, 89–116. (In English)
McNamara, D., Graesser, A., McCarthy, P. and Cai, Z. (2014). Automated Evaluation of Text and Discourse with Coh-Metrix, Cambridge University Press, Cambridge, UK. http://doi.org/10.1017/CBO9780511894664(In English)
Oborneva, I. V. (2006). Avtomatizirovannaya otsenka slozhnosti uchebnyh tekstov na osnove statisticheskih parameters [Automated assessment of the complexity of educational texts based on statistical parameters], Abstract of Ph.D. dissertation, Moscow City University, Moscow, Russia. (In Russian)
Seifart, F., Danielsen, S., Meyer, R., Nordhoff, S., Pakendorf, B., Witzlack-Makarevich, A. and Zakharko, T. (2012). The relative frequencies of nouns, pronouns, and verbs cross-linguisticallyApplicant, available at: https://www.semanticscholar.org/paper/The-relative-frequencies-of-nouns-%2C-pronouns-%2C-and-Seifart-Danielsen/cd52cd7091fee4b1781c16a51fe58f87ba642c1c (Accessed 5 March 2022). (In English)
Sirotinina, O. B. (2009). Spoken language within the system of functional styles of the Russian literary language: grammar, Librekom, Moscow, Russia. (In English)
Solnyshkina, M. I. and Kiselnikov, A. S. (2015). Slozhnost’ teksta kak funktsiya leksicheskih parametrov (na materiale uchebnyh tekstov na russkom yazyke [Text Complexity: Chronology of Russian applied linguistics studies], Vestnik Tomskogo gosudarstvennogo universiteta. Filologiya, 6 (38). (In Russian)
Solnyshkina, M. I., Harkova, E. V. and Kazachkova, M. B. (2020). The Structure of Cross-Linguistic Differences: Meaning and Context of ‘Readability’ and its Russian Equivalent ‘Chitabelnost’, Journal of Language and Education, 6 (1), 103–119. https://doi.org/10.17323/jle.2020.7176(In English)
Solnyshkina, M. I., Kazachkova, M. B. and Harkova, E. V. (2020). Сifrovye tekhnologii izmereniya slozhnosti tekstov kak instrument upravleniya kachestvom obucheniya chteniyu na anglijskom yazyke [Digital technologies for measuring text complexity as a tool for managing the quality of teaching reading in English], Foreign languages at school, 3, 15–21, available at: https://www.elibrary.ru/item.asp?id=42609743 (Accessed 5 March 2022). (In Russian)
Solnyshkina, M., McNamara, D. and Zamaletdinov, R. (2022). Natural language processing and discourse complexity studies, Russian Journal of Linguistics, 26 (2), 317–341. (In English)
Solnyshkina, M. I., Solovyev, V. D., Gafiyatova, E. V. and Martynova, E. V. (2022) Slozhnost' teksta kak mezhdisciplinarnaya problema [Text complexity as an interdisciplinary problem], Issues of cognitive linguistics, 1, 18-40. (In Russian)
Solovyev, V. D., Ivanov, V. V. and Akhtiamov, R. B. (2019). Dictionary of abstract and concrete words of the Russian language: A methodology for creation and application, Journal of research in applied linguistics, 10, 215–227. (In English)
Solovyev, V., Ivanov, V. and Solnyshkina, M. (2018). Assessment of reading difficulty levels in Russian academic texts: Approaches and Metrics, Journal of Intelligent & Fuzzy Systems, 34 (5). http://doi.org/10.3233/JIFS-169489(In English)
Stamatatos, E., Fakotakis, N. and Kokkinakis, G. (2001). Computer-based authorship attribution without lexical measures, Computers and the Humanities, 35 (2), 193–214. (In English)
Vakhrusheva, A. Ya., Solnyshkina, M. I., Kupriyanov, R. V., Gafiyatova, E. V. and Klimagina, I. O. (2021). Lingvisticheskaya slozhnost’ uchebnyh tekstov [Linguistic complexity of academic texts], Voprosy zhurnalistiki, pedagogiki, yazykoznaniya: elektronnyj zhurnal, 40 (1), 89–99, available at: http://jpl-journal.ru/index.php/journal/article/view/78 (Accessed 5 March 2022). (In Russian)
Zherebtsova, Zh. I. (2007). Ispol’zovanie informatsionnoj struktury predlozheniya v obuchenii inostrannyh studentov-nefilologov chteniyu russkih uchebno-nauchnyh tekstov [The use of information structure of the sentence in teaching foreign non-philological students to read Russian academic and research texts], Ph.D. Thesis, Herzen State University, St.Petersburg, Russia. (In Russian)
Zhuravlev, A. F. (1988). An experience of quantitative and typological investigation of spoken registers, Varieties of urban spoken language: a collection of research articles. Raznovidnosti gorodskoy ustnoy rechi, Nauka, Moscow, Russia, 84–150. (In English)
This paper has been supported by the Kazan Federal University Strategic Academic Leadership Program (“PRIORITY-2030”), Strategic Project №4.
We thank Polina Alexandrovna Lekhnitskaya, a student at Kazan Federal University, for her assistance in compiling the corpus of academic texts and cooperation while conducting the research.