<?xml version='1.0' encoding='utf-8'?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<article article-type="research-article" dtd-version="1.2" xml:lang="ru" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><front><journal-meta><journal-id journal-id-type="issn">2313-8912</journal-id><journal-title-group><journal-title>Research Result. Theoretical and Applied Linguistics</journal-title></journal-title-group><issn pub-type="epub">2313-8912</issn></journal-meta><article-meta><article-id pub-id-type="doi">10.18413/2313-8912-2024-10-2-0-6</article-id><article-id pub-id-type="publisher-id">3501</article-id><article-categories><subj-group subj-group-type="heading"><subject>APPLIED LINGUISTICS</subject></subj-group></article-categories><title-group><article-title>&lt;strong&gt;Multi-word expressions for Russian L2 learners: corpora-based selection with expert verification&lt;/strong&gt;</article-title><trans-title-group xml:lang="en"><trans-title>&lt;strong&gt;Multi-word expressions for Russian L2 learners: corpora-based selection with expert verification&lt;/strong&gt;</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Laposhina</surname><given-names>Antonina Nikolaevna</given-names></name><name xml:lang="en"><surname>Laposhina</surname><given-names>Antonina Nikolaevna</given-names></name></name-alternatives><email>antonina.laposhina@gmail.com</email><xref ref-type="aff" rid="aff1" /></contrib><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Khramchanka</surname><given-names>Tatsiana Alyaksandrauna</given-names></name><name xml:lang="en"><surname>Khramchanka</surname><given-names>Tatsiana Alyaksandrauna</given-names></name></name-alternatives><email>hramchenkot@mail.ru</email><xref ref-type="aff" rid="aff2" /></contrib><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Lebedeva</surname><given-names>Maria Yuryevna</given-names></name><name xml:lang="en"><surname>Lebedeva</surname><given-names>Maria Yuryevna</given-names></name></name-alternatives><email>m.u.lebedeva@gmail.com</email><xref ref-type="aff" rid="aff1" /></contrib></contrib-group><aff id="aff2"><institution>Belarusian State University</institution></aff><aff id="aff1"><institution>Pushkin State Russian Language Institute</institution></aff><pub-date pub-type="epub"><year>2024</year></pub-date><volume>10</volume><issue>2</issue><fpage>0</fpage><lpage>0</lpage><self-uri content-type="pdf" xlink:href="/media/linguistics/2024/2/2024-02_июнь_Том_10_2-117-137.pdf" /><abstract xml:lang="ru"><p>The article describes the experience of creating a corpus-based list of the most relevant multi-word expressions for Russian L2 learners, distributed across the levels of the Common European Framework of Reference for Languages (CEFR) from A1 to C1. Modern linguistic and cognitive research shows that our speech is patterned and largely consists of stable segments. This fact is supported by the linguodidactic idea of teaching not isolated language units but their combinations of different nature. However, the selection and ranking of multi-word expressions based on language proficiency levels is constrained by the difficulty of automatically extracting them from a corpus of texts and estimating their frequency, as well as disagreements in defining the boundaries, linguistic nature, and terminology of multi-word expressions. This article describes the experience of compiling a list of the most valuable fixed-type multi-word expressions from various sources: two types of existing CEFR-graded vocabulary lists for Russian L2 learners &amp;ndash; lexical minimums for the TORFL (Test of Russian as a Foreign Language) system and Russian KELLY (KEywords for Language Learning for Young and adults alike); the most frequent n-grams from the RuFoLa &amp;ndash; Russian L2 textbook corpus and from the Russian Web corpus of internet texts; list of discourse formulas from the &amp;laquo;Pragmaticon&amp;raquo; project. The CEFR level of each multi-word expression is predicted using the frequency-based Max Delta measure, and its effectiveness is subsequently validated through annotation by multiple experts. The resulting list of multi-word expressions contains 1645 entries from A1 to C1 levels. The proposed version of the list has been implemented into an automated text analysis system for learners of Russian as a Foreign Language and can be useful for a wide range of professionals in the preparation of educational content for foreign language learners. The suggested Max Delta measure has demonstrated a high degree of agreement with expert evaluations within proficiency levels A1-B1. This signifies the importance of further exploring its potential in addressing related practical tasks and in selecting language learning content derived for other languages.</p></abstract><trans-abstract xml:lang="en"><p>The article describes the experience of creating a corpus-based list of the most relevant multi-word expressions for Russian L2 learners, distributed across the levels of the Common European Framework of Reference for Languages (CEFR) from A1 to C1. Modern linguistic and cognitive research shows that our speech is patterned and largely consists of stable segments. This fact is supported by the linguodidactic idea of teaching not isolated language units but their combinations of different nature. However, the selection and ranking of multi-word expressions based on language proficiency levels is constrained by the difficulty of automatically extracting them from a corpus of texts and estimating their frequency, as well as disagreements in defining the boundaries, linguistic nature, and terminology of multi-word expressions. This article describes the experience of compiling a list of the most valuable fixed-type multi-word expressions from various sources: two types of existing CEFR-graded vocabulary lists for Russian L2 learners &amp;ndash; lexical minimums for the TORFL (Test of Russian as a Foreign Language) system and Russian KELLY (KEywords for Language Learning for Young and adults alike); the most frequent n-grams from the RuFoLa &amp;ndash; Russian L2 textbook corpus and from the Russian Web corpus of internet texts; list of discourse formulas from the &amp;laquo;Pragmaticon&amp;raquo; project. The CEFR level of each multi-word expression is predicted using the frequency-based Max Delta measure, and its effectiveness is subsequently validated through annotation by multiple experts. The resulting list of multi-word expressions contains 1645 entries from A1 to C1 levels. The proposed version of the list has been implemented into an automated text analysis system for learners of Russian as a Foreign Language and can be useful for a wide range of professionals in the preparation of educational content for foreign language learners. The suggested Max Delta measure has demonstrated a high degree of agreement with expert evaluations within proficiency levels A1-B1. This signifies the importance of further exploring its potential in addressing related practical tasks and in selecting language learning content derived for other languages.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>Multi-word expressions</kwd><kwd>Multi-word units</kwd><kwd>Vocabulary acquisition</kwd><kwd>Formulaic sequences</kwd><kwd>Lexical approach</kwd><kwd>Collocations</kwd><kwd>Russian as a foreign language</kwd></kwd-group><kwd-group xml:lang="en"><kwd>Multi-word expressions</kwd><kwd>Multi-word units</kwd><kwd>Vocabulary acquisition</kwd><kwd>Formulaic sequences</kwd><kwd>Lexical approach</kwd><kwd>Collocations</kwd><kwd>Russian as a foreign language</kwd></kwd-group></article-meta></front><back><ack><p>The article was prepared with the financial support of the state assignment of Ministry of Education and Science of the Russian Federation for 2020&amp;ndash;2024 (No. FZNM-2020-0005) - Laposhina A.N., Lebedeva M.Yu. The study was conducted during the participation of Khramchanka T. A. in the fellowship programme &amp;laquo;InteRussia&amp;raquo; of the Gorchakov Fund.</p></ack><ref-list><title>Список литературы</title><ref id="B1"><mixed-citation>Eremina,&amp;nbsp;O.&amp;nbsp;S. (2020). Russian non-free expressions in the speech of foreigners: a corpus approach, Russkiy yazyk za rubezhom, 6 (283), 29-35. https://doi.org/10.37632/PI.2020.283.6.004 (In Russian)</mixed-citation></ref><ref id="B2"><mixed-citation>Inkova,&amp;nbsp;O.&amp;nbsp;Ju. (2015). On the question of lemmatization of multi-component units, Proceedings of the international conference &amp;laquo;Corpus Linguistics &amp;ndash; 2015&amp;raquo;, June 22&amp;ndash;26, 2015, St. Petersburg, Russia, 1-10. (In Russian)</mixed-citation></ref><ref id="B3"><mixed-citation>Iordanskaya,&amp;nbsp;L.&amp;nbsp;N. and Melchuk,&amp;nbsp;I.&amp;nbsp;A. (2007). Smysl i sochetaemost v slovare [Meaning and combinability in the dictionary], M.: Yazyki slavjanskih kul&amp;rsquo;tur, Moscow, Russia. (In Russian)</mixed-citation></ref><ref id="B4"><mixed-citation>Laposhina,&amp;nbsp;A.&amp;nbsp;N. (2020). A corpus of Russian textbook materials for foreign students as an instrument of an educational content analysis, Russkiy yazyk za rubezhom, 6 (283), 22-28. https://doi.org/10.37632/PI.2020.283.6.003 (In Russian)</mixed-citation></ref><ref id="B5"><mixed-citation>Minaeva,&amp;nbsp;E.&amp;nbsp;V. (2017). Discursive words in modern colloquial speech and in RCT textbooks, Mezhdunarodniy aspirantskiy vestnik, 2, 74-79. (In Russian)</mixed-citation></ref><ref id="B6"><mixed-citation>Puzhaeva,&amp;nbsp;S.&amp;nbsp;Ju., Gerasimenko,&amp;nbsp;E.&amp;nbsp;A., Zakharova,&amp;nbsp;E.&amp;nbsp;S., Rakhilina,&amp;nbsp;E.&amp;nbsp;V. (2018). Automatic extraction of discourse formulas from Russian language texts, Vestn. Novosib. gos. un-ta. Seriya: Lingvistika i mezhkulturnaya kommunikatsiya, 16 (2), 5-18. https://doi.org/10.25205/1818-7935-2018-16-2-5-18 (In Russian)</mixed-citation></ref><ref id="B7"><mixed-citation>Svirina,&amp;nbsp;L.&amp;nbsp;O. (2019). Formal language and level of foreign language communicative competence, Filologiya i kultura, 1 (55), 97-101. (In Russian)</mixed-citation></ref><ref id="B8"><mixed-citation>Shlyakhov,&amp;nbsp;V.&amp;nbsp;I. and Saakyan,&amp;nbsp;L.&amp;nbsp;N. (2015). Tekst v kommunikativnom prostranstve [Text in communicative space], Moscow, Russia. (In Russian)</mixed-citation></ref><ref id="B9"><mixed-citation>Alfter,&amp;nbsp;D., Bizzoni,&amp;nbsp;Y., Agebjorn,&amp;nbsp;A., Volodina,&amp;nbsp;E. and Pilan,&amp;nbsp;I. (2016). From distributions to labels: A lexical proficiency analysis using learner corpora, Proceedings of the joint workshop on NLP4CALL and NLP for Language Acquisition at SLTC, Ume&amp;aring;, Sweden, November 2016, 130, 1-7. (In English)</mixed-citation></ref><ref id="B10"><mixed-citation>Bahns,&amp;nbsp;J. and Eldaw,&amp;nbsp;M. (1993). Should We Teach EFL Students Collocations? System, 21(1), 101-114. (In English)</mixed-citation></ref><ref id="B11"><mixed-citation>Bybee,&amp;nbsp;J. (1998). The emergent lexicon, Chicago Linguistic Society, 34, 421-435. (In English)</mixed-citation></ref><ref id="B12"><mixed-citation>Calzolari, N., Fillmore,&amp;nbsp;C., Grishman,&amp;nbsp;R., Ide,&amp;nbsp;N., Lenci,&amp;nbsp;A., Macleod,&amp;nbsp;C. and Zampolli,&amp;nbsp;A. (2002). Towards best practice for multiword expressions in computational lexicons, Proceedings of LREC 2002, Las Palmas, Canary Islands &amp;ndash; Spain, May 2002, 1934-1940. (In English)</mixed-citation></ref><ref id="B13"><mixed-citation>Christiansen,&amp;nbsp;M.&amp;nbsp;H. and Chater,&amp;nbsp;N. (2016). The Now-or-Never bottleneck: A fundamental constraint on language, Behavioral &amp;amp; Brain Sciences, 39, 62-102. https://doi.org/10.1017/S0140525X1500031X (In English)</mixed-citation></ref><ref id="B14"><mixed-citation>De Cock,&amp;nbsp;S., Granger,&amp;nbsp;S., Leech,&amp;nbsp;G. and Mcenery,&amp;nbsp;T. (1998). An automated approach to the phrasicon of EFL learners, Learner English on computer, 67-79. https://doi.org/10.4324/9781315841342 (In English)</mixed-citation></ref><ref id="B15"><mixed-citation>Volodina,&amp;nbsp;Е., Pil&amp;aacute;n,&amp;nbsp;I., Enstr&amp;ouml;m,&amp;nbsp;I., Llozhi,&amp;nbsp;L., Lundkvist,&amp;nbsp;P., Sundberg,&amp;nbsp;G. and Sandell,&amp;nbsp;M. (2016). SweLL on the rise: Swedish Learner Language corpus for European Reference Level studies, Proceedings of LREC 2016, Portorož, Slovenia, May 2016, 206-212. (In English)</mixed-citation></ref><ref id="B16"><mixed-citation>Elman,&amp;nbsp;J.&amp;nbsp;L. (2009). On the meaning of words and dinosaur bones: Lexical knowledge without a lexicon, Cognitive Science, 33, 547-582. https://doi.org/10.1111/j.1551-6709.2009.01023.x (In English)</mixed-citation></ref><ref id="B17"><mixed-citation>Fran&amp;ccedil;ois,&amp;nbsp;T., Gala,&amp;nbsp;N., Watrin,&amp;nbsp;P. and Fairon,&amp;nbsp;C. (2014). FLELex: a graded lexical resource for French foreign learners, The 9th International Conference on Language Resources and Evaluation (LREC 2014), Reykjavik, Iceland, 26-31 May 2014, 3766&amp;ndash;3773. (In English)</mixed-citation></ref><ref id="B18"><mixed-citation>Janda,&amp;nbsp;L., Endresen,&amp;nbsp;A., Zhukova,&amp;nbsp;V., Mordashova,&amp;nbsp;D. and Rakhilina,&amp;nbsp;E. (2020). How to build a constructicon in five years: The Russian Example, The Wealth and Breadth of Construction-Based Research (a thematic issue of Belgian Journal of Linguistics), 34, 162-175. (In English)</mixed-citation></ref><ref id="B19"><mixed-citation>Jolsvai,&amp;nbsp;H., McCauley,&amp;nbsp;S.&amp;nbsp;M. and Christiansen,&amp;nbsp;M.&amp;nbsp;H. (2013). Meaning overrides frequency in idiomatic and compositional multiword chunks, Proceedings of the 35th Annual Conference of the Cognitive Science Society, Austin, Tx, January 2013, 692&amp;ndash;697. (In English)</mixed-citation></ref><ref id="B20"><mixed-citation>Kilgarriff,&amp;nbsp;A., Charalabopoulou,&amp;nbsp;F., Gavrilidou,&amp;nbsp;M., Johannessen,&amp;nbsp;J., Saussan,&amp;nbsp;K., Kokkinakis,&amp;nbsp;S., Lew,&amp;nbsp;R., Sharoff,&amp;nbsp;S., Vadlapudi,&amp;nbsp;R. and Volodina,&amp;nbsp;E. (2014). Corpus-Based Vocabulary lists for Language Learners for Nine Languages, Language Resources and Evaluation Journal, 48, 121-163. https://doi.org/10.1007/s10579-013-9251-2 (In English)</mixed-citation></ref><ref id="B21"><mixed-citation>Kopotev,&amp;nbsp;M., Escoter,&amp;nbsp;L., Kormacheva,&amp;nbsp;D., Pierce,&amp;nbsp;M., Pivovarova,&amp;nbsp;L. and Yangarber,&amp;nbsp;R. (2015). CoCoCo: Online Extraction of Russian Multiword Expressions, The 5th Workshop on Balto-Slavic Natural Language Processing 2015, Hissar, Bulgaria, September 2015, 43-45. (In English)</mixed-citation></ref><ref id="B22"><mixed-citation>Kopotev,&amp;nbsp;M., Pivovarova,&amp;nbsp;L. and Kormacheva,&amp;nbsp;D. (2016). Constructional generalization over Russian collocations, Mémoires de la Société néophilologique de Helsinki, Tome C (Collocations Cross-Linguistically), 121-140. (In English)</mixed-citation></ref><ref id="B23"><mixed-citation>Kopotev,&amp;nbsp;M., Pivovarova,&amp;nbsp;L., Kochetkova,&amp;nbsp;N. and Yangarber,&amp;nbsp;R. (2013). Automatic detection of stable grammatical features in n-grams, Proceedings of the 9th Workshop on Multiword Expressions, Atlanta, GA, June 2013, 73-81. (In English)</mixed-citation></ref><ref id="B24"><mixed-citation>Lewis,&amp;nbsp;M. (1997). Implementing the Lexical Approach: Putting Theory into Practice, Language Teaching Publications, Hove, England. (In English)</mixed-citation></ref><ref id="B25"><mixed-citation>Loukachevitch,&amp;nbsp;N. and Lashevich,&amp;nbsp;G. (2016). Multiword expressions in Russian Thesauri RuThes and RuWordNet, Proceedings of the AINL FRUCT 2016 Conference, Saint Petersburg, Russia, December 2016, 66-71. (In English)</mixed-citation></ref><ref id="B26"><mixed-citation>McClelland,&amp;nbsp;J.&amp;nbsp;L. (2010). Emergence in cognitive science, Topics in Cognitive Science, 2 (4), 751-770. https://doi.org/10.1111/j.1756-8765.2010.01116.x (In English)</mixed-citation></ref><ref id="B27"><mixed-citation>Paquot,&amp;nbsp;M. and Granger,&amp;nbsp;S. (2012). Formulaic Language in Learner Corpora, Annual Review of Applied Linguistics, 32, 130&amp;ndash;149. https://doi.org/10.1017/S0267190512000098 (In English)</mixed-citation></ref><ref id="B28"><mixed-citation>Parmentier,&amp;nbsp;Y. and Waszczuk,&amp;nbsp;J. (2019). Representation and parsing of multiword expressions: Current trends (Phraseology and Multiword Expressions 3), Language Science Press, Berlin, Germany, 326. (In English)</mixed-citation></ref><ref id="B29"><mixed-citation>Schmitt,&amp;nbsp;N. (2004). Formulaic Sequences: Acquisition, processing and use, John Benjamins Publishing Company, Amsterdam, Netherlands, 304. (In English)</mixed-citation></ref><ref id="B30"><mixed-citation>Wray,&amp;nbsp;A. (2000). Formulaic sequences in second language teaching: Principles and practice, Applied Linguistics, 21(4), 463-489. https://doi.org/10.1093/applin/21.4.463 (In English)</mixed-citation></ref><ref id="B31"><mixed-citation>Wray,&amp;nbsp;A. (2002). Formulaic language and the lexicon, Cambridge University Press, Cambridge, UK. (In English)</mixed-citation></ref></ref-list></back></article>