LINGUISTIC AND TECHNOLOGICAL FOUNDATIONS FOR BUILDING A LARGE-SCALE UZBEK TEXT CORPUS FOR NATURAL LANGUAGE PROCESSING

Main Article Content

O‘ralova Feruza O‘ktam qizi

Abstract

This article investigates the creation of a large-scale Uzbek text corpus for Natural Language Processing (NLP) systems within the implementation framework of Presidential Decree No. UP-6084 (October 20, 2020) and Presidential Resolutions No. PP-358 (October 14, 2024) and No. PP-308 (October 21, 2025). The study analyzes the impact of the agglutinative nature of the Uzbek language, complex graphemes of the current Latin alphabet (digraphs sh, ch, ng and apostrophe-modified letters o‘, g‘), and the parallel use of Cyrillic and Latin scripts on computational linguistics processes. The author proposes a corpus architecture encompassing text collection, orthographic normalization in Unicode (NFC), contextual transliteration, lemmatization, and morphological tagging. Based on the analysis of domestic and international computational linguistics research, actionable recommendations are formulated for developing a high-precision Uzbek text corpus.

Article Details

Section

Articles

References

1.Sinclair J. Corpus, Concordance, Collocation. – Oxford: Oxford University Press, 1991. – 179 p.

2.Jurafsky D., Martin J. H. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. – 3rd ed. – Stanford: Stanford University, 2023. – 642 p.

3.McEnery T., Wilson A. Corpus Linguistics: An Introduction. – 2nd ed. – Edinburgh: Edinburgh University Press, 2001. – 235 p.

4.Mahmudov N., Madvaliyev A., Mahkamov N. O‘zbek tili imlosi va alifboni takomillashtirish masalalari // O‘zbek tili va adabiyoti. – Toshkent, 2021. – № 2. – B. 12-19.

5.Po‘latov A. K. Kompyuter lingvistikasi. – Toshkent: Akademnashr, 2011. – 520 b.

6.Abdurahmonova N. Z. Kompyuter lingvistikasi asoslari: O‘quv qo‘llanma. – Toshkent: Nodirabegim, 2021. – 216 b.

7.Hamroyeva Sh. M. O‘zbek tili mualliflik korpusini tuzishning lingvistik asoslari. – Buxoro: Durdona, 2018. – 148 b.

8.Mengliyev B. R., Karimov R. A. O‘zbek tili milliy korpusi: nazariya va amaliyot // O‘zbek tili va adabiyoti. – Toshkent, 2020. – № 3. – B. 84-90.

9.Sharipov M., Kuriyozov E. Uzbek Corpus: A Large-Scale Dataset for Natural Language Processing // Proceedings of the Language Resources and Evaluation Conference (LREC). – Marseille, 2022. – Pp. 132-139.

10.Elov B. B., Hamroyeva Sh. M. O‘zbek tili milliy korpusini yaratishda matnlarni avtomatik qayta ishlash va transliteratsiya masalalari // O‘zbekistonda xorijiy tillar. – Toshkent, 2022. – № 4 (45). – B. 38-46.