NLPNING ZAMONAVIY ALGORITMLARI VA KONSEPSIYALARI

Аннотация

Natural language processing (NLP) algorithms serve to process human language data, including unstructured text data. Today, NLP algorithms are developed based on language rule-based, statistical and artificial intelligence approaches. Based on the approach based on language rules, the formation of linguistic bases for NLP tasks and the operations of classification in language corpora are performed. Statistical algorithms allow machines to read, understand and derive meaning from human languages and are based on processing large volumes of (bigdata) texts. Statistical algorithms are used in many NLP tasks such as speech recognition, machine translation, sentiment analysis, text classification and analysis. Today, deep learning models of machine learning (ML) algorithms based on CNN and RNN technologies allow to "learn" existing NLP systems and allow more accurate processing of large volumes of unstructured texts. This article discusses modern algorithms and concepts of NLP today, and methods of processing texts in the Uzbek language based on these algorithms are given.