ANALYSIS OF DEEP LEARNING MODELS IN NLP (RNN, LSTM, TRANSFORMER)
Keywords:
Big Data, business processes, data analysis, digital transformation, machine learning, analytical models, decision-making, business efficiency, real-time analytics, information technologies.Abstract
This article explores modern methods for analyzing business processes based on Big Data and their practical significance. The study examines the role of Big Data technologies in improving business efficiency, optimizing decision-making processes, and enhancing competitiveness. Modern approaches such as machine learning, data mining, real-time analytics, and evaluation models are considered. The results demonstrate that Big Data enables the automation of business processes, reduces risks, and provides a deeper understanding of customer needs. The findings have both theoretical and practical significance for developing effective management decisions across various sectors.
Downloads
References
1. Yeh, Yi-Ting & Eden, Rebekah & Fielt, Erwin & Syed, Rehan. (2025). The role of use for the business value of big data analytics. The Journal of Strategic Information Systems. 34. 101888. 10.1016/j.jsis.2025.101888.
2. Jurafsky, Daniel & Martin, James. (2008). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition.
3. Hochreiter, Sepp & Schmidhuber, Jürgen. (1997). Long Short-Term Memory. Neural Computation. 9. 1735-1780. 10.1162/neco.1997.9.8.1735.
4. Rumelhart D. E., Hinton G. E., Williams R. J. Learning Representations by Back-Propagating Errors // Nature. 1986. Vol. 323. P. 533–536.
5. Vaswani A., Shazeer N., Parmar N. et al. Attention Is All You Need // Advances in Neural Information Processing Systems (NeurIPS). 2017. Vol. 30. P. 5998–6008.
6. Goldberg Y. Neural Network Methods for Natural Language Processing. — San Rafael: Morgan & Claypool Publishers, 2017. — 309 p.
7. Young T., Hazarika D., Poria S., Cambria E. Recent Trends in Deep Learning Based Natural Language Processing // IEEE Computational Intelligence Magazine. 2018. — Vol. 13, No. 3. P. 55–75.
8. Brown T. B., Mann B., Ryder N. et al. Language Models are Few-Shot Learners // Advances in Neural Information Processing Systems (NeurIPS). 2020. Vol. 33. — P. 1877–1901.
9. Devlin J., Chang M.-W., Lee K., Toutanova K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding // Proceedings of NAACL-HLT. 2019. P. 4171–4186.
10. LeCun Y., Bengio Y., Hinton G. Deep Learning // Nature. — 2015. — Vol. 521. — P. 436–444.
11. Mikolov T., Chen K., Corrado G., Dean J. Efficient Estimation of Word Representations in Vector Space // Proceedings of ICLR. — 2013.
12. Pennington J., Socher R., Manning C. GloVe: Global Vectors for Word Representation // Proceedings of EMNLP. — 2014. — P. 1532–1543.
13. Sutskever I., Vinyals O., Le Q. Sequence to Sequence Learning with Neural Networks // Advances in Neural Information Processing Systems. 2014. Vol. 27.
14. Bahdanau D., Cho K., Bengio Y. Neural Machine Translation by Jointly Learning to Align and Translate // Proceedings of ICLR. — 2015.
15. Cho K., van Merriënboer B., Gulcehre C. et al. Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation // Proceedings of EMNLP.— 2014. P. 1724–1734.
16. Radford A., Narasimhan K., Salimans T., Sutskever I. Improving Language Understanding by Generative Pre-Training // OpenAI Technical Report. — 2018.
17. Peters M. E., Neumann M., Iyyer M. et al. Deep Contextualized Word Representations // Proceedings of NAACL-HLT. 2018. P. 2227–2237.
18. Alammar J. The Illustrated Transformer. 2018. Available at: https://jalammar.github.io/illustrated-transformer/
19. Aggarwal C. C. Neural Networks and Deep Learning. Cham: Springer, 2018. 497 p.
