International Journal of Applied Science and Engineering
Published by Chaoyang University of Technology

Christine Dewi 1*, Calvin Satya Adi Kristiantoro 1, Henoch Juli Christanto 2*, Dalianus Riantama 3

1 Department of Information Technology, Satya Wacana Christian University, Salatiga City, 50711, Indonesia

2 Department of Information System, Atma Jaya Catholic University of Indonesia, Jakarta, 12930, Indonesia

3 Management Department, BINUS Business School Undergraduate Program, Bina Nusantara University, Jakarta, 11480, Indonesia

Download Citation: |
Download PDF


ABSTRACT

The rapid development of the times and the influence of globalization have enormously changed human life. One of the affected fields is service, and machines are gradually replacing services. Not without reason, the number of bad assessments of services is one of the factors why machines begin to replace the role of humans. The existence of machines also makes it easier for companies to provide services and help cut costs for labor. The machine used in this research was a chatbot. Chatbot is a computer program designed to simulate conversations between humans. The long short- term memory network (LSTM) algorithm was implemented on the chatbot with a natural language processing (NLP) approach in this research. Our experiment was carried out using the NLP approach, where the results were used in the data training process using the bidirectional LSTM algorithm to produce a chatbot model. Next, after evaluating the model, our proposed method outperformed other models in the experiment. Bidirectional LSTM had 98.09% accuracy, 98.23% precision, 98.29% recall, and 98.25% f1 score.


Keywords: Chatbot, LSTM, NLP.


Share this article with your colleagues

 


REFERENCES

  1. Adamopoulou, E., Moussiades, L. 2020. An overview of chatbot technology. IFIP Advances in Information and Communication Technology, 584, 373–383.

  2. Alghifari, R.D., Edi, M., Firmansyah, L. 2022. Implementasi bidirectional LSTM untuk analisis sentimen terhadap layanan grab Indonesia. Jurnal Manajemen Informatika, 12(2), 89–99. (In Indonesian)

  3. Anki, P., Bustamanm A. 2021. Measuring the accuracy of LSTM and BiLSTM models in the application of artificial intelligence by applying a chatbot program. Indonesian Journal of Electrical Engineering and Computer Science, 23(1), 197–205.

  4. Anki, P., Bustamam, A., Al-Ash, S.H., Sarwinda, D. 2021. Intelligent chatbot adapted from question and answer system using RNN-LSTM model. Journal of Physics: Conference Series, 1844 012001.

  5. Calimeri, F., Cauteruccio, F., Cinelli, L., Marzullo, A., Stamile, C., Terracina, G., Durand-Dubief, F., Sappey-Marinier, D. 2019. A logic-based framework leveraging neural networks for studying the evolution of neurological disorders. Theory and Practice of Logic Programming.

  6. Chicho, T.B., Sallow, B.A. 2021. A comprehensive survey of deep learning models based on Keras framework. Journal of Soft Computing and Data Mining, 2(2), 49–62.

  7. Chen, R.-C., Dewi, C., Huang, S.-W., Caraka, E.R. 2020. Selecting critical features for data classification based on machine learning methods. Journal of Big Data, 7(52), 1–26.

  8. Chen, R.-C., Dewi, C., Jiang, X., Yu, H. 2022. Adjusting eye aspect ratio for strong eye blink detection based on facial landmarks. PeerJ Computer Science, 8, e943.

  9. Chowdhary, K.R. 2020. Natural language processing. In: Fundamentals of artificial intelligence. Springer, New Delhi. pp 603–649.

  10. Chung, M., Ko, E., Joung, H., Kim, S. J. 2020. Chatbot e-service and customer satisfaction regarding luxury brands. Journal of Business Research, 117, 587–595.

  11. Chusna, L.N., Tari, R.M.D., Khumaidi, A. 2022. Konfigurasi hyperparameter long short-term memory untuk optimalisasi prediksi penjualan. Faktor Exacta, 15(4), 290–300.

  12. DeSouza, D.D., Robin, J., Gumus, M., Yeung, A. 2021. Natural language processing as an emerging tool to detect late-life depression. Frontiers in Psychiatry, 12, 719125.

  13. Dewi, C., Chen R.-C. 2022. Combination of resnet and spatial pyramid pooling for musical instrument identification. Cybernetics and Information Technologies, 22(1), 104–116.

  14. Dewi, C., Chen, S.P.A., Christanto, J.H. 2023. Deep learning for highly accurate hand recognition based on Yolov7 model. Big Data and Cognitive Computing, 7(1), 53.

  15. Dhandayuthapani, V. 2022. A proposed cognitive framework model for a student support chatbot in a higher education institution. International Journal of Advanced Networking and Applications, 14(2), 5390–5395.

  16. Fida, A.B., Ahmed, U., Al-Balushi, Y., Singh, D. 2020. Impact of service quality on customer loyalty and customer satisfaction in islamic banks in the sultanate of oman. SAGE Open, 10(2), 1–10.

  17. Grattarola, D., Alippi, C. 2021. Graph neural networks in TensorFlow and Keras with Spektral. IEEE Computational Intelligence Magazine, 16(1), 99–106.

  18. Hardi, R., Pee, C.N.A., Abdullah, B.L.H.M., Pitogo, A.V., Pribadi, S.A., Rusdi, F.J. 2022. Academic smart chatbot to support emerging artificial intelligence conversation. 2022 International Conference of Science and Information Technology in Smart Administration (ICSINTESA). Denpasar, Bali, Indonesia, 194–199.

  19. Hastomo, W., Aini, N., Karno, B.S.A., Rere, R.M.L. 2022. Machine learning methods for predicting manure management emissions. Jurnal Nasional Teknik Elektro dan Teknologi Informasi, 11(2), 131–139.

  20. Hu, J., Wang, X., Zhang, Y., Zhang, D., Zhang, M., Xue, J. 2020. Time series prediction method based on variant LSTM recurrent neural network. Neural Processing Letters, 52, 1485–1500.

  21. Jenneboer, L., Herrando, C., Constantinides, E. 2022. The impact of chatbots on customer loyalty: A systematic literature review. Journal of Theoretical and Applied Electronic Commerce Research, 17(1), 212–229.

  22. Khurana, D., Koli, A., Khatter, K., Singh, S. 2023. Natural language processing: State of the art, current trends and challenges. Multimedia Tools and Application, 82, 3713–3744.

  23. Lin, C.-B., Dong, Z., Kuan, Wei.-K., Huang, Y.F. 2021. A framework for fall detection based on openpose skeleton and LSTM/GRU models. Applied Sciences 11(1), 329.

  24. Long, L., Zeng, X. 2022. Recurrent neural network. In: Beginning deep learning with TensorFlow. Apress, Berkeley, CA.

  25. Luo, B., Lau, K.Y.R., Li, C., Si, Y.-W. 2022. A critical review of state-of-the-art chatbot designs and applications. WIREs Data Mining and Knowledge Discovery, 12(1), e1434.

  26. Oruh, J., Viriri, S., Adegun, A. 2022. Long short-term memory recurrent neural network for automatic speech recognition. IEEE Access, 10, 30069–30079.

  27. Rokhmatun, N.P., Maesaroh, S., Putri, R.R.I., Salmah, S., Kurnianingsih, A.S., Fauziah, N.A., Zamani, A., Atmojo T.J., Widiyanto, A. 2023. The relationship between hospital administration and quality of services: Meta-analysis. Journal of Health Policy and Management, 8(1), 39–47.

  28. Sands, S., Ferraro, C., Campbell, C., Tsao, H.Y. 2021. Managing the human–chatbot divide: How service scripts influence service experience. Journal of Service Management, 32(2), 246–264.

  29. Setiawan, I.E. Ferdianto, A., Santoso, J., Kristian, Y., Gunawan, Sumpeno, S., Purnomo, H.M. 2020. Indonesian stance analysis of healthcare news using sentence embedding based on LSTM. Jurnal Nasional Teknik Elektro dan Teknologi Informasi, 9(1), 8–17.

  30. Suhaili, M.S., Salim, N., Jambli, N.M. 2021. Service chatbots: A systematic review. Expert Systems with Applications, 184, 115461.

  31. Tai, S.-K., Dewi, C., Chen, R.-C, Liu, Y.-T., Jiang, X., Yu, H. 2020. Deep learning for traffic sign recognition based on spatial pyramid pooling with scale analysis. Applied Sciences, 10(19), 6997.

  32. Togatorop, R.P., Simanjuntak, P.R., Manurung, B.S., Silalahi, C.M. 2021. Generating entity relationship diagram from requirement specification using natural language processing for indonesian language. Jurnal Komputer dan Informatika, 9(2), 196–206.

  33. Wang, Q., Peng, R.-Q., Wang, J.-Q., Li, Z., Qu, H.-B. 2020. NEWLSTM: An optimized long short-term memory language model for sequence prediction. IEEE Access, 8, 65395–65401.

  34. Wei, L., Guo, D., Chen, Z., Yang, J., Feng, T. 2023. Forecasting short-term passenger flow of subway stations based on the temporal pattern attention mechanism and the long short-term memory network. ISPRS International Journal of Geo-Information, 12(1), 25.

  35. Wintoro, B.P., Hermawan, H., Muda, A.M. Mulyani, Y. 2022. Implementation of long short-term memory in the unila informatics engineering academic information chatbot. EXPERT: Jurnal Manajemen Sistem Informasi dan Teknologi, 12(1), 68–75.

  36. Yuniar, E., Purnomo H. 2019. Implementasi chatbot “ALITTA” asisten virtual dari balittas sebagai pusat informasi di balittas. Antivirus: Jurnal Ilmiah Teknik Informatika, 13(1), 24–35. (In Indonesian)

  37. Zhou, L., Gao, J., Li, D., Shum, H.-Y. 2020. The design and implementation of Xiaoice, an empathetic social chatbot. Computational Linguistics, 46(1), 53–93.


ARTICLE INFORMATION

Received: 2023-06-08
Revised: 2023-08-09
Accepted: 2024-01-29


Cite this article:

Dewi, C., Kristiantoro, C.S.A., Christanto, H.J., Riantama, D. 2024. Improving service quality through classifying chatbot messages based on natural language processing: A bidirectional long short-term memory network model. International Journal of Applied Science and Engineering, 21, 2023204. https://doi.org/10.6703/IJASE.202406_21(2).006

  Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.

Other people also read ...

doaj logo

 

2.3
2022CiteScore
 
 
48th percentile
Powered by  Scopus
 
 

SCImago Journal & Country Rank

IJASE - Most Read Articles

IJASE - Most popular articles