Implementation of Natural Language Processing (NLP) in Developing a Chatbot Application for Classical Islamic Text Learning at Pesantren El-Huda El-Islamy
Main Article Content
Abstract
El-Huda El-Islamy Islamic Boarding School is an Islamic educational institution that aims to mould students into competent and noble religious preachers. This institution focuses on learning and deep understanding of Islamic teachings, including the study of classical books such as the Yellow Book of Fathul Qorib. This research aims to develop and evaluate an Android-based chatbot application that uses the BERT model to help the learning process of the Yellow Book of Fathul Qorib at El-Huda Islamic Boarding School. In this research, the BERT model is integrated into the chatbot application to understand and respond to user questions appropriately. Testing was done by asking 25 questions to the chatbot, which successfully answered 11 questions with a success rate of 44%. Evaluation of the model performance using confusion matrix showed that the chatbot had 90% accuracy, 87% precision, 87% recall, and 86% F1-score. These results show that the chatbot has not been able to provide relevant and accurate responses, and recognise most of the questions asked. This research concludes that this chatbot application is not yet an effective tool to support the learning process at El-Huda Islamic Boarding School
Article Details

This work is licensed under a Creative Commons Attribution 4.0 International License.
References
A. Muchasan, N. Syam, and A. Humaidi, “Title: Use of Technology in Islamic Boarding Schools (Impact and Solutions in Educational Context)”.
M. R. Astari, M. Sa’id, A. Kunta Mardlian, S. Bahri, and M. U. Siregar, “Rancangan Aplikasi Chatbot Telegram ‘Tanya Zaid’ Sebagai Media Pembelajaran Nahwu,” 2023.
A. Y. Chandra, D. Kurniawan, and R. Musa, “Perancangan Chatbot Menggunakan Dialogflow Natural Language Processing (Studi Kasus: Sistem Pemesanan pada Coffee Shop),” Jurnal Media Informatika Budidarma, vol. 4, no. 1, p. 208, 2020.
Vidya Chandradev, I Made Agus Dwi Suarjaya, and I Putu Agung Bayupati, “Analisis Sentimen Review Hotel Menggunakan Metode Deep Learning BERT,” Jurnal Buana Informatika, vol. 14, no. 02, pp. 107–116, 2023.
Yudha Nurdin, Khairun Saddami, Nasaruddin “Pengenalan Praktis Supervised Machine Learning: Dengan Jupyter Notebook”, Banda Aceh, 2025, pp. 16-17.
Anita Wasilewska, Churn-Jung Liau, Tsau Young Lin, Ying Xie, “Data Mining: Foundations and Practice”, Berlin, 2008, pp. 260.
Nasir Ali Mirza, “Practitioner's Guide to Data Science. Streamlining Data Science Solutions Using Python, Scikit-Learn, and Azure ML Service Platform”, Delhi, 2022, pp. 116
Sreedhar, G, “Web Data Mining and the Development of Knowledge-Based Decision Support Systems”, Hershey PA, 2016, pp. 209.
David L. Olson, Dursun Delen, “Advanced Data Mining Techniques”, Berlin, 2008, pp.10.
Graham J. Williams, Graham Williams, “Data Mining with Rattle and R. The Art of Excavating Data for Knowledge Discovery”, New York, 2011, pp. 36.