Comparing Machine Learning Classification Models on a Loan Approval Prediction Dataset
Abstract views: 116 / PDF downloads: 33
Keywords:Machine Learning, Classification, Loan Approval Prediction, Dataset Analysis, Neural Network, Ensemble Model
In the last decade, we have observed the usage of artificial intelligence algorithms and machine learning models in industry, education, healthcare, entertainment, and several other areas. In this paper, we focus on using machine learning algorithms in the loan approval process of financial institutions. First, we briefly review some prior research papers that dealt with loan approval predictions using machine learning models. Next, we analyze the loan approval prediction dataset we downloaded from Kaggle, which was used in this paper to compare several machine learning classification models. During this analysis, we observed that credit scores and loan terms are the attributes that probably most affect the result. Next, we divided the dataset into a training set (80%) and a test set (20%). We trained 27 various machine learning models in MATLAB. Three models were optimized with Bayesian optimization to find the best hyperparameters with minimum error. We used 5-fold cross-validation for the validations to prevent overfitting during the training. In the following step, we used the test set on trained models to measure the models’ accuracy on unseen data. The result showed that the best accuracy both on validation and test data, more than 98%, was reached with neural networks and ensemble classification models.
M. T. Fülöp, M. Gubán, Á. Gubán, and M. Avornicului, “Application Research of Soft Computing Based on Machine Learning Production Scheduling,” Processes 2022, vol. 10, issue 3, paper 520, March 2022. https://doi.org/10.3390/pr10030520
N. Annuš, “Usability of Artificial Intelligence to Create Predictive Models in Education,” in EDULEARN23 Proceedings, 2023, pp. 5061–5065.
N. Annuš, “Weigh the Pros and Cons of Using Artificial Intelligence in Education,” International Journal of Science, Engineering and Technology (IJSET), vol. 11, issue 3, May 2023.
J. Udvaros and N. Forman, “Artificial Intelligence and Education 4.0,” in INTED2023 Proceedings, 2023, pp. 6309–6317. https://doi.org/10.21125/inted.2023.1670
A. Al Kuwaiti, K. Nazer, A. Al-Reedy, S. Al-Shehri, A. Al-Muhanna, A. V. Subbarayalu, D. Al Muhanna, F. A. Al-Muhanna, “A Review of the Role of Artificial Intelligence in Healthcare,” Journal of Personalized Medicine, vol. 13, issue 6, paper 951, June 2023. https://doi.org/10.3390/jpm13060951
A. Zahlan, R. P. Ranjan, D. Hayes, “Artificial intelligence innovation in healthcare: Literature review, exploratory analysis, and future research,” Technology in Society, vol. 74, paper 102321, August 2023. https://doi.org/10.1016/j.techsoc.2023.102321
S. Gupta. (2023) AI in Entertainment. [Online]. Available: https://www.scaler.com/topics/ai-inentertainment/
Z. Illési and V. Honfi, “A Security Assessment of AI, Related to the Financial Institutions,” in SecurityRelated Advanced Technologies in Critical Infrastructure Protection, 2022, pp. 85–94.https://doi.org/10.1007/978-94-024-2174-3_7
S. S. Sai, A. B. Krishna, P. Ganthi, S. K. Kankanala, S. Tinnaluri, and V. Simhadri, “Machine Learning Algorithms for Predicting the Loan Status,” Journal of Survey in Fisheries Sciences, vol. 10, no. 25, pp. 3677–3685, 2023.
M. A. Sheikh, A. K. Goel, and T. Kumar, “An Approach for Prediction of Loan Approval usingMachine Learning Algorithm,” in Proceedings of the International Conference on Electronics and Sustainable Communication Systems (ICESC 2020), IEEE, 2020, pp. 490–494.
Y. Divate, P. Rana, and P. Chavan, “Loan Approval Prediction Using Machine Learning,” International Research Journal of Engineering and Technology (IRJET), vol. 8, issue 5, pp. 1741–1745, May 2021.
N. Pandey, R. Gupta, S. Uniyal, and V. Kumar, “Loan Approval Prediction using Machine Learning Algorithms Approach,” International Journal of Innovative Research in Technology (IJIRT), vol. 8, issue 1, pp. 898–902, June 2021.
A. Shinde, Y. Patil, I. Kotian, A. Shinde, and R. Gulwani, “Loan Prediction System Using Machine Learning,” in International Conference on Automation, Computing and Communication 2022 (ICACC-2022), ITM Web of Conferences 44, 2022, paper 03019, p. 4. https://doi.org/10.1051/itmconf/20224403019
A. Sharma. (2023) Loan-Approval-Prediction-Dataset. Loan Approval Dataset used for Prediction Models. [Online]. Available: