Journal Article

Prediction of diabetes disease using an ensemble of machine learning multi-classifier models

Farnoosh, Rahman, Behzadi, Mohammad Hassan, Abnoosian, Karlo

2023

Overview

Background and objective Diabetes is a life-threatening chronic disease with a growing global prevalence, necessitating early diagnosis and treatment to prevent severe complications. Machine learning has emerged as a promising approach for diabetes diagnosis, but challenges such as limited labeled data, frequent missing values, and dataset imbalance hinder the development of accurate prediction models. Therefore, a novel framework is required to address these challenges and improve performance. Methods In this study, we propose an innovative pipeline-based multi-classification framework to predict diabetes in three classes: diabetic, non-diabetic, and prediabetes, using the imbalanced Iraqi Patient Dataset of Diabetes. Our framework incorporates various pre-processing techniques, including duplicate sample removal, attribute conversion, missing value imputation, data normalization and standardization, feature selection, and k-fold cross-validation. Furthermore, we implement multiple machine learning models, such as k-NN, SVM, DT, RF, AdaBoost, and GNB, and introduce a weighted ensemble approach based on the Area Under the Receiver Operating Characteristic Curve (AUC) to address dataset imbalance. Performance optimization is achieved through grid search and Bayesian optimization for hyper-parameter tuning. Results Our proposed model outperforms other machine learning models, including k-NN, SVM, DT, RF, AdaBoost, and GNB, in predicting diabetes. The model achieves high average accuracy, precision, recall, F1-score, and AUC values of 0.9887, 0.9861, 0.9792, 0.9851, and 0.999, respectively. Conclusion Our pipeline-based multi-classification framework demonstrates promising results in accurately predicting diabetes using an imbalanced dataset of Iraqi diabetic patients. The proposed framework addresses the challenges associated with limited labeled data, missing values, and dataset imbalance, leading to improved prediction performance. This study highlights the potential of machine learning techniques in diabetes diagnosis and management, and the proposed framework can serve as a valuable tool for accurate prediction and improved patient care. Further research can build upon our work to refine and optimize the framework and explore its applicability in diverse datasets and populations.

• Publisher: BioMed Central,BioMed Central Ltd,Springer Nature B.V,BMC
• Subject: Algorithms / Analysis / Bayesian analysis / Bioinformatics / Biomedical and Life Sciences / Care and treatment / Chronic diseases / Chronic illnesses / Classification / Computational Biology/Bioinformatics / Computer Appl. in Life Sciences / Datasets / Decision tree / Diabetes / Diabetes disease prediction / Diabetes mellitus / Diabetes therapy / Diabetics / Diagnosis / Ensemble machine learning models / Feature selection / Learning algorithms / Life Sciences / Machine learning / Machine learning classifiers / Mathematical models / Medical research / Medicine, Experimental / Microarrays / Neural networks / Optimization / Performance enhancement / Prediabetic state / Prediction models / Random forest / Risk factors / Standardization / Support vector machines