Journal Article

Decoding student cognitive abilities: a comparative study of explainable AI algorithms in educational data mining

Xiang, Ao, Pang, Patrick Cheong-Iao, Niu, Tianyue, Huang, Shuaishuai, Liu, Ting, Luo, Yiming Taclis

2025

Overview

Exploring students’ cognitive abilities has long been an important topic in education. This study employs data-driven artificial intelligence (AI) models supported by explainability algorithms and PSM causal inference to investigate the factors influencing students’ cognitive abilities, and it delved into the differences that arise when using various explainability AI algorithms to analyze educational data mining models. In this paper, five AI models were used to model educational data. Subsequently, four interpretable algorithms, including feature importance, Morris Sensitivity, SHAP, and LIME, were used to globally interpret the results, and PSM causal tests were performed on the factors that affect students’ cognitive abilities. The results reveal that self-perception and parental expectations have a certain impact on students’ cognitive abilities, as indicated by all algorithms. Our work also uncovers that different explainability algorithms exhibit varying preferences and inclinations when interpreting the model, as evidenced by discrepancies in the top ten features highlighted by each algorithm. Morris Sensitivity presents a more balanced perspective, while SHAP and feature importance reflect the diversity of interpretable algorithms, and LIME shows a unique perspective. This detailed observation highlights the practical contribution of interpretable AI algorithms in the field of educational data mining, paving the way for more refined applications and deeper insights in future research.

• Publisher: Nature Publishing Group UK,Nature Publishing Group,Nature Portfolio
• Subject: 631/477 / 631/477/2811 / 639/705/117 / Accuracy / Algorithms / Artificial Intelligence / Cognition / Cognition & reasoning / Cognitive abilities / Cognitive ability / Cognitive development / Comparative studies / Critical thinking / Data mining / Data Mining - methods / Education / Educational data mining / Explainability algorithms / Female / Humanities and Social Sciences / Humans / Hypotheses / Machine learning / Male / multidisciplinary / Research methodology / Science / Science (multidisciplinary) / Skills / Socioeconomic factors / Socioeconomic status / Statistical methods / Student teacher relationship / Students / Students - psychology