Journal Article

DA-ViT: Deformable Attention Vision Transformer for Alzheimer’s Disease Classification from MRI Scans

Alshomrani, Faisal, Almutairi, Abdulaziz T. M., Alalwany, Easa, Alshuhri, Mohammed S., Almansour, Abdullah G. M., Alfahaid, Abdullah, Alshaari, Hussein

2025

Overview

The early and precise identification of Alzheimer’s Disease (AD) continues to pose considerable clinical difficulty due to subtle structural alterations and overlapping symptoms across the disease phases. This study presents a novel Deformable Attention Vision Transformer (DA-ViT) architecture that integrates deformable Multi-Head Self-Attention (MHSA) with a Multi-Layer Perceptron (MLP) block for efficient classification of Alzheimer’s disease (AD) using Magnetic resonance imaging (MRI) scans. In contrast to traditional vision transformers, our deformable MHSA module preferentially concentrates on spatially pertinent patches through learned offset predictions, markedly diminishing processing demands while improving localized feature representation. DA-ViT contains only 0.93 million parameters, making it exceptionally suitable for implementation in resource-limited settings. We evaluate the model using a class-imbalanced Alzheimer’s MRI dataset comprising 6400 images across four categories, achieving a test accuracy of 80.31%, a macro F1-score of 0.80, and an area under the receiver operating characteristic curve (AUC) of 1.00 for the Mild Demented category. Thorough ablation studies validate the ideal configuration of transformer depth, headcount, and embedding dimensions. Moreover, comparison research indicates that DA-ViT surpasses state-of-the-art pre-trained Convolutional Neural Network (CNN) models in terms of accuracy and parameter efficiency.

• Publisher: Tech Science Press
• Subject: Ablation / Accuracy / Alzheimer's disease / Artificial neural networks / Classification / Deformation / Formability / Magnetic resonance imaging / Multilayer perceptrons / Multilayers / Parameters / Vision transformers