Journal Article

How to Learn More? Exploring Kolmogorov–Arnold Networks for Hyperspectral Image Classification

Ghamisi, Pedram, Hong, Danfeng, Jamali, Ali, Roy, Swalpa Kumar, Lu, Bing

2024

Overview

Convolutional neural networks (CNNs) and vision transformers (ViTs) have shown excellent capability in complex hyperspectral image (HSI) classification. However, these models require a significant number of training data and are computational resources. On the other hand, modern Multi-Layer Perceptrons (MLPs) have demonstrated a great classification capability. These modern MLP-based models require significantly less training data compared with CNNs and ViTs, achieving state-of-the-art classification accuracy. Recently, Kolmogorov–Arnold networks (KANs) were proposed as viable alternatives for MLPs. Because of their internal similarity to splines and their external similarity to MLPs, KANs are able to optimize learned features with remarkable accuracy, in addition to being able to learn new features. Thus, in this study, we assessed the effectiveness of KANs for complex HSI data classification. Moreover, to enhance the HSI classification accuracy obtained by the KANs, we developed and proposed a hybrid architecture utilizing 1D, 2D, and 3D KANs. To demonstrate the effectiveness of the proposed KAN architecture, we conducted extensive experiments on three newly created HSI benchmark datasets: QUH-Pingan, QUH-Tangdaowan, and QUH-Qingyun. The results underscored the competitive or better capability of the developed hybrid KAN-based model across these benchmark datasets over several other CNN- and ViT-based algorithms, including 1D-CNN, 2DCNN, 3D CNN, VGG-16, ResNet-50, EfficientNet, RNN, and ViT.

• Publisher: MDPI AG
• Subject: Accuracy / Algorithms / Artificial neural networks / Benchmarks / Classification / Computer vision / Datasets / Deep learning / Effectiveness / hyperspectral data / Hyperspectral imaging / Image classification / Image processing / KAN / Kolmogorov–Arnold networks / Methods / MLP / Multilayer perceptrons / Multilayers / Neural networks / Remote sensing / Similarity / vision transformer