Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
120
result(s) for
"spatial spectral representation"
Sort by:
Deep Boltzmann machine algorithm for accurate medical image analysis for classification of cancerous region
by
Nadar, Edward Rajan Samuel
,
Jeyaraj, Pandia Rajan
in
Accuracy
,
accurate medical image analysis
,
Algorithms
2019
In this research work, a deep learning algorithm is applied to the medical domain to deliver a better healthcare system. For this, a deep learning framework for classification the region of interest pattern of complex hyperspectral medical images is proposed. The performance of computer-aided diagnosis by verifying the region in hyperspectral image by pre and post-cancerous region classification is enhanced. For this a deep Boltzmann machine (DBM) architecture of the bipartite structure as an unsupervised generative model was developed. The performance of DBM is compared with deep convolutional neural network architecture. For implementation, a three-layer unsupervised network with a backpropagation structure is used. From the presented dataset, image patches are collected and classified into two classes, namely non-informative and discriminative classes as labelled classes. The spatial information is used for classification and spectral-spatial representation of class labels is formed. In the labelled classes, the accuracy, false-positive predictions, sensitivity are obtained for the proposed fully-connected network. By the proposed cognitive computation technique an accuracy of 95.5% with 93.5% sensitivity was obtained. From the obtained classification, accuracy and success rate DBM provide a better classification of complex images compared to traditional convolution network.
Journal Article
The Spectral-Spatial Joint Learning for Change Detection in Multispectral Imagery
2019
Change detection is one of the most important applications in the remote sensing domain. More and more attention is focused on deep neural network based change detection methods. However, many deep neural networks based methods did not take both the spectral and spatial information into account. Moreover, the underlying information of fused features is not fully explored. To address the above-mentioned problems, a Spectral-Spatial Joint Learning Network (SSJLN) is proposed. SSJLN contains three parts: spectral-spatial joint representation, feature fusion, and discrimination learning. First, the spectral-spatial joint representation is extracted from the network similar to the Siamese CNN (S-CNN). Second, the above-extracted features are fused to represent the difference information that proves to be effective for the change detection task. Third, the discrimination learning is presented to explore the underlying information of obtained fused features to better represent the discrimination. Moreover, we present a new loss function that considers both the losses of the spectral-spatial joint representation procedure and the discrimination learning procedure. The effectiveness of our proposed SSJLN is verified on four real data sets. Extensive experimental results show that our proposed SSJLN can outperform the other state-of-the-art change detection methods.
Journal Article
Cross Attention Based Dual-Modality Collaboration for Hyperspectral Image and LiDAR Data Classification
2025
Advancements in satellite sensor technology have enabled access to diverse remote sensing (RS) data from multiple platforms. Hyperspectral Image (HSI) data offers rich spectral detail for material identification, while LiDAR captures high-resolution 3D structural information, making the two modalities naturally complementary. By fusing HSI and LiDAR, we can mitigate the limitations of each and improve tasks like land cover classification, vegetation analysis, and terrain mapping through more robust spectral–spatial feature representation. However, traditional multi-scale feature fusion models often struggle with aligning features effectively, which can lead to redundant outputs and diminished spatial clarity. To address these issues, we propose the Cross Attention Bridge for HSI and LiDAR (CAB-HL), a novel dual-path framework that employs a multi-stage cross-attention mechanism to guide the interaction between spectral and spatial features. In CAB-HL, features from each modality are refined across three progressive stages using cross-attention modules, which enhance contextual alignment while preserving the distinctive characteristics of each modality. These fused representations are subsequently integrated and passed through a lightweight classification head. Extensive experiments on three benchmark RS datasets demonstrate that CAB-HL consistently outperforms existing state-of-the-art models, confirm that CAB-HL consistently outperforms in learning deep joint representations for multimodal classification tasks.
Journal Article
Hyperspectral classification employing spatial–spectral low rank representation in hidden fields
by
Wang, Jin
,
Wang, Shunfeng
,
Jeon, Byeungwoo
in
Artificial Intelligence
,
Classification
,
Classifiers
2024
This paper presents a novel classification method based on spatial–spectral low-rank representation in the hidden field under a Bayesian framework for hyperspectral imagery. The key idea of the method is to simultaneously explore the low-rank property in the spectral domain and nonlocal self-similarity in the spatial domain of the hidden field, which is estimated by sparse multinomial logistic regression in a supervised manner. First, the low rank property in the spectral domain is exploited in local cubic patches. Following this, similar cubic patches are clustered into several groups in a nonlocal sense and patches in each group are assumed to lie in a low-rank subspace. The final model could be efficiently solved by the augmented Lagrangian method. Experimental results on two real hyperspectral datasets validate that the proposed classifier produces a superior performance compared to other state-of-the-art classifiers in terms of overall accuracy, average accuracy and the kappa statistic (
k
).
Journal Article
Low-Rank and Sparse Representation with Adaptive Neighborhood Regularization for Hyperspectral Image Classification
2022
Low-Rank and Sparse Representation (LRSR) method has gained popularity in Hyperspectral Image (HSI) processing. However, existing LRSR models rarely exploited spectral-spatial classification of HSI. In this paper, we proposed a novel Low-Rank and Sparse Representation with Adaptive Neighborhood Regularization (LRSR-ANR) method for HSI classification. In the proposed method, we first represent the hyperspectral data via LRSR since it combines both sparsity and low-rankness to maintain global and local data structures simultaneously. The LRSR is optimized by using a mixed Gauss-Seidel and Jacobian Alternating Direction Method of Multipliers (M-ADMM), which converges faster than ADMM. Then to incorporate the spatial information, an ANR scheme is designed by combining Euclidean and Cosine distance metrics to reduce the mixed pixels within a neighborhood. Lastly, the predicted labels are determined by jointly considering the homogeneous pixels in the classification rule of the minimum reconstruction error. Experimental results based on three popular hyperspectral images demonstrate that the proposed method outperforms other related methods in terms of classification accuracy and generalization performance.
Journal Article
SSCNet: A Spectrum-Space Collaborative Network for Semantic Segmentation of Remote Sensing Images
2023
Semantic segmentation plays a pivotal role in the intelligent interpretation of remote sensing images (RSIs). However, conventional methods predominantly focus on learning representations within the spatial domain, often resulting in suboptimal discriminative capabilities. Given the intrinsic spectral characteristics of RSIs, it becomes imperative to enhance the discriminative potential of these representations by integrating spectral context alongside spatial information. In this paper, we introduce the spectrum-space collaborative network (SSCNet), which is designed to capture both spectral and spatial dependencies, thereby elevating the quality of semantic segmentation in RSIs. Our innovative approach features a joint spectral–spatial attention module (JSSA) that concurrently employs spectral attention (SpeA) and spatial attention (SpaA). Instead of feature-level aggregation, we propose the fusion of attention maps to gather spectral and spatial contexts from their respective branches. Within SpeA, we calculate the position-wise spectral similarity using the complex spectral Euclidean distance (CSED) of the real and imaginary components of projected feature maps in the frequency domain. To comprehensively calculate both spectral and spatial losses, we introduce edge loss, Dice loss, and cross-entropy loss, subsequently merging them with appropriate weighting. Extensive experiments on the ISPRS Potsdam and LoveDA datasets underscore SSCNet’s superior performance compared with several state-of-the-art methods. Furthermore, an ablation study confirms the efficacy of SpeA.
Journal Article
Graph convolutional networks: a comprehensive review
by
Xu, Jiejun
,
Tong, Hanghang
,
Maciejewski, Ross
in
Artificial neural networks
,
Bioinformatics
,
Computer vision
2019
Graphs naturally appear in numerous application domains, ranging from social analysis, bioinformatics to computer vision. The unique capability of graphs enables capturing the structural relations among data, and thus allows to harvest more insights compared to analyzing data in isolation. However, it is often very challenging to solve the learning problems on graphs, because (1) many types of data are not originally structured as graphs, such as images and text data, and (2) for graph-structured data, the underlying connectivity patterns are often complex and diverse. On the other hand, the representation learning has achieved great successes in many areas. Thereby, a potential solution is to learn the representation of graphs in a low-dimensional Euclidean space, such that the graph properties can be preserved. Although tremendous efforts have been made to address the graph representation learning problem, many of them still suffer from their shallow learning mechanisms. Deep learning models on graphs (e.g., graph neural networks) have recently emerged in machine learning and other related areas, and demonstrated the superior performance in various problems. In this survey, despite numerous types of graph neural networks, we conduct a comprehensive review specifically on the emerging field of graph convolutional networks, which is one of the most prominent graph deep learning models. First, we group the existing graph convolutional network models into two categories based on the types of convolutions and highlight some graph convolutional network models in details. Then, we categorize different graph convolutional networks according to the areas of their applications. Finally, we present several open challenges in this area and discuss potential directions for future research.
Journal Article
S2A-Swin: Spectral Smoothing–Guided Spectral–Spatial Windows with Generative Augmentation for Hyperspectral Image Classification Under Class Imbalance and Limited Labels
2026
Hyperspectral image (HSI) classification faces the challenges of scarce labeled data and severe class imbalance, which limits the effective training and generalization capabilities of models. To address these issues, we propose S2A-Swin, a joint spatial–spectral hybrid Swin Transformer framework. First, we develop a spectral–spatial conditional generative adversarial network (SSC-cGAN), which combines spectral and spatial smoothing regularizers to synthesize class-specific image patches, thus alleviating the problems of data scarcity and class imbalance while maintaining spectral continuity and local spatial structure consistent with real data. Second, we introduce a dimension-aware hybrid Transformer module, which adds local windows along the spectral dimension to the standard spatial window, thereby facilitating cross-dimensional feature interactions and ensuring that each spectral band is modeled using the local spatial context for more efficient joint spatial–spectral modeling. In this module, attention mechanisms for spectral and spatial windows are applied alternately (“cross-sequence” attention mechanisms), the execution order of which is guided by hyperspectral prior knowledge to enhance cross-dimensional representation learning. This module is embedded in the lightweight Swin backbone and extends the traditional spatial window mechanism through spectral window attention, capturing spectral continuity while maintaining spatial structure consistency. Extensive experiments on multiple datasets demonstrate that, compared to mainstream CNN and Transformer baselines on four benchmark datasets, the proposed method achieves overall accuracy (OA) improvements of 2.45%, 7.05%, 5.17%, and 0.85%.
Journal Article
A Dual-Stream State-Space Fusion Network with Implicit Neural Representation for Hyperspectral–Multispectral Image Fusion
2026
What are the main findings? We demonstrate that prevailing CNN- and Transformer-based HSI–MSI fusion frameworks may exhibit limited capability in capturing long-range spectral–spatial dependencies and preserving cross-modal consistency, which can lead to spatial artifacts and spectral deviations in the reconstructed HR-HSI. We develop a dual-stream state-space fusion network with implicit neural representation (INR)-based refinement, and extensive experiments on four public benchmarks validate consistent improvements in both quantitative metrics and visual fidelity. What are the implications of the main findings? The proposed state-space-driven spectral–spatial modeling provides a principled and efficient mechanism for mitigating spectral distortion while enhancing structural continuity, thereby improving the reliability of HR-HSI reconstruction. Higher-quality fused hyperspectral products can serve as stronger inputs for downstream remote sensing applications (e.g., land-cover classification, target recognition, and change analysis), potentially improving task robustness and performance. Hyperspectral–multispectral (HSI–MSI) image fusion aims to reconstruct high-spatial-resolution hyperspectral images (HR-HSIs) by combining the spectral fidelity of low-resolution HSIs (LR-HSIs) with the spatial details of high-resolution MSIs (HR-MSIs). A key challenge is preserving spectral–spatial consistency under cross-modal resolution mismatch, where inadequate long-range dependency modeling and unstable inter-modality interaction may induce spectral distortion and structural discontinuities. This paper proposes DSIR-Net (DSIR), a dual-stream state-space fusion architecture equipped with an implicit neural representation (INR) module. DSIR decouples spectral and spatial representation learning into two coordinated streams and leverages state-space modeling to aggregate global context efficiently during progressive fusion. Moreover, INR-based coordinate-conditioned refinement provides continuous sub-pixel compensation, enhancing high-frequency detail recovery while suppressing fusion-induced artifacts. Across four commonly used benchmark datasets, DSIR shows consistent advantages over the competing methods in both numerical metrics and visual reconstruction quality. In addition to sharper structural details, DSIR preserves spectral information more faithfully. Using the best result among the baselines on each dataset as reference, the PSNR improvements are 0.040 dB (Houston), 0.204 dB (PaviaU), 0.093 dB (Botswana), and 0.163 dB (Chikusei).
Journal Article
SSF-TransUnet: Fine-Grained Crop Classification via Cross-Source Spatial Spectral Fusion
by
Jiang, Zhenzhao
,
Ren, Rongrong
,
Yan, Jian
in
Agriculture
,
Artificial neural networks
,
Cereal crops
2026
Accurate exploitation of spatial structures and spectral characteristics is essential for fine-grained crop classification using remote sensing imagery. Although multi-source remote sensing data provide complementary information, most existing methods implicitly assume homogeneous data sources with consistent spatial resolution. In practice, high spatial resolution and rich spectral information are usually provided by different sensors, making cross-source spatial–spectral fusion a non-trivial challenge. To address this issue, we propose SSF-TransUnet, a dual-branch spatial–spectral joint modeling framework for fine crop classification. The proposed network explicitly decouples spatial structure extraction and spectral discriminability learning by jointly utilizing high spatial resolution imagery and multi-spectral observations acquired from different satellite sensors within a unified architecture. To support model training and evaluation, we construct SSCR-Agri, a spatial–spectral complementary resolution agricultural dataset integrating meter-level GF-2 imagery and multi-spectral Sentinel-2 data from five representative agricultural regions in northern China, covering five crop categories including corn, rice, wheat, potato, and others. Extensive experiments demonstrate that SSF-TransUnet consistently outperforms representative CNN-based and hybrid CNN–Transformer models. The proposed method achieves an overall accuracy (OA) of 81.84% and a mean Intersection over Union (mIoU) of 0.6954 in fine-grained crop classification, effectively distinguishing crops. These results highlight the effectiveness of spatial–spectral joint modeling for high-resolution crop mapping and demonstrate its potential for precision agriculture and large-scale agricultural monitoring applications, and shows a promising mechanism when combined with multi-temporal observations.
Journal Article