Journal Article

Multimodal image registration techniques: a comprehensive survey

Bastidas, Gisel, Rouhani, Mohammad, Velesaca, Henry O., Sappa, Angel D.

2024

Overview

This manuscript presents a review of state-of-the-art techniques proposed in the literature for multimodal image registration, addressing instances where images from different modalities need to be precisely aligned in the same reference system. This scenario arises when the images to be registered come from different modalities, among the visible and thermal spectral bands, 3D-RGB, or flash-no flash, or NIR-visible. The review spans different techniques from classical approaches to more modern ones based on deep learning, aiming to highlight the particularities required at each step in the registration pipeline when dealing with multimodal images. It is noteworthy that medical images are excluded from this review due to their specific characteristics, including the use of both active and passive sensors or the non-rigid nature of the body contained in the image.

• Publisher: Springer US,Springer Nature B.V
• Subject: Computer Communication Networks / Computer Science / Data Structures and Information Theory / Deep learning / Image registration / Information sources / Medical imaging / Multimedia / Multimedia Information Systems / Reference systems / Registration / Remote sensing / Sensors / Special Purpose and Application-Based Systems / Spectral bands / State-of-the-art reviews / Track 6: Computer Vision for Multimedia Applications