Journal Article

Cut2Self: A single image based self‐supervised denoiser

Bae, Sung‐Ho, Jubyrea, Iqbal, Md. Tauhid Bin, Ryu, Byungyong

2023

Overview

Despite the recent upsurge of self‐supervised methods in single image denoising, achieving robustness and efficiency of performance is still challenging due to some prevalent issues like identity mapping, overfitting, and increased variance of network predictions. Recent self‐supervised approaches prescribe a dropout‐based single‐pixel masking strategy in this regard. However, real camera noise is signal‐dependent, and typically poses trivial changes to the images. Hence, such a strategy still preserves contextual information about target location even after dropping them out, leading to an identity mapping and overfitting problems in practice. Here, Cut2Self, a new denoising method to address this issue, which cuts out random block‐regions instead of singleton pixels to provide the higher possibility to remove contextual information from the neighbouring pixels, thus reducing identity mapping chances while being resilient against overfitting is proposed. Cut2Self creates distinct training pairs for each training iteration by randomly cutting out square regions of input and sending them to the denoising network. Thus, iteration‐wise different network predictions are generated, which are then assembled to generate the final denoised output. Cut2Self is evaluated with synthetic and real‐world noise, visualising its consistent denoising performance compared to other supervised, unsupervised, and self‐supervised methods. Recent self‐supervised denoising approaches prescribe a dropout‐based single‐pixel masking strategy. However, real camera noise is signal dependent, and typically poses trivial changes to the images. Hence, such strategy still preserves contextual information about target location even after dropping them out, leading to identity mapping and overfitting problems in practice. Here, Cut2Self, a new denoising method to address this issue, which cuts out random block‐regions instead of singleton pixels to provide the higher possibility to remove contextual information from the neighbouring pixels, thus reducing identity mapping chances while being resilient against overfitting is proposed.

• Publisher: John Wiley & Sons, Inc,Wiley
• Subject: Datasets / Experiments / image and vision processing and display technology / image denoising / image filtering / image processing / image sensors / Mapping / Noise / Noise prediction / Noise reduction / Performance evaluation / Pixels