Journal Article

X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module

Chen, Hanliang, Sun, Zhonghua, Li, Zhe, Zhang, Hu, Pogue, Brian W., Geng, Mengfan, Cao, Xu, Feng, Jinchao, Jia, Kebin

2023

Overview

X-ray Cherenkov-luminescence tomography (XCLT) produces fast emission data from megavoltage (MV) x-ray scanning, in which the excitation location of molecules within tissue is reconstructed. However standard filtered backprojection (FBP) algorithms for XCLT sinogram reconstruction can suffer from insufficient data due to dose limitations, so there are limits in the reconstruction quality with some artifacts. We report a deep learning algorithm for XCLT with high image quality and improved quantitative accuracy. To directly reconstruct the distribution of emission quantum yield for x-ray Cherenkov-luminescence tomography, we proposed a three-component deep learning algorithm that includes a Swin transformer, convolution neural network, and locality module model. A data-to-image model x-ray Cherenkov-luminescence tomography is developed based on a Swin transformer, which is used to extract pixel-level prior information from the sinogram domain. Meanwhile, a convolutional neural network structure is deployed to transform the extracted pixel information from the sinogram domain to the image domain. Finally, a locality module is designed between the encoder and decoder connection structures for delivering features. Its performance was validated with simulation, physical phantom, and experiments. This approach can better deal with the limits to data than conventional FBP methods. The method was validated with numerical and physical phantom experiments, with results showing that it improved the reconstruction performance mean square error ( ), peak signal-to-noise ratio ( ), and Pearson correlation ( ) compared with the FBP algorithm. The Swin-CNN also achieved a 32.1% improvement in PSNR over the deep learning method AUTOMAP. This study shows that the three-component deep learning algorithm provides an effective reconstruction method for x-ray Cherenkov-luminescence tomography.

• Publisher: SPIE,S P I E - International Society for,Society of Photo-Optical Instrumentation Engineers
• Subject: Algorithms / Artificial neural networks / Coders / Computational linguistics / Data mining / Datasets / Deep Learning / Electric transformers / Emission / Emissions / Image Processing, Computer-Assisted - methods / Image quality / Image reconstruction / Imaging / Information processing / Language processing / Luminescence / Machine learning / Medical imaging / Medical imaging equipment / Modules / Natural language interfaces / Neural networks / Neural Networks, Computer / Phantoms, Imaging / Pixels / Signal to noise ratio / Teaching methods / Tissues / Tomography / Tomography, X-Ray Computed - methods / Transformers / X-Rays