Journal Article

Deep learning extended depth-of-field microscope for fast and slide-free histology

Robinson, Jacob T., Badaoui, Hawraa, Coole, Jackson B., Richards-Kortum, Rebecca R., Tan, Melody T., Williams, Michelle D., Wu, Yicheng, Gillenwater, Ann M., Zhao, Xuan, Jin, Lingbo, Tang, Yubo, Veeraraghavan, Ashok

2020

Overview

Microscopic evaluation of resected tissue plays a central role in the surgical management of cancer. Because optical microscopes have a limited depth-of-field (DOF), resected tissue is either frozen or preserved with chemical fixatives, sliced into thin sections placed on microscope slides, stained, and imaged to determine whether surgical margins are free of tumor cells—a costly and time- and labor-intensive procedure. Here, we introduce a deep-learning extended DOF (DeepDOF) microscope to quickly image large areas of freshly resected tissue to provide histologic-quality images of surgical margins without physical sectioning. The DeepDOF microscope consists of a conventional fluorescence microscope with the simple addition of an inexpensive (less than $10) phase mask inserted in the pupil plane to encode the light field and enhance the depth-invariance of the point-spread function. When used with a jointly optimized image-reconstruction algorithm, diffraction-limited optical performance to resolve subcellular features can be maintained while significantly extending the DOF (200 μm). Data from resected oral surgical specimens show that the DeepDOF microscope can consistently visualize nuclear morphology and other important diagnostic features across highly irregular resected tissue surfaces without serial refocusing. With the capability to quickly scan intact samples with subcellular detail, the DeepDOF microscope can improve tissue sampling during intraoperative tumor-margin assessment, while offering an affordable tool to provide histological information from resected tissue specimens in resource-limited settings.

• Publisher: National Academy of Sciences
• Subject: Algorithms / Animals / Biopsy - instrumentation / Biopsy - methods / Biopsy - standards / Calibration / Carcinoma - pathology / Deep Learning / Engineering / Humans / Image Processing, Computer-Assisted - instrumentation / Image Processing, Computer-Assisted - methods / Image Processing, Computer-Assisted - standards / Microscopy, Fluorescence - instrumentation / Microscopy, Fluorescence - methods / Microscopy, Fluorescence - standards / Mouth Neoplasms - pathology / Physical Sciences / Swine