Deep learning-based combination of [18F]-FDG PET and CT images for producing pulmonary perfusion image

BackgroundThe main application of [18F] FDG-PET ((18)FDG-PET) and CT images in oncology is tumor identification and quantification. Combining PET and CT images to mine pulmonary perfusion information for functional lung avoidance radiation therapy (FLART) is desirable but remains challenging. PurposeTo develop a deep-learning-based (DL) method to combine (18)FDG-PET and CT images for producing pulmonary perfusion images (PPI). MethodsPulmonary technetium-99 m-labeled macroaggregated albumin SPECT (PPISPECT), (18)FDG-PET, and CT images obtained from 53 patients were enrolled. CT and PPISPECT images were rigidly registered, and registration displacement was subsequently used to align (18)FDG-PET and PPISPECT images. The left/right lung was separated and rigidly registered again to improve the registration accuracy. A DL model based on 3D Unet architecture was constructed to directly combine multi-modality (18)FDG-PET and CT images for producing PPI (PPIDLM). 3D Unet architecture was used as the basic architecture, and the input was expanded from a single-channel to a dual-channel to combine multi-modality images. For comparative evaluation, (18)FDG-PET images were also used alone to generate PPIDLPET. Sixty-seven samples were randomly selected for training and cross-validation, and 36 were used for testing. The Spearman correlation coefficient (r(s)) and multi-scale structural similarity index measure (MS-SSIM) between PPIDLM/PPIDLPET and PPISPECT were computed to assess the statistical and perceptual image similarities. The Dice similarity coefficient (DSC) was calculated to determine the similarity between high-/low- functional lung (HFL/LFL) volumes. ResultsThe voxel-wise r(s) and MS-SSIM of PPIDLM/PPIDLPET were 0.78 & PLUSMN; 0.04/0.57 & PLUSMN; 0.03, 0.93 & PLUSMN; 0.01/0.89 & PLUSMN; 0.01 for cross-validation and 0.78 & PLUSMN; 0.11/0.55 & PLUSMN; 0.18, 0.93 & PLUSMN; 0.03/0.90 & PLUSMN; 0.04 for testing. PPIDLM/PPIDLPET achieved averaged DSC values of 0.78 & PLUSMN; 0.03/0.64 & PLUSMN; 0.02 for HFL and 0.83 & PLUSMN; 0.01/0.72 & PLUSMN; 0.03 for LFL in the training dataset and 0.77 & PLUSMN; 0.11/0.64 & PLUSMN; 0.12, 0.82 & PLUSMN; 0.05/0.72 & PLUSMN; 0.06 in the testing dataset. PPIDLM yielded a stronger correlation and higher MS-SSIM with PPISPECT than PPIDLPET (p < 0.001). ConclusionsThe DL-based method integrates lung metabolic and anatomy information for producing PPI and significantly improved the accuracy over methods based on metabolic information alone. The generated PPIDLM can be applied for pulmonary perfusion volume segmentation, which is potentially beneficial for FLART treatment plan optimization.