MSKdeX: Musculoskeletal (MSK) Decomposition from an X-Ray Image for Fine-Grained Estimation of Lean Muscle Mass and Muscle Volume

被引:2
作者
Gu, Yi [1 ,2 ]
Otake, Yoshito [1 ]
Uemura, Keisuke [3 ]
Takao, Masaki [4 ]
Soufi, Mazen [1 ]
Hiasa, Yuta
Talbot, Hugues [2 ]
Okada, Seiji
Sugano, Nobuhiko [5 ]
Sato, Yoshinobu [1 ]
机构
[1] Nara Inst Sci & Technol, Grad Sch Sci & Technol, Div Informat Sci, Ikoma, Japan
[2] Univ Paris Saclay, CentraleSupelec, Paris, France
[3] Osaka Univ, Dept Orthopaed, Grad Sch Med, Suita, Osaka, Japan
[4] Ehime Univ, Dept Bone & Joint Surg, Grad Sch Med, Toon, Japan
[5] Osaka Univ, Dept Orthopaed Med Engn, Grad Sch Med, Suita, Osaka, Japan
来源
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VII | 2023年 / 14226卷
关键词
Muscles; Radiography; Generative adversarial networks (GAN); Sarcopenia; Image-to-image translation; BODY-COMPOSITION; SARCOPENIA;
D O I
10.1007/978-3-031-43990-2_47
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Musculoskeletal diseases such as sarcopenia and osteoporosis are major obstacles to health during aging. Although dual-energy X-ray absorptiometry (DXA) and computed tomography (CT) can be used to evaluate musculoskeletal conditions, frequent monitoring is difficult due to the cost and accessibility (as well as high radiation exposure in the case of CT). We propose a method (named MSKdeX) to estimate fine-grained muscle properties from a plain X-ray image, a low-cost, low-radiation, and highly accessible imaging modality, through musculoskeletal decomposition leveraging fine-grained segmentation in CT. We train a multi-channel quantitative image translation model to decompose an X-ray image into projections of CT of individual muscles to infer the lean muscle mass and muscle volume. We propose the object-wise intensity-sum loss, a simple yet surprisingly effective metric invariant to muscle deformation and projection direction, utilizing information in CT and X-ray images collected from the same patient. While our method is basically an unpaired image-to-image translation, we also exploit the nature of the bone's rigidity, which provides the paired data through 2D-3D rigid registration, adding strong pixel-wise supervision in unpaired training. Through the evaluation using a 539-patient dataset, we showed that the proposed method significantly outperformed conventional methods. The average Pearson correlation coefficient between the predicted and CT-derived ground truth metrics was increased from 0.460 to 0.863. We believe our method opened up a new musculoskeletal diagnosis method and has the potential to be extended to broader applications in multi-channel quantitative image translation tasks.
引用
收藏
页码:497 / 507
页数:11
相关论文
共 24 条
[1]   Measurement of skeletal muscle radiation attenuation and basis of its biological variation [J].
Aubrey, J. ;
Esfandiari, N. ;
Baracos, V. E. ;
Buteau, F. A. ;
Frenette, J. ;
Putman, C. T. ;
Mazurak, V. C. .
ACTA PHYSIOLOGICA, 2014, 210 (03) :489-497
[2]   Recent Advances in Sarcopenia Research in Asia: 2016 Update From the Asian Working Group for Sarcopenia [J].
Chen, Liang-Kung ;
Lee, Wei-Ju ;
Peng, Li-Ning ;
Liu, Li-Kuo ;
Arai, Hidenori ;
Akishita, Masahiro .
JOURNAL OF THE AMERICAN MEDICAL DIRECTORS ASSOCIATION, 2016, 17 (08) :767.e1-767.e7
[3]   Osteoporosis and sarcopenia in older age [J].
Edwards, M. H. ;
Dennison, E. M. ;
Sayer, A. Aihie ;
Fielding, R. ;
Cooper, C. .
BONE, 2015, 80 :126-130
[4]   Evaluation of automated computed tomography segmentation to assess body composition and mortality associations in cancer patients [J].
Feliciano, Elizabeth M. Cespedes ;
Popuri, Karteek ;
Cobzas, Dana ;
Baracos, Vickie E. ;
Beg, Mirza Faisal ;
Khan, Arafat Dad ;
Ma, Cydney ;
Chow, Vincent ;
Prado, Carla M. ;
Xiao, Jingjie ;
Liu, Vincent ;
Chen, Wendy Y. ;
Meyerhardt, Jeffrey ;
Albers, Kathleen B. ;
Caan, Bette J. .
JOURNAL OF CACHEXIA SARCOPENIA AND MUSCLE, 2020, 11 (05) :1258-1269
[5]   BMD-GAN: Bone Mineral Density Estimation Using X-Ray Image Decomposition into Projections of Bone-Segmented Quantitative Computed Tomography Using Hierarchical Learning [J].
Gu, Yi ;
Otake, Yoshito ;
Uemura, Keisuke ;
Soufi, Mazen ;
Takao, Masaki ;
Sugano, Nobuhiko ;
Sato, Yoshinobu .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI, 2022, 13436 :644-654
[6]   Automated Muscle Segmentation from Clinical CT Using Bayesian U-Net for Personalized Musculoskeletal Modeling [J].
Hiasa, Yuta ;
Otake, Yoshito ;
Takao, Masaki ;
Ogawa, Takeshi ;
Sugano, Nobuhiko ;
Sato, Yoshinobu .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (04) :1030-1040
[7]   Cross-Modality Image Synthesis from Unpaired Data Using CycleGAN Effects of Gradient Consistency Loss and Training Data Size [J].
Hiasa, Yuta ;
Otake, Yoshito ;
Takao, Masaki ;
Matsuoka, Takumi ;
Takashima, Kazuma ;
Carass, Aaron ;
Prince, Jerry L. ;
Sugano, Nobuhiko ;
Sato, Yoshinobu .
SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, 2018, 11037 :31-41
[8]   Application of deep learning neural network in predicting bone mineral density from plain X-ray radiography [J].
Ho, Chan-Shien ;
Chen, Yueh-Peng ;
Fan, Tzuo-Yau ;
Kuo, Chang-Fu ;
Yen, Tzu-Yun ;
Liu, Yuan-Chang ;
Pei, Yu-Cheng .
ARCHIVES OF OSTEOPOROSIS, 2021, 16 (01)
[9]   Automated bone mineral density prediction and fracture risk assessment using plain radiographs via deep learning [J].
Hsieh, Chen-, I ;
Zheng, Kang ;
Lin, Chihung ;
Mei, Ling ;
Lu, Le ;
Li, Weijian ;
Chen, Fang-Ping ;
Wang, Yirui ;
Zhou, Xiaoyun ;
Wang, Fakai ;
Xie, Guotong ;
Xiao, Jing ;
Miao, Shun ;
Kuo, Chang-Fu .
NATURE COMMUNICATIONS, 2021, 12 (01)
[10]   Sarcopenia: prevalence, associated factors, and the risk of mortality and disability in Japanese older adults [J].
Kitamura, Akihiko ;
Seino, Satoshi ;
Abe, Takumi ;
Nofuji, Yu ;
Yokoyama, Yuri ;
Amano, Hidenori ;
Nishi, Mariko ;
Taniguchi, Yu ;
Narita, Miki ;
Fujiwara, Yoshinori ;
Shinkai, Shoji .
JOURNAL OF CACHEXIA SARCOPENIA AND MUSCLE, 2021, 12 (01) :30-38