CNN-based pose estimation for assessing quality of ankle-joint X-ray images

被引:2
作者
Kroenke, Sven [1 ]
von Berg, Jens [1 ]
Brueck, Matthias [1 ]
Bystrov, Daniel [1 ]
Goossen, Andre [1 ]
Harder, Tim [1 ]
Lundt, Bernd [2 ]
May, Jan Marek [2 ]
Wieberneit, Nataly [2 ]
Wissel, Tobias [1 ]
Hertgers, Omar [3 ]
Lamb, Hildo J. [3 ]
Young, Stewart [1 ]
机构
[1] Philips Res, Hamburg, Germany
[2] Philips Healthcare, Diagnost Xray, Hamburg, Germany
[3] Leiden Univ, Dept Radiol, Med Ctr, Leiden, Netherlands
来源
MEDICAL IMAGING 2022: IMAGE PROCESSING | 2022年 / 12032卷
关键词
X-ray; musculoskeletal; image quality; patient positioning; neural networks; pose estimation; articulated model;
D O I
10.1117/12.2611734
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
A novel technology for estimating both the pose and the joint flexion from a single musculoskeletal X-ray image is presented for automatic quality assessment of patient positioning. The method is based on convolutional neural networks and does not require pose or flexion labels of the X-ray images for the training phase. The task is split into two steps: (i) detection of relevant bone contours in the X-ray by a feature-detection network and (ii) regression of the pose and flexion parameters by a pose-estimation network based upon the detected contours. This separation enables the pose-estimation network to be trained using synthetic contours, which are generated via projections of an articulated 3D model of the target anatomy. It is demonstrated that the use of data-augmentation techniques during training of the pose-estimation network significantly contributes to the robustness of the algorithm. Feasibility of the approach is illustrated using lateral ankle X-ray exams. Validation was performed using X-rays of an anthropomorphic phantom of the foot-ankle joint, imaged in various controlled positions. Reference pose parameters were established by an expert using an interactive tool to align the articulated 3D joint model with the phantom image. Errors in pose estimation are in the range of 2 degrees per pose angle and at the level of the expert performance. Using the rigid foot phantom the flexion parameter was constant, but the overall results indicate accurate estimation also of this parameter.
引用
收藏
页数:9
相关论文
共 9 条
[1]   X-ray-transform Invariant Anatomical Landmark Detection for Pelvic Trauma Surgery [J].
Bier, Bastian ;
Unberath, Mathias ;
Zaech, Jan-Nico ;
Fotouhi, Javad ;
Armand, Mehran ;
Osgood, Greg ;
Navab, Nassir ;
Maier, Andreas .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT IV, 2018, 11073 :55-63
[2]   Foveal Fully Convolutional Nets for Multi-Organ Segmentation [J].
Brosch, Tom ;
Saalbach, Axel .
MEDICAL IMAGING 2018: IMAGE PROCESSING, 2018, 10574
[3]   X-ray PoseNet: 6 DoF Pose Estimation for Mobile X-ray Devices [J].
Bui, Mai ;
Albarqouni, Shadi ;
Schrapp, Michael ;
Navab, Nassir ;
Ilic, Slobodan .
2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, :1036-1044
[4]   3D reconstruction of the human rib cage from 2D projection images using a statistical shape model [J].
Dworzak, Jalda ;
Lamecker, Hans ;
von Berg, Jens ;
Klinder, Tobias ;
Lorenz, Cristian ;
Kainmueller, Dagmar ;
Seim, Heiko ;
Hege, Hans-Christian ;
Zachow, Stefan .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2010, 5 (02) :111-124
[5]   Automated segmentation of the left ventricle in cardiac MRI [J].
Kaus, MR ;
von Berg, J ;
Weese, R ;
Niessen, W ;
Pekar, V .
MEDICAL IMAGE ANALYSIS, 2004, 8 (03) :245-254
[6]   PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization [J].
Kendall, Alex ;
Grimes, Matthew ;
Cipolla, Roberto .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2938-2946
[7]  
Mairhofer D., 2021, Medical Imaging with Deep Learning
[8]   DeepDRR - A Catalyst for Machine Learning in Fluoroscopy-Guided Procedures [J].
Unberath, Mathias ;
Zaech, Jan-Nico ;
Lee, Sing Chun ;
Bier, Bastian ;
Fotouhi, Javad ;
Armand, Mehran ;
Navab, Nassir .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT IV, 2018, 11073 :98-106
[9]   Robust Chest X-ray Quality Assessment using Convolutional Neural Networks and Atlas Regularization [J].
von Berg, Jens ;
Kroenke, Sven ;
Goossen, Andre ;
Bystrov, Daniel ;
Brueck, Matthias ;
Harder, Tim ;
Wieberneit, Nataly ;
Young, Stewart .
MEDICAL IMAGING 2020: IMAGE PROCESSING, 2021, 11313