External Validation of Diagnostic Models to Estimate the Risk of Malignancy in Adnexal Masses

被引:69
作者
Van Holsbeke, Caroline [1 ,2 ]
Van Calster, Ben [2 ,3 ]
Bourne, Tom [2 ,5 ]
Ajossa, Silvia [6 ]
Testa, Antonia C. [7 ]
Guerriero, Stefano [6 ]
Fruscio, Robert [8 ]
Lissoni, Andrea Alberto [8 ]
Czekierdowski, Artur [10 ]
Savelli, Luca [9 ]
Van Huffel, Sabine [3 ,4 ]
Valentin, Lil [11 ]
Timmerman, Dirk [2 ]
机构
[1] ZOL Genk, Dept Obstet & Gynaecol, B-3600 Genk, Belgium
[2] Univ Hosp Leuven, Dept Obstet & Gynaecol, Louvain, Belgium
[3] ESAT SCD, Dept Elect Engn, Louvain, Belgium
[4] Katholieke Univ Leuven, IBBT KU Leuven Future Hlth Dept, Louvain, Belgium
[5] Univ London Imperial Coll Sci Technol & Med, Dept Obstet & Gynaecol, London, England
[6] Univ Cagliari, Osped San Giovanni di Dio, Dept Obstet & Gynecol, Cagliari, Italy
[7] Univ Cattolica Sacro Cuore, Ist Clin Ostetr & Ginecol, Rome, Italy
[8] Univ Milano Bicocca, Osped S Gerardo, Clin Ostetr & Ginecol, Monza, Italy
[9] St Orsola Marcello Malpighi Hosp, Dept Obstet & Gynecol, Reproduct Med Unit, Bologna, Italy
[10] Med Univ Lublin, Dept Gynecol Oncol & Gynecol 1, Lublin, Poland
[11] Lund Univ, Malmo Univ Hosp, Dept Obstet & Gynaecol, Lund, Sweden
基金
英国医学研究理事会;
关键词
OVARIAN-TUMOR-ANALYSIS; PROSPECTIVE CROSS-VALIDATION; LOGISTIC-REGRESSION MODELS; PELVIC MASSES; PREOPERATIVE DIAGNOSIS; MATHEMATICAL-MODELS; ULTRASOUND EXAMINATION; MENOPAUSAL STATUS; SERUM CA-125; IOTA GROUP;
D O I
10.1158/1078-0432.CCR-11-0879
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
Purpose: To externally validate and compare the performance of previously published diagnostic models developed to predict malignancy in adnexal masses. Experimental Design: We externally validated the diagnostic performance of 11 models developed by the International Ovarian Tumor Analysis (IOTA) group and 12 other (non-IOTA) models on 997 prospectively collected patients. The non-IOTA models included the original risk of malignancy index (RMI), three modified versions of the RMI, six logistic regression models, and two artificial neural networks. The ability of the models to discriminate between benign and malignant adnexal masses was expressed as the area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and likelihood ratios (LR+, LR-). Results: Seven hundred and forty-two (74%) benign and 255 (26%) malignant masses were included. The IOTA models did better than the non-IOTA models (AUCs between 0.941 and 0.956 vs. 0.839 and 0.928). The difference in AUC between the best IOTA and the best non-IOTA model was 0.028 [95% confidence interval (CI), 0.011-0.044]. The AUC of the RMI was 0.911 (difference with the best IOTA model, 0.044; 95% CI, 0.024-0.064). The superior performance of the IOTA models was most pronounced in premenopausal patients but was also observed in postmenopausal patients. IOTA models were better able to detect stage I ovarian cancer. Conclusion: External validation shows that the IOTA models outperform other models, including the current reference test RMI, for discriminating between benign and malignant adnexal masses. Clin Cancer Res; 18(3); 815-25. (C)2011 AACR.
引用
收藏
页码:815 / 825
页数:11
相关论文
共 44 条
[21]   Comparison of non-parametric confidence intervals for the area under the ROC curve of a continuous-scale diagnostic test [J].
Qin, Gengsheng ;
Hotilovac, Lejla .
STATISTICAL METHODS IN MEDICAL RESEARCH, 2008, 17 (02) :207-221
[22]   PROGNOSTIC FACTORS IN ADVANCED OVARIAN-CARCINOMA [J].
REDMAN, JR ;
PETRONI, GR ;
SAIGO, PE ;
GELLER, NL ;
HAKES, TB .
JOURNAL OF CLINICAL ONCOLOGY, 1986, 4 (04) :515-523
[23]   Partially parametric techniques for multiple imputation [J].
Schenker, N ;
Taylor, JMG .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 1996, 22 (04) :425-446
[24]   Sonographic prediction of malignancy in adnexal masses using multivariate logistic regression analysis [J].
Tailor, A ;
Jurkovic, D ;
Bourne, TH ;
Collins, WP ;
Campbell, S .
ULTRASOUND IN OBSTETRICS & GYNECOLOGY, 1997, 10 (01) :41-47
[25]   Logistic regression model to distinguish between the benign and malignant adnexal mass before surgery: A multicenter study by the International Ovarian Tumor Analysis Group [J].
Timmerman, D ;
Testa, AC ;
Bourne, T ;
Ferrazzi, E ;
Ameye, L ;
Konstantinovic, ML ;
Van Calster, B ;
Collins, WP ;
Vergote, I ;
Van Huffel, S ;
Valentin, L .
JOURNAL OF CLINICAL ONCOLOGY, 2005, 23 (34) :8794-8801
[26]   Ovarian cancer prediction in adnexal masses using ultrasound-based logistic regression models: a temporal and external validation study by the IOTA group [J].
Timmerman, D. ;
Van Calster, B. ;
Testa, A. C. ;
Guerriero, S. ;
Fischerova, D. ;
Lissoni, A. A. ;
Van Holsbeke, C. ;
Fruscio, R. ;
Czekierdowski, A. ;
Jurkovic, D. ;
Savelli, L. ;
Vergote, I. ;
Bourne, T. ;
Van Huffel, S. ;
Valentin, L. .
ULTRASOUND IN OBSTETRICS & GYNECOLOGY, 2010, 36 (02) :226-234
[27]   Terms, definitions and measurements to describe the sonographic features of adnexal tumors: a consensus opinion from the International Ovarian Tumor Analysis (IOTA) group [J].
Timmerman, D ;
Valentin, L ;
Bourne, TH ;
Collins, WP ;
Verrelst, H ;
Vergote, I .
ULTRASOUND IN OBSTETRICS & GYNECOLOGY, 2000, 16 (05) :500-505
[28]   Artificial neural network models for the preoperative discrimination between malignant and benign adnexal masses [J].
Timmerman, D ;
Verrelst, H ;
Bourne, TH ;
De Moor, B ;
Collins, WP ;
Vergote, I ;
Vandewalle, J .
ULTRASOUND IN OBSTETRICS & GYNECOLOGY, 1999, 13 (01) :17-25
[29]   A comparison of methods for preoperative discrimination between malignant and benign adnexal masses: The development of a new logistic regression model [J].
Timmerman, D ;
Bourne, TH ;
Tailor, A ;
Collins, WP ;
Verrelst, H ;
Vandenberghe, K ;
Vergote, I .
AMERICAN JOURNAL OF OBSTETRICS AND GYNECOLOGY, 1999, 181 (01) :57-65
[30]   Inclusion of CA-125 does not improve mathematical models developed to distinguish between benign and malignant adnexal tumors [J].
Timmerman, Dirk ;
Van Calster, Ben ;
Jurkovic, Davor ;
Valentin, Lil ;
Testa, Antonia C. ;
Bernard, Jean-Pierre ;
Van Holsbeke, Caroline ;
Van Huffel, Sabine ;
Vergote, Ignace ;
Bourne, Tom .
JOURNAL OF CLINICAL ONCOLOGY, 2007, 25 (27) :4194-4200