Design and application of a structured phantom for detection performance comparison between breast tomosynthesis and digital mammography

This paper introduces and applies a structured phantom with inserted target objects for the comparison of detection performance of digital breast tomosynthesis (DBT) against 2D full field digital mammography (FFDM). The phantom consists of a 48 mm thick breast-shaped polymethyl methacrylate (PMMA) container filled with water and PMMA spheres of different diameters. Three-dimensionally (3D) printed spiculated masses (diameter range: 3.8-9.7 mm) and non-spiculated masses (1.6-6.2 mm) along with microcalcifications (90-250 mu m) were inserted as targets. Reproducibility of the phantom application was studied on a single system using 30 acquisitions. Next, the phantom was evaluated on five different combined FFDM & DBT systems and target detection was compared for FFDM and DBT modes. Ten phantom images in both FFDM and DBT modes were acquired on these 5 systems using automatic exposure control. Five readers evaluated target detectability. Images were read with the fouralternative forced-choice (4-AFC) paradigm, with always one segment including a target and 3 normal background segments. The percentage of correct responses (PC) was assessed based on 10 trials of each reader for each object type, size and imaging modality. Additionally, detection threshold diameters at 62.5 PC were assessed via non-linear regression fitting of the psychometric curve. The reproducibility study showed no significant differences in PC values. Evaluation of target detection in FFDM showed that microcalcification detection thresholds ranged between 110 and 118 mu m and were similar compared to the detection in DBT (range of 106-158 mu m). In DBT, detection of both mass types increased significantly (p = 0.0001 and p = 0.0002 for non-spiculated and spiculated masses respectively) compared to FFDM, achieving almost 100% detection for all spiculated mass diameters. In conclusion, a structured phantom with inserted targets was able to show evidence for detectability differences between FFDM and DBT modes for five commercial systems. This phantom has potential for application in task-based assessment at acceptance and commissioning testing of DBT systems.