Comparison of two different DL-based CAD systems regarding pulmonary nodule detection, localisation and classification: a multi-reader study
Author Block: A. A. Peters1, N. Wiescholek1, J. Klaus1, F. Strodka1, A. Macek1, E. C. Primetis2, D. D. Drakopoulos2, A. Christe1, L. Ebner1; 1Bern/CH, 2Muri bei Bern/CH
Purpose: The aim of this study was to evaluate and compare the performance of two DL-CAD systems regarding detection, localisation and classification of pulmonary nodules.
Methods or Background: The main study cohort contained 122 proven T1 tumors of the lung and was extended by 83 cases (subsolid, n=13; solid<6mm, n=40; controls, n=30), resulting in a primary cohort of n=205. Two different DL-CAD systems analyzed all cases. Five independent blinded readers with different experience levels (residents, n=3; seniors, n=2) performed two readout sessions, first stand-alone and then with access to the results of one of the DL-CAD systems. Two readers used software 1 and the three readers used software 2 and scored nodule size, density and localisation. LungRADS categories were calculated and compared.
Results or Findings: After application of the eligibility criteria, the final cohort consisted of 198 subjects with 221 pulmonary nodules. Residents' mean detection rate increased from 64% to 77% (p<0.001) using the respective DL-CAD (table 2), while the seniors’ detection rates did not improve (p=0.25). Regarding the correct localization of the nodules, the residents' rates for lobar (73% vs. 77%; p<0.001) and segmental (64% vs. 68%; p<0.001) nodule localisation improved significantly, the seniors showed no significant benefit. Regarding software comparison, software 2 lead to a slightly higher increase in detection rates (software 1, 80% to 86% and software 2, 67% to 77%; both p<0.001). Both systems showed no significant effect on the rate of correct LungRADS classification.
Conclusion: Less experienced readers have more benefits from using DL-CAD systems regarding detection and localisation of pulmonary nodules. There is no effect on correct LungRADS classification. Both systems performed comparably, software 2 lead to a higher increase in detection rates.
Limitations: Selection bias (high cancer prevalence). Nodule size groups categorized instead of exact measures.
Funding for this study: No funding was obtained for the current study.
Has your study been approved by an ethics committee? Yes
Ethics committee - additional information: This study was approved by the Kantonale Ethikkommision (KEK) Bern.