A prospective study, assessing the AI software deployment in a clinical environment to analyze routinely acquired chest CT scans of adult oncology patients. Three time periods of 15 weeks each were compared: routine workflow without AI, manual triage without AI, and worklist prioritization with AI. Diagnostic accuracy of the tool was evaluated on both prospectively and retrospectively collected data. Temporal endpoints including Detection and Notification Times (DNT) were assessed.
A total of 11,736 CT scans were evaluated. Prevalence of IPE was 1.2% (n=143). The AI software detected 131 TP, 12 FN, 31 FP, and 11559 TN. Sensitivity was 91.6%, specificity 99.7%, NPV 99.9%, and PPV 80.9%. When applied retrospectively, the AI software found IPEs in 47 CTs (44.8%) that were missed in the radiology report. The median DNT for IPE positive examinations was 7714, 4973, 87 min for the respective time periods. The difference in DNT between positive and negative CTs was largest when using AI assistance and was significantly different from both workflows without AI.
A commercially available AI tool was found to have a high diagnostic efficacy in detecting IPE on CT of oncology patients. AI assisted worklist prioritization was shown to be effective in significantly reducing the time to diagnosis of IPE cases compared to the routine clinical workflow.