Detection of Pneumonia in Children through Chest Radiographs using Artificial Intelligence in a Low-Resource Setting: A Pilot Study
Author Block: T. O. Togunwa, A. Babatunde, R. B. Olatunji, O. E. Fatade, G. I. Ogbole, A. Falade; Ibadan/NG
Purpose: Pneumonia remains a leading cause of death in under-5 children in low- and middle-income countries (LMICs), exacerbated by limited diagnostic imaging expertise. Artificial intelligence (AI) shows potential in improving pneumonia diagnosis from chest radiographs (CXRs). However, most models lack external validation on prospective clinical data from LMICs. This study aims to develop and validate an AI model for childhood pneumonia detection in Nigeria.
Methods or Background: In a multi-center cross-sectional study in Ibadan, Nigeria, CXRs were prospectively collected from two radiology departments via cluster sampling (November 2023–August 2024). A VGG-19-based AI model was trained and validated (internal test) using open-source paediatric CXR dataset from the USA; to classify local CXRs as either normal or pneumonia. Two blinded radiologists provided consensus classification as the reference standard. The model's accuracy, precision, recall, F1 score, and AUC were evaluated.
Results or Findings: The AI model was developed on 5,232 open-source paediatric CXRs, divided into training (1,349 normal, 3,883 pneumonia) and internal test (234 normal, 390 pneumonia) sets, and externally tested on 190 radiologist-classified CXRs (93 normal, 97 pneumonia). The model achieved 86% accuracy, 0.83 precision, 0.98 recall, 0.79 F1 score, and 0.93 AUC on the internal test, and 58% accuracy, 0.62 precision, 0.48 recall, 0.68 F1 score, and 0.65 AUC on the external test (95% CI).
Conclusion: This study demonstrates AI’s potential in diagnosing childhood pneumonia with reasonable performance on internal tests. However, external test results highlight the need for further AI development to enhance AI generalizability across diverse clinical settings.
Limitations: The model's lower performance on external tests highlights challenges in applying AI across diverse healthcare settings, likely due to differences in imaging protocols and equipment. Prioritizing robust, region-specific African datasets is key to sustainable AI development in the region.
Funding for this study: Funding was provided by Center for Policy Impact in Global Health, Duke Global Health Institute
Has your study been approved by an ethics committee? Yes
Ethics committee - additional information: The study was approved by the University of Ibadan/ University College Hospital ethics committee (UI/EC/23/0651)