scholarly journals An automated COVID-19 triage pipeline using artificial intelligence based on chest radiographs and clinical data

2022 ◽  
Vol 5 (1) ◽  
Author(s):  
Chris K. Kim ◽  
Ji Whae Choi ◽  
Zhicheng Jiao ◽  
Dongcui Wang ◽  
Jing Wu ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Model Development ◽  
Chest Radiographs ◽  
X Rays ◽  
Diagnosis And Prognosis ◽  
Radiology Reports ◽  
Intelligence Models ◽  
Artificial Intelligence Models ◽  
Image Repository ◽  
External Test

AbstractWhile COVID-19 diagnosis and prognosis artificial intelligence models exist, very few can be implemented for practical use given their high risk of bias. We aimed to develop a diagnosis model that addresses notable shortcomings of prior studies, integrating it into a fully automated triage pipeline that examines chest radiographs for the presence, severity, and progression of COVID-19 pneumonia. Scans were collected using the DICOM Image Analysis and Archive, a system that communicates with a hospital’s image repository. The authors collected over 6,500 non-public chest X-rays comprising diverse COVID-19 severities, along with radiology reports and RT-PCR data. The authors provisioned one internally held-out and two external test sets to assess model generalizability and compare performance to traditional radiologist interpretation. The pipeline was evaluated on a prospective cohort of 80 radiographs, reporting a 95% diagnostic accuracy. The study mitigates bias in AI model development and demonstrates the value of an end-to-end COVID-19 triage platform.

scholarly journals Stress testing reveals gaps in clinic readiness of image-based diagnostic artificial intelligence models

2021 ◽  
Vol 4 (1) ◽  
Author(s):  
Albert T. Young ◽  
Kristen Fernandez ◽  
Jacob Pfau ◽  
Rasika Reddy ◽  
Nhat Anh Cao ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Real World ◽  
Stress Testing ◽  
Operating Characteristic ◽  
Characteristic Curve ◽  
Skin Lesions ◽  
Stress Tests ◽  
Performance Metric ◽  
Intelligence Models ◽  
Artificial Intelligence Models

AbstractArtificial intelligence models match or exceed dermatologists in melanoma image classification. Less is known about their robustness against real-world variations, and clinicians may incorrectly assume that a model with an acceptable area under the receiver operating characteristic curve or related performance metric is ready for clinical use. Here, we systematically assessed the performance of dermatologist-level convolutional neural networks (CNNs) on real-world non-curated images by applying computational “stress tests”. Our goal was to create a proxy environment in which to comprehensively test the generalizability of off-the-shelf CNNs developed without training or evaluation protocols specific to individual clinics. We found inconsistent predictions on images captured repeatedly in the same setting or subjected to simple transformations (e.g., rotation). Such transformations resulted in false positive or negative predictions for 6.5–22% of skin lesions across test datasets. Our findings indicate that models meeting conventionally reported metrics need further validation with computational stress tests to assess clinic readiness.

scholarly journals How can artificial intelligence models assist PD-L1 expression scoring in breast cancer: results of multi-institutional ring studies

2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Xinran Wang ◽  
Liang Wang ◽  
Hong Bu ◽  
Ningning Zhang ◽  
Meng Yue ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Artificial Intelligence ◽  
Clinical Practice ◽  
Subjective Assessment ◽  
Current Guideline ◽  
Scoring Method ◽  
Programmed Death ◽  
Intelligence Models ◽  
Artificial Intelligence Models ◽  
Scoring Accuracy

AbstractProgrammed death ligand-1 (PD-L1) expression is a key biomarker to screen patients for PD-1/PD-L1-targeted immunotherapy. However, a subjective assessment guide on PD-L1 expression of tumor-infiltrating immune cells (IC) scoring is currently adopted in clinical practice with low concordance. Therefore, a repeatable and quantifiable PD-L1 IC scoring method of breast cancer is desirable. In this study, we propose a deep learning-based artificial intelligence-assisted (AI-assisted) model for PD-L1 IC scoring. Three rounds of ring studies (RSs) involving 31 pathologists from 10 hospitals were carried out, using the current guideline in the first two rounds (RS1, RS2) and our AI scoring model in the last round (RS3). A total of 109 PD-L1 (Ventana SP142) immunohistochemistry (IHC) stained images were assessed and the role of the AI-assisted model was evaluated. With the assistance of AI, the scoring concordance across pathologists was boosted to excellent in RS3 (0.950, 95% confidence interval (CI): 0.936–0.962) from moderate in RS1 (0.674, 95% CI: 0.614–0.735) and RS2 (0.736, 95% CI: 0.683–0.789). The 2- and 4-category scoring accuracy were improved by 4.2% (0.959, 95% CI: 0.953–0.964) and 13% (0.815, 95% CI: 0.803–0.827) (p < 0.001). The AI results were generally accepted by pathologists with 61% “fully accepted” and 91% “almost accepted”. The proposed AI-assisted method can help pathologists at all levels to improve the PD-L1 assay (SP-142) IC assessment in breast cancer in terms of both accuracy and concordance. The AI tool provides a scheme to standardize the PD-L1 IC scoring in clinical practice.

Evaluation of Artificial Intelligence Models for Flood and Drought Forecasting in Arid and Tropical Regions

2021 ◽  
pp. 105136
Author(s):  
Kasuni E. Adikari ◽  
Sangam Shrestha ◽  
Dhanika T. Ratnayake ◽  
Aakanchya Budhathoki ◽  
Mohana S. Shanmugam ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Drought Forecasting ◽  
Tropical Regions ◽  
Intelligence Models ◽  
Artificial Intelligence Models
Sign in / Sign up

Export Citation Format

Share Document