The Impact of Age on Predictive Performance of National Early Warning Score at Arrival to Emergency Departments: Development and External Validation

AbstractObjectivesTo evaluate the National Early Warning Score (NEWS2), currently recommended in the UK for risk-stratification of severe COVID-19 outcomes, and subsequently identify and validate a minimal set of common parameters taken at hospital admission that improve the score.DesignRetrospective observational cohort with internal and multi-hospital external validation.SettingSecondary care.InterventionsNot applicable.ParticipantsMain outcome measuresResultsTraining and temporal external validation cohorts comprised 1464 patients admitted to King’s College Hospital NHS Foundation Trust (KCH) with COVID-19 disease from 1st March to 30th April 2020. External validation cohorts included 3869 patients from two UK NHS Trusts (Guys and St Thomas’ Hospitals, GSTT and University Hospitals Southampton, UHS) and two hospitals in Wuhan, China (Wuhan Sixth Hospital and Taikang Tongji Hospital).The primary outcome was patient status at 14 days after symptom onset categorised as severe disease (transferred to intensive care unit or death). Age, physiological measures, blood biomarkers, sex, ethnicity and comorbidities (hypertension, diabetes, cardiovascular, respiratory and kidney diseases) were included.ConclusionsNEWS2 score on admission was a weak predictor of severe COVID-19 infection (AUC = 0.628). Adding age and common blood tests (CRP, neutrophil count, estimated GFR and albumin) provided substantial improvements to a risk stratification model, particularly in relation to sensitivity, but performance was only moderate (AUC = 0.753). Improvement over NEWS2 remained robust and generalisable in GSTT (AUC = 0.817), UHS (AUC = 0.835) and Wuhan hospitals (AUC = 0.918).Adding age and a minimal set of blood parameters to NEWS2 improves the detection of patients likely to develop severe COVID-19 outcomes. This finding was replicated across NHS and non-UK hospitals. Adding a few common parameters to a pre-existing acuity score allows rapid and easy implementation of this risk-scoring system.Key MessagesThe National Early Warning Score (NEWS2), currently recommended for severe COVID-19 disease in the UK shows overall poor discrimination for severe outcomes (transfer to ICU or death). It can be improved by the addition of a small number of blood and physiological parameters routinely measured at hospital admission.The addition of age and a minimal set of common blood tests (C-reactive protein, neutrophil count, estimated GFR and albumin) provided substantial improvements in a risk stratification model.Although predictive performance varied from hospital to hospital, the improvement over NEWS2 alone was consistent across different patient cohorts.The proposed addition of a limited number of dichotomised parameters is easily derived from a pre-existing acuity score would be substantially easier to implement in a short-time scale compared to novel high-dimensional risk-scoring systems.

Download Full-text

Early Warning Scores in Patients with Suspected COVID-19 Infection in Emergency Departments

Journal of Personalized Medicine ◽

10.3390/jpm11030170 ◽

2021 ◽

Vol 11 (3) ◽

pp. 170

Author(s):

Francisco Martín-Rodríguez ◽

José L. Martín-Conty ◽

Ancor Sanz-García ◽

Virginia Carbajosa Rodríguez ◽

Guillermo Ortega Rabbione ◽

...

Keyword(s):

Early Warning ◽

Emergency Departments ◽

Life Support ◽

Area Under The Curve ◽

Advanced Life Support ◽

Early Mortality ◽

Early Warning Score ◽

Mortality Data ◽

Early Warning Scores ◽

National Early Warning Score

Early warning scores (EWSs) help prevent and recognize and thereby act as the first signs of clinical and physiological deterioration. The objective of this study is to evaluate different EWSs (National Early Warning Score 2 (NEWS2), quick sequential organ failure assessment score (qSOFA), Modified Rapid Emergency Medicine Score (MREMS) and Rapid Acute Physiology Score (RAPS)) to predict mortality within the first 48 h in patients suspected to have Coronavirus disease 2019 (COVID-19). We conducted a retrospective observational study in patients over 18 years of age who were treated by the advanced life support units and transferred to the emergency departments between March and July of 2020. Each patient was followed for two days registering their final diagnosis and mortality data. A total of 663 patients were included in our study. Early mortality within the first 48 h affected 53 patients (8.3%). The scale with the best capacity to predict early mortality was the National Early Warning Score 2 (NEWS2), with an area under the curve of 0.825 (95% CI: 0.75–0.89). The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) positive patients presented an area under the curve (AUC) of 0.804 (95% CI: 0.71–0.89), and the negative ones with an AUC of 0.863 (95% CI: 0.76–0.95). Among the EWSs, NEWS2 presented the best predictive power, even when it was separately applied to patients who tested positive and negative for SARS-CoV-2.

Download Full-text

Impact of Intensive Care Unit Readmissions on Patient Outcomes and the Evaluation of the National Early Warning Score to Prevent Readmissions: Literature Review

JMIR Perioperative Medicine ◽

10.2196/13782 ◽

2020 ◽

Vol 3 (1) ◽

pp. e13782

Author(s):

Heidi Mcneill ◽

Saif Khairat

Keyword(s):

Intensive Care Unit ◽

Intensive Care ◽

Literature Review ◽

Hospital Mortality ◽

Patient Outcomes ◽

Early Warning ◽

Early Warning Score ◽

Risk Stratification Tool ◽

National Early Warning Score ◽

The Impact

Background Intensive care unit (ICU) readmissions have been shown to increase a patient’s in-hospital mortality and length of stay (LOS). Despite this, no methods have been set in place to prevent readmissions from occurring. Objective The aim of this literature review was to evaluate the impact of ICU readmission on patient outcomes and to evaluate the effect of using a risk stratification tool, the National Early Warning Score (NEWS), on ICU readmissions. Methods A database search was performed on PubMed, Cumulative Index of Nursing and Allied Health Literature, Google Scholar, and ProQuest. In the initial search, 2028 articles were retrieved; after inclusion and exclusion criteria were applied, 12 articles were ultimately used in this literature review. Results This literature review found that patients readmitted to the ICU have an increased mortality rate and LOS at the hospital. The sample sizes in the reviewed studies ranged from 158 to 745,187 patients. Readmissions were most commonly associated with respiratory issues about 18% to 59% of the time. The NEWS has been shown to detect early clinical deterioration in a patient within 24 hours of transfer, with a 95% CI of 0.89 to 0.94 (P<.001), a sensitivity of 93.6% , and a specificity of 82.2%. Conclusions ICU readmissions are associated with worse patient outcomes, including hospital mortality and increased LOS. Without the use of an objective screening tool, the provider has been solely responsible for the decision of patient transfer. Assessment with the NEWS could be helpful in decreasing the frequency of inappropriate transfers and ultimately ICU readmission.

Download Full-text

Impact of Intensive Care Unit Readmissions on Patient Outcomes and the Evaluation of the National Early Warning Score to Prevent Readmissions: Literature Review (Preprint)

10.2196/preprints.13782 ◽

2019 ◽

Author(s):

Heidi Mcneill ◽

Saif Khairat

Keyword(s):

Intensive Care Unit ◽

Intensive Care ◽

Literature Review ◽

Hospital Mortality ◽

Patient Outcomes ◽

Early Warning ◽

Early Warning Score ◽

Risk Stratification Tool ◽

National Early Warning Score ◽

The Impact

BACKGROUND Intensive care unit (ICU) readmissions have been shown to increase a patient’s in-hospital mortality and length of stay (LOS). Despite this, no methods have been set in place to prevent readmissions from occurring. OBJECTIVE The aim of this literature review was to evaluate the impact of ICU readmission on patient outcomes and to evaluate the effect of using a risk stratification tool, the National Early Warning Score (NEWS), on ICU readmissions. METHODS A database search was performed on PubMed, Cumulative Index of Nursing and Allied Health Literature, Google Scholar, and ProQuest. In the initial search, 2028 articles were retrieved; after inclusion and exclusion criteria were applied, 12 articles were ultimately used in this literature review. RESULTS This literature review found that patients readmitted to the ICU have an increased mortality rate and LOS at the hospital. The sample sizes in the reviewed studies ranged from 158 to 745,187 patients. Readmissions were most commonly associated with respiratory issues about 18% to 59% of the time. The NEWS has been shown to detect early clinical deterioration in a patient within 24 hours of transfer, with a 95% CI of 0.89 to 0.94 (<i>P</i><.001), a sensitivity of 93.6% , and a specificity of 82.2%. CONCLUSIONS ICU readmissions are associated with worse patient outcomes, including hospital mortality and increased LOS. Without the use of an objective screening tool, the provider has been solely responsible for the decision of patient transfer. Assessment with the NEWS could be helpful in decreasing the frequency of inappropriate transfers and ultimately ICU readmission.

Download Full-text

The optimal threshold for prompt clinical review: An external validation study of the national early warning score

Journal of Clinical Nursing ◽

10.1111/jocn.15493 ◽

2020 ◽

Vol 29 (23-24) ◽

pp. 4594-4603

Author(s):

Filip Haegdorens ◽

Koenraad G. Monsieurs ◽

Koen De Meester ◽

Peter Van Bogaert

Keyword(s):

Clinical Review ◽

Validation Study ◽

Early Warning ◽

External Validation ◽

Early Warning Score ◽

Optimal Threshold ◽

External Validation Study ◽

National Early Warning Score

Download Full-text

Performance of externally validated enhanced computer-aided versions of the National Early Warning Score in predicting mortality following an emergency admission to hospital in England: a cross-sectional study

BMJ Open ◽

10.1136/bmjopen-2019-031596 ◽

2019 ◽

Vol 9 (11) ◽

pp. e031596 ◽

Cited By ~ 5

Author(s):

Muhammad Faisal ◽

Donald Richardson ◽

Andy Scally ◽

Robin Howes ◽

Kevin Beatson ◽

...

Keyword(s):

Early Warning ◽

Clinical Decision Making ◽

External Validation ◽

Model Development ◽

Emergency Admission ◽

Early Warning Score ◽

Cross Sectional ◽

Risk Of Death ◽

Computer Aided ◽

National Early Warning Score

ObjectivesIn the English National Health Service, the patient’s vital signs are monitored and summarised into a National Early Warning Score (NEWS) to support clinical decision making, but it does not provide an estimate of the patient’s risk of death. We examine the extent to which the accuracy of NEWS for predicting mortality could be improved by enhanced computer versions of NEWS (cNEWS).DesignLogistic regression model development and external validation study.SettingTwo acute hospitals (YH—York Hospital for model development; NH—Northern Lincolnshire and Goole Hospital for external model validation).ParticipantsAdult (≥16 years) medical admissions discharged over a 24-month period with electronic NEWS (eNEWS) recorded on admission are used to predict mortality at four time points (in-hospital, 24 hours, 48 hours and 72 hours) using the first electronically recorded NEWS (model M0) versus a cNEWS model which included age+sex (model M1) +subcomponents of NEWS (including diastolic blood pressure) (model M2).ResultsThe risk of dying in-hospital following emergency medical admission was 5.8% (YH: 2080/35 807) and 5.4% (NH: 1900/35 161). The c-statistics for model M2 in YH for predicting mortality (in-hospital=0.82, 24 hours=0.91, 48 hours=0.88 and 72 hours=0.88) was higher than model M0 (in-hospital=0.74, 24 hours=0.89, 48 hours=0.86 and 72 hours=0.85) with higher Positive Predictive Value (PPVs) for in-hospital mortality (M2 19.3% and M0 16.6%). Similar findings were seen in NH. Model M2 performed better than M0 in almost all major disease subgroups.ConclusionsAn externally validated enhanced computer-aided NEWS model (cNEWS) incrementally improves on the performance of a NEWS only model. Since cNEWS places no additional data collection burden on clinicians and is readily automated, it may now be carefully introduced and evaluated to determine if it can improve care in hospitals that have eNEWS systems.

Download Full-text

Experiences of a National Early Warning Score (NEWS) intervention in care homes during the COVID-19 pandemic: a qualitative interview study

BMJ Open ◽

10.1136/bmjopen-2020-045469 ◽

2021 ◽

Vol 11 (7) ◽

pp. e045469

Author(s):

Rachel Stocker ◽

Siân Russell ◽

Jennifer Liddle ◽

Robert O Barker ◽

Adam Remmer ◽

...

Keyword(s):

Early Warning ◽

Healthcare Professionals ◽

Care Home ◽

Qualitative Interview ◽

Interview Study ◽

Care Homes ◽

Early Warning Score ◽

Service Utilisation ◽

Qualitative Interview Study ◽

National Early Warning Score

BackgroundThe COVID-19 pandemic has taken a heavy toll on the care home sector, with residents accounting for up to half of all deaths in Europe. The response to acute illness in care homes plays a particularly important role in the care of residents during a pandemic. Digital recording of a National Early Warning Score (NEWS), which involves the measurement of physical observations, started in care homes in one area of England in 2016. Implementation of a NEWS intervention (including equipment, training and support) was accelerated early in the pandemic, despite limited evidence for its use in the care home setting.ObjectivesTo understand how a NEWS intervention has been used in care homes in one area of North-East England during the COVID-19 pandemic, and how it has influenced resident care, from the perspective of stakeholders involved in care delivery and commissioning.MethodsA qualitative interview study with care home (n=10) and National Health Service (n=7) staff. Data were analysed using thematic analysis.ResultsUse of the NEWS intervention in care homes in this area accelerated during the COVID-19 pandemic. Stakeholders felt that NEWS, and its associated education and support package, improved the response of care homes and healthcare professionals to deterioration in residents’ health during the pandemic. Healthcare professionals valued the ability to remotely monitor resident observations, which facilitated triage and treatment decisions. Care home staff felt empowered by NEWS, providing a common clinical language to communicate concerns with external services, acting as an adjunct to staff intuition of resident deterioration.ConclusionsThe NEWS intervention formed an important part of the care home response to COVID-19 in the study area. Positive staff perceptions now need to be supplemented with data on the impact on resident health and well-being, workload, and service utilisation, during the pandemic and beyond.

Download Full-text