Dataset Information

Global Health Security Preparedness and Response: An Analysis of the Relationship between Joint External Evaluation Scores and COVID-19 Response Performance.

ABSTRACT:

Objectives

The COVID-19 pandemic has highlighted the importance and complexity of a country's ability to effectively respond. The Joint External Evaluation (JEE) assessment was launched in 2016 to assess a country's ability to prevent, detect and respond to public health emergencies. We examined whether JEE indicators could be used to predict a country's COVID-19 response performance to tailor a country's support more effectively.

Design

From April to August 2020, we conducted interviews with Centers for Disease Control and Prevention country offices that requested COVID-19 support and previously completed the JEE (version 1.0). We used an assessment tool, the 'Emergency Response Capacity Tool' (ERCT), to assess COVID-19 response performance. We analysed 28 ERCT indicators aligned with eight JEE indicators to assess concordance and discordance using strict agreement and weighted kappa statistics. Generalised estimating equation (GEE) models were used to generate predicted probabilities for ERCT scores using JEE scores as the independent model variable.

Results

Twenty-three countries met inclusion criteria. Of the 163 indicators analysed, 42.3% of JEE and ERCT scores were in agreement (p value=0.02). The JEE indicator with the highest agreement (62%) was 'Emergency Operations Center (EOC) operating procedures and plans', while the lowest (16%) was 'capacity to activate emergency operations'. Findings were consistent with weighted kappa statistics. In the GEE model, EOC operating procedures and plans had the highest predicted probability (0.86), while indicators concerning response strategy and coordination had the lowest (≤0.5).

Conclusions

Overall, there was low agreement between JEE scores and COVID-19 response performance, with JEE scores often trending higher. JEE indicators concerning coordination and operations were least predictive of COVID-19 response performance, underscoring the importance of not inferring country response readiness from JEE scores alone. More in-depth country-specific investigations are likely needed to accurately estimate response capacity and tailor countries' global health security activities.

SUBMITTER: Nguyen L

PROVIDER: S-EPMC8640194 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Global Health Security Index (GHSI) and Joint External Evaluation (JEE) are two well-known health security and related capability indices. We hypothesised that countries with higher GHSI or JEE scores would have detected their first COVID-19 case earlier, and would experience lower mortality outcome compared to countries with lower scores. We evaluated the effectiveness of GHSI and JEE in predicting countries' COVID-19 detection response times and mortality outcome (deaths/million). We used two different outcomes for the evaluation: (i) detection response time, the duration of time to the first confirmed case detection (from 31st December 2019 to 20th February 2020 when every country's first case was linked to travel from China) and (ii) mortality outcome (deaths/million) until 11th March and 1st July 2020, respectively. We interpreted the detection response time alongside previously published relative risk of the importation of COVID-19 cases from China. We performed multiple linear regression and negative binomial regression analysis to evaluate how these indices predicted the actual outcome. The two indices, GHSI and JEE were strongly correlated (r = 0.82), indicating a good agreement between them. However, both GHSI (r = 0.31) and JEE (r = 0.37) had a poor correlation with countries' COVID-19-related mortality outcome. Higher risk of importation of COVID-19 from China for a given country was negatively correlated with the time taken to detect the first case in that country (adjusted R2 = 0.63-0.66), while the GHSI and JEE had minimal predictive value. In the negative binomial regression model, countries' mortality outcome was strongly predicted by the percentage of the population aged 65 and above (incidence rate ratio (IRR): 1.10 (95% confidence interval (CI): 1.01-1.21) while overall GHSI score (IRR: 1.01 (95% CI: 0.98-1.01)) and JEE (IRR: 0.99 (95% CI: 0.96-1.02)) were not significant predictors. GHSI and JEE had lower predictive value for detection response time and mortality outcome due to COVID-19. We suggest introduction of a population healthiness parameter, to address demographic and comorbidity vulnerabilities, and reappraisal of the ranking system and methods used to obtain the index based on experience gained from this pandemic.