Dataset Information

Evaluating the impact of mobility on COVID-19 pandemic with machine learning hybrid predictions.

ABSTRACT: COVID-19 pandemic had expanded to the US since early 2020 and has caused nationwide economic loss and public health crisis. Until now, although the US has the most confirmed cases in the world and are still experiencing an increasing pandemic, several states insisted to re-open business activities and colleges while announced strict control measures. To provide a quantitative reference for official strategies, predicting the near future trend based on finer spatial resolution data and presumed scenarios are urgently needed. In this study, the first attempted COVID-19 case predicting model based on county-level demographic, environmental, and mobility data was constructed with multiple machine learning techniques and a hybrid framework. Different scenarios were also applied to selected metropolitan counties including New York City, Cook County in Illinois, Los Angeles County in California, and Miami-Dade County in Florida to assess the impact from lockdown, Phase I, and Phase III re-opening. Our results showed that, for selected counties, the mobility decreased substantially after the lockdown but kept increasing with an apparent weekly pattern, and the weekly pattern of mobility and infections implied high infections during the weekend. Meanwhile, our model was successfully built up, and the scenario assessment results indicated that, compared with Phase I re-opening, a 1-week and a 2-week lockdown could reduce 4%-29% and 15%-55% infections, respectively, in the future week, while 2-week Phase III re-opening could increase 16%-80% infections. We concluded that the mandatory orders in metropolitan counties such lockdown should last longer than one week, the effect could be observed. The impact of lockdown or re-opening was also county-dependent and varied with the local pandemic. In future works, we expect to involve a longer period of data, consider more county-dependent factors, and employ more sophisticated techniques to decrease the modeling uncertainty and apply it to counties nationally and other countries.

SUBMITTER: Kuo CP

PROVIDER: S-EPMC7837279 | biostudies-literature | 2021 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evaluating the impact of mobility on COVID-19 pandemic with machine learning hybrid predictions.

Kuo Cheng-Pin CP Fu Joshua S JS

The Science of the total environment 20201128

COVID-19 pandemic had expanded to the US since early 2020 and has caused nationwide economic loss and public health crisis. Until now, although the US has the most confirmed cases in the world and are still experiencing an increasing pandemic, several states insisted to re-open business activities and colleges while announced strict control measures. To provide a quantitative reference for official strategies, predicting the near future trend based on finer spatial resolution data and presumed s ...[more]

PMID: 33316596

Similar Datasets

Project description:Machine-learning models are susceptible to external influences which can result in performance deterioration. The aim of our study was to elucidate the impact of a sudden shift in covariates, like the one caused by the Covid-19 pandemic, on model performance. After ethical approval and registration in Clinical Trials (NCT04092933, initial release 17/09/2019), we developed different models for the prediction of perioperative mortality based on preoperative data: one for the pre-pandemic data period until March 2020, one including data before the pandemic and from the first wave until May 2020, and one that covers the complete period before and during the pandemic until October 2021. We applied XGBoost as well as a Deep Learning neural network (DL). Performance metrics of each model during the different pandemic phases were determined, and XGBoost models were analysed for changes in feature importance. XGBoost and DL provided similar performance on the pre-pandemic data with respect to area under receiver operating characteristic (AUROC, 0.951 vs. 0.942) and area under precision-recall curve (AUPR, 0.144 vs. 0.187). Validation in patient cohorts of the different pandemic waves showed high fluctuations in performance from both AUROC and AUPR for DL, whereas the XGBoost models seemed more stable. Change in variable frequencies with onset of the pandemic were visible in age, ASA score, and the higher proportion of emergency operations, among others. Age consistently showed the highest information gain. Models based on pre-pandemic data performed worse during the first pandemic wave (AUROC 0.914 for XGBoost and DL) whereas models augmented with data from the first wave lacked performance after the first wave (AUROC 0.907 for XGBoost and 0.747 for DL). The deterioration was also visible in AUPR, which worsened by over 50% in both XGBoost and DL in the first phase after re-training. A sudden shift in data impacts model performance. Re-training the model with updated data may cause degradation in predictive accuracy if the changes are only transient. Too early re-training should therefore be avoided, and close model surveillance is necessary.

Dataset Information

Evaluating the impact of mobility on COVID-19 pandemic with machine learning hybrid predictions.

Publications

Evaluating the impact of mobility on COVID-19 pandemic with machine learning hybrid predictions.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets