Dataset Information

An approach to predicting patient experience through machine learning and social network analysis.

ABSTRACT: Objective: Improving the patient experience has become an essential component of any healthcare system's performance metrics portfolio. In this study, we developed a machine learning model to predict a patient's response to the Hospital Consumer Assessment of Healthcare Providers and Systems survey's "Doctor Communications" domain questions while simultaneously identifying most impactful providers in a network.

Materials and methods: This is an observational study of patients admitted to a single tertiary care hospital between 2016 and 2020. Using machine learning algorithms, electronic health record data were used to predict patient responses to Hospital Consumer Assessment of Healthcare Providers and Systems survey questions in the doctor domain, and patients who are at risk for responding negatively were identified. Model performance was assessed by area under receiver-operating characteristic curve. Social network analysis metrics were also used to identify providers most impactful to patient experience.

Results: Using a random forest algorithm, patients' responses to the following 3 questions were predicted: "During this hospital stay how often did doctors. 1) treat you with courtesy and respect? 2) explain things in a way that you could understand? 3) listen carefully to you?" with areas under the receiver-operating characteristic curve of 0.876, 0.819, and 0.819, respectively. Social network analysis found that doctors with higher centrality appear to have an outsized influence on patient experience, as measured by rank in the random forest model in the doctor domain.

Conclusions: A machine learning algorithm identified patients at risk of a negative experience. Furthermore, a doctor social network framework provides metrics for identifying those providers that are most influential on the patient experience.

SUBMITTER: Bari V

PROVIDER: S-EPMC7727354 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An approach to predicting patient experience through machine learning and social network analysis.

Bari Vitej V Hirsch Jamie S JS Narvaez Joseph J Sardinia Robert R Bock Kevin R KR Oppenheim Michael I MI Meytlis Marsha M

Journal of the American Medical Informatics Association : JAMIA 20201201 12

<h4>Objective</h4>Improving the patient experience has become an essential component of any healthcare system's performance metrics portfolio. In this study, we developed a machine learning model to predict a patient's response to the Hospital Consumer Assessment of Healthcare Providers and Systems survey's "Doctor Communications" domain questions while simultaneously identifying most impactful providers in a network.<h4>Materials and methods</h4>This is an observational study of patients admitt ...[more]

PMID: 33104210

Similar Datasets

Project description:Abstract Background Diagnosis of schizophrenia is based on a collection of symptoms which are heterogeneous from one patient to the other. Therefore, improving the reliability of this diagnosis is a currently unmet need. Schizophrenia risk is associated with genetic variation and with environmental factors potentially affecting neurodevelopment. Moreover, among the symptoms, cognitive abnormalities are heritable and predate its clinical onset. Multivariate techniques can leverage the high dimensionality of data in order to study the combined effect of multiple risk factors and symptoms on clinical predictions. The aim of the current study is therefore to assess the predictability of schizophrenia diagnosis applying machine learning techniques to an ensemble of genetic, early environmental and cognitive deficits variables. Methods 442 subjects (339 healthy controls – HC – and 103 patients with schizophrenia – SCZ) were recruited for the study. Participants underwent a full neuropsychological evaluation (Modality 1, assessment of working memory, verbal fluency, intelligence quotient, attention, speed of processing and cognitive control), a broad environmental assessment (Modality 2, investigation of urbanicity, obstetric complications, developmental anomalies, socio-economic parental status and age of parents at birth) and genome-wide genotyping (Modality 3). Following published procedures, we computed individual risk scores for each of the single nucleotide polymorphisms (SNPs) associated with risk for schizophrenia in the Psychiatric Genomics Consortium (PGC) study. Data from Modalities 1, 2 and 3 entered NeuroMiner v0.998 and underwent preprocessing procedures through scaling, pruning of non-informative variables and imputation of missing values through Euclidean distance-based nearest-neighbor search. Then, these three modalities were included in a Support Vector Machine HC vs. SCZ classification algorithm, which applied decision-based data fusion strategies to integrate the individual predictions of the three modalities in a nested cross-validation framework. Results Our cross-validated results revealed that Modality 1 (cognition) predicted schizophrenia diagnosis with the highest Balanced Accuracy (BAC, 87.3%) and that the most selected cognitive indices were intelligence quotient scores and attentional abilities. Modality 2 (environment) classified HC and SCZ with a BAC of 67.2%, and the most predictive environmental features were the parental socio-economic status, the presence of developmental anomalies during the first year of life and the age of father at birth. On the other hand, Modality 3 (genetics) predicted schizophrenia diagnosis with BAC=54,1%. The most informative SNPs were FUT9 rs117074560, TCF4 rs72934570 and STAG1 rs7432375. Decision-based fusion combining individual cognitive, environmental and genetic decision scores predicted the classification of SCZ from HC with a 78.9% BAC. Discussion Our results using a novel machine learning approach suggest that an ensemble of cognitive, early environmental and genetic features can predict schizophrenia with significant accuracy. Our results also give key information on cognitive and environmental factors that can be targeted in early identification programs and offer novel insights about genetic loci that may be prioritized in future investigations of the pathophysiology of the disease. However, the near chance-level predictive ability of the genetic modality alone calls for the implementation and testing of more complex models of interaction between multiple risk factors.

Project description:BackgroundThe Centers for Medicare and Medicaid Services projects that health care costs will continue to grow over the next few years. Rising readmission costs contribute significantly to increasing health care costs. Multiple areas of health care, including readmissions, have benefited from the application of various machine learning algorithms in several ways.ObjectiveWe aimed to identify suitable models for predicting readmission charges billed by hospitals. Our literature review revealed that this application of machine learning is underexplored. We used various predictive methods, ranging from glass-box models (such as regularization techniques) to black-box models (such as deep learning-based models).MethodsWe defined readmissions as readmission with the same major diagnostic category (RSDC) and all-cause readmission category (RADC). For these readmission categories, 576,701 and 1,091,580 individuals, respectively, were identified from the Nationwide Readmission Database of the Healthcare Cost and Utilization Project by the Agency for Healthcare Research and Quality for 2013. Linear regression, lasso regression, elastic net, ridge regression, eXtreme gradient boosting (XGBoost), and a deep learning model based on multilayer perceptron (MLP) were the 6 machine learning algorithms we tested for RSDC and RADC through 10-fold cross-validation.ResultsOur preliminary analysis using a data-driven approach revealed that within RADC, the subsequent readmission charge billed per patient was higher than the previous charge for 541,090 individuals, and this number was 319,233 for RSDC. The top 3 major diagnostic categories (MDCs) for such instances were the same for RADC and RSDC. The average readmission charge billed was higher than the previous charge for 21 of the MDCs in the case of RSDC, whereas it was only for 13 of the MDCs in RADC. We recommend XGBoost and the deep learning model based on MLP for predicting readmission charges. The following performance metrics were obtained for XGBoost: (1) RADC (mean absolute percentage error [MAPE]=3.121%; root mean squared error [RMSE]=0.414; mean absolute error [MAE]=0.317; root relative squared error [RRSE]=0.410; relative absolute error [RAE]=0.399; normalized RMSE [NRMSE]=0.040; mean absolute deviation [MAD]=0.031) and (2) RSDC (MAPE=3.171%; RMSE=0.421; MAE=0.321; RRSE=0.407; RAE=0.393; NRMSE=0.041; MAD=0.031). The performance obtained for MLP-based deep neural networks are as follows: (1) RADC (MAPE=3.103%; RMSE=0.413; MAE=0.316; RRSE=0.410; RAE=0.397; NRMSE=0.040; MAD=0.031) and (2) RSDC (MAPE=3.202%; RMSE=0.427; MAE=0.326; RRSE=0.413; RAE=0.399; NRMSE=0.041; MAD=0.032). Repeated measures ANOVA revealed that the mean RMSE differed significantly across models with P<.001. Post hoc tests using the Bonferroni correction method indicated that the mean RMSE of the deep learning/XGBoost models was statistically significantly (P<.001) lower than that of all other models, namely linear regression/elastic net/lasso/ridge regression.ConclusionsModels built using XGBoost and MLP are suitable for predicting readmission charges billed by hospitals. The MDCs allow models to accurately predict hospital readmission charges.

Dataset Information

An approach to predicting patient experience through machine learning and social network analysis.

Publications

An approach to predicting patient experience through machine learning and social network analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets