Dataset Information

Development of a patients' satisfaction analysis system using machine learning and lexicon-based methods.

ABSTRACT:

Background

Patients' rights are integral to medical ethics. This study aimed to perform sentiment analysis and opinion mining on patients' messages by a combination of lexicon-based and machine learning methods to identify positive or negative comments and to determine the different ward and staff names mentioned in patients' messages.

Methods

The level of satisfaction and observance of the rights of 250 service recipients of the hospital was evaluated through the related checklists by the evaluator. In total, 822 Persian messages, composed of 540 negative and 282 positive comments, were collected and labeled by the evaluator. Pre-processing was performed on the messages and followed by 2 feature vectors which were extracted from the messages, including the term frequency-inverse document frequency (TFIDF) vector and a combination of the multifeature (MF) (a lexicon-based method) and TFIDF (MF + TFIDF) vectors. Six feature selectors and 5 classifiers were used in this study. For the evaluations, 5-fold cross-validation with different metrics including area under the receiver operating characteristic curve (AUC), accuracy (ACC), F1 score, sensitivity (SEN), specificity (SPE) and Precision-Recall Curves (PRC) were reported. Message tag detection, which featured different hospital wards and identified staff names mentioned in the study patients' messages, was implemented by the lexicon-based method.

Results

The best classifier was Multinomial Naïve Bayes in combination with MF + TFIDF feature vector and SelectFromModel (SFM) feature selection (ACC = 0.89 ± 0.03, AUC = 0.87 ± 0.03, F1 = 0.92 ± 0.03, SEN = 0.93 ± 0.04, and SPE = 0.82 ± 0.02, PRC-AUC = 0.97). Two methods of assessment by the evaluator and artificial intelligence as well as survey systems were compared.

Conclusion

Our results demonstrated that the lexicon-based method, in combination with machine learning classifiers, could extract sentiments in patients' comments and classify them into positive and negative categories. We also developed an online survey system to analyze patients' satisfaction in different wards and to remove conventional assessments by the evaluator.

SUBMITTER: Khaleghparast S

PROVIDER: S-EPMC10037842 | biostudies-literature | 2023 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of a patients' satisfaction analysis system using machine learning and lexicon-based methods.

Khaleghparast Shiva S Maleki Majid M Hajianfar Ghasem G Soumari Esmaeil E Oveisi Mehrdad M Golandouz Hassan Maleki HM Noohi Feridoun F Dehaki Maziar Gholampour MG Golpira Reza R Mazloomzadeh Saeideh S Arabian Maedeh M Kalayinia Samira S

BMC health services research 20230323 1

<h4>Background</h4>Patients' rights are integral to medical ethics. This study aimed to perform sentiment analysis and opinion mining on patients' messages by a combination of lexicon-based and machine learning methods to identify positive or negative comments and to determine the different ward and staff names mentioned in patients' messages.<h4>Methods</h4>The level of satisfaction and observance of the rights of 250 service recipients of the hospital was evaluated through the related checklis ...[more]

PMID: 36959630

Similar Datasets

Project description:Preeclampsia is one of the leading causes of maternal and fetal morbidity and mortality. Due to the lack of effective preventive measures, its prediction is essential to its prompt management. This study aimed to develop models using machine learning to predict late-onset preeclampsia using hospital electronic medical record data. The performance of the machine learning based models and models using conventional statistical methods were also compared. A total of 11,006 pregnant women who received antenatal care at Yonsei University Hospital were included. Maternal data were retrieved from electronic medical records during the early second trimester to 34 weeks. The prediction outcome was late-onset preeclampsia occurrence after 34 weeks' gestation. Pattern recognition and cluster analysis were used to select the parameters included in the prediction models. Logistic regression, decision tree model, naïve Bayes classification, support vector machine, random forest algorithm, and stochastic gradient boosting method were used to construct the prediction models. C-statistics was used to assess the performance of each model. The overall preeclampsia development rate was 4.7% (474 patients). Systolic blood pressure, serum blood urea nitrogen and creatinine levels, platelet counts, serum potassium level, white blood cell count, serum calcium level, and urinary protein were the most influential variables included in the prediction models. C-statistics for the decision tree model, naïve Bayes classification, support vector machine, random forest algorithm, stochastic gradient boosting method, and logistic regression models were 0.857, 0.776, 0.573, 0.894, 0.924, and 0.806, respectively. The stochastic gradient boosting model had the best prediction performance with an accuracy and false positive rate of 0.973 and 0.009, respectively. The combined use of maternal factors and common antenatal laboratory data of the early second trimester through early third trimester could effectively predict late-onset preeclampsia using machine learning algorithms. Future prospective studies are needed to verify the clinical applicability algorithms.

Project description:Chagas disease (CD) is recognized by the World Health Organization as one of the thirteen most neglected tropical diseases. More than 80% of people affected by CD will not have access to diagnosis and continued treatment, which partly supports the high morbidity and mortality rate. Machine Learning (ML) can identify patterns in data that can be used to increase our understanding of a specific problem or make predictions about the future. Thus, the aim of this study was to evaluate different models of ML to predict death in two years of patients with CD. ML models were developed using different techniques and configurations. The techniques used were: Random Forests, Adaptive Boosting, Decision Tree, Support Vector Machine, and Artificial Neural Networks. The adopted settings considered only interview variables, only complementary exam variables, and finally, both mixed. Data from a cohort study with CD patients called SaMi-Trop were analyzed. The predictor variables came from the baseline; and the outcome, which was death, came from the first follow-up. All models were evaluated in terms of Sensitivity, Specificity and G-mean. Among the 1694 individuals with CD considered, 134 (7.9%) died within two years of follow-up. Using only the predictor variables from the interview, the different techniques achieved a maximum G-mean of 0.64 in predicting death. Using only the variables from complementary exams, the G-mean was up to 0.77. In this configuration, the protagonism of NT-proBNP was evident, where it was possible to observe that an ML model using only this single variable reached G-mean of 0.76. The configuration that mixed interview variables and complementary exams achieved G-mean of 0.75. ML can be used as a useful tool with the potential to contribute to the management of patients with CD, by identifying patients with the highest probability of death. Trial Registration: This trial is registered with ClinicalTrials.gov, Trial ID: NCT02646943.

Project description:ImportanceMany indicators need to be considered when judging the condition of patients with infertility, which makes diagnosis and treatment complicated.ObjectiveTo construct a dynamic scoring system for infertility to assist clinicians in efficiently and accurately assessing the condition of patients with infertility.Design, setting, and participantsThis prognostic study reviewed 95 868 medical records of couples with infertility in which women had undergone in vitro fertilization and embryo transfer at the Reproductive Center of Tongji Medical College, Huazhong University of Science and Technology, in Wuhan, Hubei, China, from January 2006 to May 2019. A dynamic diagnosis and grading system for infertility was constructed. The analysis was conducted between May 20, 2019, and April 15, 2020.Main outcomes and measuresPatients were divided into pregnant and nonpregnant groups according to eventual pregnancy results. The evaluation index system was constructed based on the test results of the significant difference between the 2 groups of indicators and the clinician's experience. Random forest machine learning was used to determine the weight of the index, and the entropy-based feature discretization algorithm classified the abnormality of the index and the patient's condition. A 10-fold cross-validation method was used to test the validity of the system.ResultsA total of 60 648 couples with infertility were enrolled, in which 15 021 women became pregnant, with a mean (SD) age of 30.30 (4.02) years. A total of 45 627 couples were in the nonpregnant group, with a mean (SD) age among women of 32.17 (5.58) years. Seven indicators were selected to build the dynamic grading system for patients with infertility: age, body mass index, follicle-stimulating hormone level, antral follicle count, anti-Mullerian hormone level, number of oocytes, and endometrial thickness. The importance weight of each indicator obtained by the random forest algorithm was 0.1748 for age, 0.0785 for body mass index, 0.0581 for follicle-stimulating hormone level, 0.1214 for antral follicle count, 0.1616 for anti-Mullerian hormone level, 0.2307 for number of oocytes, and 0.1749 for endometrial thickness. The grading system divided the condition of the patient with infertility into 5 grades from A to E. The worst E grade represented a 0.90% pregnancy rate, and the pregnancy rate in the A grade was 53.82%. The cross-validation results showed that the stability of the system was 95.94% (95% CI, 95.14%-96.74%).Conclusions and relevanceThis machine learning-derived algorithm may assist clinicians in making an efficient and accurate initial judgment on the condition of patients with infertility.

Dataset Information

Development of a patients' satisfaction analysis system using machine learning and lexicon-based methods.

Background

Methods

Results

Conclusion

Publications

Development of a patients' satisfaction analysis system using machine learning and lexicon-based methods.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets