Development and validation of a machine learning algorithm for predicting the risk of postpartum depression among pregnant women.
Ontology highlight
ABSTRACT: Objective
There is a scarcity in tools to predict postpartum depression (PPD). We propose a machine learning framework for PPD risk prediction using data extracted from electronic health records (EHRs).Methods
Two EHR datasets containing data on 15,197 women from 2015 to 2018 at a single site, and 53,972 women from 2004 to 2017 at multiple sites were used as development and validation sets, respectively, to construct the PPD risk prediction model. The primary outcome was a diagnosis of PPD within 1 year following childbirth. A framework of data extraction, processing, and machine learning was implemented to select a minimal list of features from the EHR datasets to ensure model performance and to enable future point-of-care risk prediction.Results
The best-performing model uses from clinical features related to mental health history, medical comorbidity, obstetric complications, medication prescription orders, and patient demographic characteristics. The model performances as measured by area under the receiver operating characteristic curve (AUC) are 0.937 (95% CI 0.912 - 0.962) and 0.886 (95% CI 0.879-0.893) in the development and validation datasets, respectively. The model performances were consistent when tested using data ending at multiple time periods during pregnancy and at childbirth.Limitations
The prevalence of PPD in the study data represented a treatment prevalence and is likely lower than the illness prevalence.Conclusions
EHRs and machine learning offer the ability to identify women at risk for PPD early in their pregnancy. This may facilitate scalable and timely prevention and intervention, reducing negative outcomes and the associated burden.
SUBMITTER: Zhang Y
PROVIDER: S-EPMC7738412 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundMachine learning (ML) offers vigorous statistical and probabilistic techniques that can successfully predict certain clinical conditions using large volumes of data. A review of ML and big data research analytics in maternal depression is pertinent and timely, given the rapid technological developments in recent years.ObjectiveThis study aims to synthesize the literature on ML and big data analytics for maternal mental health, particularly the prediction of postpartum depression (PPD).MethodsWe used a scoping review methodology using the Arksey and O'Malley framework to rapidly map research activity in ML for predicting PPD. Two independent researchers searched PsycINFO, PubMed, IEEE Xplore, and the ACM Digital Library in September 2020 to identify relevant publications in the past 12 years. Data were extracted from the articles' ML model, data type, and study results.ResultsA total of 14 studies were identified. All studies reported the use of supervised learning techniques to predict PPD. Support vector machine and random forest were the most commonly used algorithms in addition to Naive Bayes, regression, artificial neural network, decision trees, and XGBoost (Extreme Gradient Boosting). There was considerable heterogeneity in the best-performing ML algorithm across the selected studies. The area under the receiver operating characteristic curve values reported for different algorithms were support vector machine (range 0.78-0.86), random forest method (0.88), XGBoost (0.80), and logistic regression (0.93).ConclusionsML algorithms can analyze larger data sets and perform more advanced computations, which can significantly improve the detection of PPD at an early stage. Further clinical research collaborations are required to fine-tune ML algorithms for prediction and treatment. ML might become part of evidence-based practice in addition to clinical knowledge and existing research evidence.
| S-EPMC8663566 | biostudies-literature
Project description:BACKGROUND:Risk-based breast cancer screening is a cost-effective intervention for controlling breast cancer in China, but the successful implementation of such intervention requires an accurate breast cancer prediction model for Chinese women. OBJECTIVE:This study aimed to evaluate and compare the performance of four machine learning algorithms on predicting breast cancer among Chinese women using 10 breast cancer risk factors. METHODS:A dataset consisting of 7127 breast cancer cases and 7127 matched healthy controls was used for model training and testing. We used repeated 5-fold cross-validation and calculated AUC, sensitivity, specificity, and accuracy as the measures of the model performance. RESULTS:The three novel machine-learning algorithms (XGBoost, Random Forest and Deep Neural Network) all achieved significantly higher area under the receiver operating characteristic curves (AUCs), sensitivity, and accuracy than logistic regression. Among the three novel machine learning algorithms, XGBoost (AUC 0.742) outperformed deep neural network (AUC 0.728) and random forest (AUC 0.728). Main residence, number of live births, menopause status, age, and age at first birth were considered as top-ranked variables in the three novel machine learning algorithms. CONCLUSIONS:The novel machine learning algorithms, especially XGBoost, can be used to develop breast cancer prediction models to help identify women at high risk for breast cancer in developing countries.
| S-EPMC7308891 | biostudies-literature
Project description:Postpartum depression (PPD) is a detrimental health condition that affects 12% of new mothers. Despite negative effects on mothers' and children's health, many women do not receive adequate care. Preventive interventions are cost-efficient among high-risk women, but our ability to identify these is poor. We leveraged the power of clinical, demographic, and psychometric data to assess if machine learning methods can make accurate predictions of postpartum depression. Data were obtained from a population-based prospective cohort study in Uppsala, Sweden, collected between 2009 and 2018 (BASIC study, n = 4313). Sub-analyses among women without previous depression were performed. The extremely randomized trees method provided robust performance with highest accuracy and well-balanced sensitivity and specificity (accuracy 73%, sensitivity 72%, specificity 75%, positive predictive value 33%, negative predictive value 94%, area under the curve 81%). Among women without earlier mental health issues, the accuracy was 64%. The variables setting women at most risk for PPD were depression and anxiety during pregnancy, as well as variables related to resilience and personality. Future clinical models that could be implemented directly after delivery might consider including these variables in order to identify women at high risk for postpartum depression to facilitate individualized follow-up and cost-effectiveness.
| S-EPMC8041863 | biostudies-literature
Project description:IntroductionPost-stroke depression (PSD) is a serious mental disorder after ischemic stroke. Early detection is important for clinical practice. This research aims to develop machine learning models to predict new-onset PSD using real-world data.MethodsWe collected data for ischemic stroke patients from multiple medical institutions in Taiwan between 2001 and 2019. We developed models from 61,460 patients and used 15,366 independent patients to test the models' performance by evaluating their specificities and sensitivities. The predicted targets were whether PSD occurred at 30, 90, 180, and 365 days post-stroke. We ranked the important clinical features in these models.ResultsIn the study's database sample, 1.3% of patients were diagnosed with PSD. The average specificity and sensitivity of these four models were 0.83-0.91 and 0.30-0.48, respectively. Ten features were listed as important features related to PSD at different time points, namely old age, high height, low weight post-stroke, higher diastolic blood pressure after stroke, no pre-stroke hypertension but post-stroke hypertension (new-onset hypertension), post-stroke sleep-wake disorders, post-stroke anxiety disorders, post-stroke hemiplegia, and lower blood urea nitrogen during stroke.DiscussionMachine learning models can provide as potential predictive tools for PSD and important factors are identified to alert clinicians for early detection of depression in high-risk stroke patients.
| S-EPMC10315461 | biostudies-literature
Project description:BackgroundLinguistic accessibility has an important impact on the reception and utilization of translated health resources among multicultural and multilingual populations. Linguistic understandability of health translation has been understudied.ObjectiveOur study aimed to develop novel machine learning models for the study of the linguistic accessibility of health translations comparing Chinese translations of the World Health Organization health materials with original Chinese health resources developed by the Chinese health authorities.MethodsUsing natural language processing tools for the assessment of the readability of Chinese materials, we explored and compared the readability of Chinese health translations from the World Health Organization with original Chinese materials from the China Center for Disease Control and Prevention.ResultsA pairwise adjusted t test showed that the following 3 new machine learning models achieved statistically significant improvement over the baseline logistic regression in terms of area under the curve: C5.0 decision tree (95% CI -0.249 to -0.152; P<0.001), random forest (95% CI 0.139-0.239; P<0.001) and extreme gradient boosting tree (95% CI 0.099-0.193; P<0.001). There was, however, no significant difference between C5.0 decision tree and random forest (P=0.513). The extreme gradient boosting tree was the best model, achieving statistically significant improvement over the C5.0 model (P=0.003) and the random forest model (P=0.006) at an adjusted Bonferroni P value at 0.008.ConclusionsThe development of machine learning algorithms significantly improved the accuracy and reliability of current approaches to the evaluation of the linguistic accessibility of Chinese health information, especially Chinese health translations in relation to original health resources. Although the new algorithms developed were based on Chinese health resources, they can be adapted for other languages to advance current research in accessible health translation, communication, and promotion.
| S-EPMC8532010 | biostudies-literature
Project description:Postpartum depression is a serious health issue beyond the mental health problems that affect mothers after childbirth. There are no predictive tools available to screen postpartum depression that also allow early interventions. We aimed to develop predictive models for postpartum depression using machine learning (ML) approaches. We performed a retrospective cohort study using data from the Pregnancy Risk Assessment Monitoring System 2012-2013 with 28,755 records (3339 postpartum depression and 25,416 normal cases). The imbalance between the two groups was addressed by a balanced resampling using both random down-sampling and the synthetic minority over-sampling technique. Nine different ML algorithms, including random forest (RF), stochastic gradient boosting, support vector machines (SVM), recursive partitioning and regression trees, naïve Bayes, k-nearest neighbor (kNN), logistic regression, and neural network, were employed with 10-fold cross-validation to evaluate the models. The overall classification accuracies of the nine models ranged from 0.650 (kNN) to 0.791 (RF). The RF method achieved the highest area under the receiver-operating-characteristic curve (AUC) value of 0.884, followed by SVM, which achieved the second-best performance with an AUC value of 0.864. Predictive modeling developed using ML-approaches may thus be used as a prediction (screening) tool for postpartum depression in future studies.
| S-EPMC7564708 | biostudies-literature
Project description:BackgroundTreatment with atezolizumab and bevacizumab has become standard of care for advanced unresectable hepatocellular carcinoma (HCC) but carries an increased gastrointestinal bleeding risk. Therefore, patients are often required to undergo esophagogastroduodenoscopy (EGD) to rule out esophageal varices (EV) prior to initiating therapy, which can delay care and lead to unnecessary procedural risks and health care costs. In 2019, the EVendo score was created and validated as a noninvasive tool to accurately screen out patients who were at low risk for having EV that required treatment. We sought to validate whether the EVendo score could be used to accurately predict the presence of EV and varices needing treatment (VNT) in patients with HCC.MethodsThis was a retrospective multicenter cohort study of patients with HCC from 9/2004 to 12/2021. We included patients who underwent EGDs within 1 year after their HCC diagnosis. We collected clinical parameters needed to calculate an EVendo score at the time of EGD and compared the EVendo model prediction to the gold standard endoscopic report in predicting presence of VNT.Results112 with HCC were recruited to this study, with 117 qualifying EGDs. VNT occurred in 39 (33.3%) patients. The EVendo score had a sensitivity of 97.4% and a negative predictive value of 96.9%, supporting the validity in applying EVendo in predicting VNT in HCC.ConclusionIn this study, we validated the use of the EVendo score in ruling out VNT in patients with HCC. The application of the EVendo score could safely defer about 30% of EGDs for EV screening in HCC patients. Although additional validation cohorts are needed, this suggests that EVendo score can potentially be applied in patients with HCC to avoid unnecessary EGDs, which can ultimately mitigate healthcare costs and delays in initiating HCC treatment with atezolizumab and bevacizumab.
| S-EPMC11341647 | biostudies-literature
Project description:BackgroundFoodborne diseases, as a type of disease with a high global incidence, place a heavy burden on public health and social economy. Foodborne pathogens, as the main factor of foodborne diseases, play an important role in the treatment and prevention of foodborne diseases; however, foodborne diseases caused by different pathogens lack specificity in clinical features, and there is a low proportion of clinically actual pathogen detection in real life.ObjectiveWe aimed to analyze foodborne disease case data, select appropriate features based on analysis results, and use machine learning methods to classify foodborne disease pathogens to predict foodborne disease pathogens that have not been tested.MethodsWe extracted features such as space, time, and exposed food from foodborne disease case data and analyzed the relationship between these features and the foodborne disease pathogens using a variety of machine learning methods to classify foodborne disease pathogens. We compared the results of 4 models to obtain the pathogen prediction model with the highest accuracy.ResultsThe gradient boost decision tree model obtained the highest accuracy, with accuracy approaching 69% in identifying 4 pathogens including Salmonella, Norovirus, Escherichia coli, and Vibrio parahaemolyticus. By evaluating the importance of features such as time of illness, geographical longitude and latitude, and diarrhea frequency, we found that they play important roles in classifying the foodborne disease pathogens.ConclusionsData analysis can reflect the distribution of some features of foodborne diseases and the relationship among the features. The classification of pathogens based on the analysis results and machine learning methods can provide beneficial support for clinical auxiliary diagnosis and treatment of foodborne diseases.
| S-EPMC7872834 | biostudies-literature
Project description:BackgroundWarfarin dosing in cardiac surgery patients is complicated by a heightened sensitivity to the drug, predisposing patients to adverse events. Predictive algorithms are therefore needed to guide warfarin dosing in cardiac surgery patients.ObjectiveThis study aimed to develop and validate an algorithm for predicting the warfarin dose needed to attain a therapeutic international normalized ratio (INR) at the time of discharge in cardiac surgery patients.MethodsWe abstracted variables influencing warfarin dosage from the records of 1031 encounters initiating warfarin between April 1, 2011, and November 29, 2019, at St Michael's Hospital in Toronto, Ontario, Canada. We compared the performance of penalized linear regression, k-nearest neighbors, random forest regression, gradient boosting, multivariate adaptive regression splines, and an ensemble model combining the predictions of the 5 regression models. We developed and validated separate models for predicting the warfarin dose required for achieving a discharge INR of 2.0-3.0 in patients undergoing all forms of cardiac surgery except mechanical mitral valve replacement and a discharge INR of 2.5-3.5 in patients receiving a mechanical mitral valve replacement. For the former, we selected 80% of encounters (n=780) who had initiated warfarin during their hospital admission and had achieved a target INR of 2.0-3.0 at the time of discharge as the training cohort. Following 10-fold cross-validation, model accuracy was evaluated in a test cohort comprised solely of cardiac surgery patients. For patients requiring a target INR of 2.5-3.5 (n=165), we used leave-p-out cross-validation (p=3 observations) to estimate model performance. For each approach, we determined the mean absolute error (MAE) and the proportion of predictions within 20% of the true warfarin dose. We retrospectively evaluated the best-performing algorithm in clinical practice by comparing the proportion of cardiovascular surgery patients discharged with a therapeutic INR before (April 2011 and July 2019) and following (September 2021 and May 2, 2022) its implementation in routine care.ResultsRandom forest regression was the best-performing model for patients with a target INR of 2.0-3.0, an MAE of 1.13 mg, and 39.5% of predictions of falling within 20% of the actual therapeutic discharge dose. For patients with a target INR of 2.5-3.5, the ensemble model performed best, with an MAE of 1.11 mg and 43.6% of predictions being within 20% of the actual therapeutic discharge dose. The proportion of cardiovascular surgery patients discharged with a therapeutic INR before and following implementation of these algorithms in clinical practice was 47.5% (305/641) and 61.1% (11/18), respectively.ConclusionsMachine learning algorithms based on routinely available clinical data can help guide initial warfarin dosing in cardiac surgery patients and optimize the postsurgical anticoagulation of these patients.
| S-EPMC10733832 | biostudies-literature
Project description:Finding the ground state of a quantum many-body system is a fundamental problem in quantum physics. In this work, we give a classical machine learning (ML) algorithm for predicting ground state properties with an inductive bias encoding geometric locality. The proposed ML model can efficiently predict ground state properties of an n-qubit gapped local Hamiltonian after learning from only [Formula: see text] data about other Hamiltonians in the same quantum phase of matter. This improves substantially upon previous results that require [Formula: see text] data for a large constant c. Furthermore, the training and prediction time of the proposed ML model scale as [Formula: see text] in the number of qubits n. Numerical experiments on physical systems with up to 45 qubits confirm the favorable scaling in predicting ground state properties using a small training dataset.
| S-EPMC10828424 | biostudies-literature