Dataset Information

Natural Language Processing Tools for Assessing Progress and Outcome of Two Veteran Populations: Cohort Study From a Novel Online Intervention for Posttraumatic Growth.

ABSTRACT: BACKGROUND:Over 100 million Americans lack affordable access to behavioral health care. Among these, military veterans are an especially vulnerable population. Military veterans require unique behavioral health services that can address military experiences and challenges transitioning to the civilian sector. Real-world programs to help veterans successfully transition to civilian life must build a sense of community, have the ability to scale, and be able to reach the many veterans who cannot or will not access care. Digitally based behavioral health initiatives have emerged within the past few years to improve this access to care. Our novel behavioral health intervention teaches mindfulness-based cognitive behavioral therapy and narrative therapy using peer support groups as guides, with human-facilitated asynchronous online discussions. Our study applies natural language processing (NLP) analytics to assess effectiveness of our online intervention in order to test whether NLP may provide insights and detect nuances of personal change and growth that are not currently captured by subjective symptom measures. OBJECTIVE:This paper aims to study the value of NLP analytics in assessing progress and outcomes among combat veterans and military sexual assault survivors participating in novel online interventions for posttraumatic growth. METHODS:IBM Watson and Linguistic Inquiry and Word Count tools were applied to the narrative writings of combat veterans and survivors of military sexual trauma who participated in novel online peer-supported group therapies for posttraumatic growth. Participants watched videos, practiced skills such as mindfulness meditation, told their stories through narrative writing, and participated in asynchronous, facilitated online discussions with peers. The writings, including online postings, by the 16 participants who completed the program were analyzed after completion of the program. RESULTS:Our results suggest that NLP can provide valuable insights on shifts in personality traits, personal values, needs, and emotional tone in an evaluation of our novel online behavioral health interventions. Emotional tone analysis demonstrated significant decreases in fear and anxiety, sadness, and disgust, as well as increases in joy. Significant effects were found for personal values and needs, such as needing or desiring closeness and helping others, and for personality traits of openness, conscientiousness, extroversion, agreeableness, and neuroticism (ie, emotional range). Participants also demonstrated increases in authenticity and clout (confidence) of expression. NLP results were generally supported by qualitative observations and analysis, structured data, and course feedback. CONCLUSIONS:The aggregate of results in our study suggest that our behavioral health intervention was effective and that NLP can provide valuable insights on shifts in personality traits, personal values, and needs, as well as measure changes in emotional tone. NLP's sensitivity to changes in emotional tone, values, and personality strengths suggests the efficacy of NLP as a leading indicator of treatment progress.

SUBMITTER: Norman KP

PROVIDER: S-EPMC7542412 | biostudies-literature | 2020 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Natural Language Processing Tools for Assessing Progress and Outcome of Two Veteran Populations: Cohort Study From a Novel Online Intervention for Posttraumatic Growth.

Norman Kim P KP Govindjee Anita A Norman Seth R SR Godoy Michael M Cerrone Kimberlie L KL Kieschnick Dustin W DW Kassler William W

JMIR formative research 20200923 9

<h4>Background</h4>Over 100 million Americans lack affordable access to behavioral health care. Among these, military veterans are an especially vulnerable population. Military veterans require unique behavioral health services that can address military experiences and challenges transitioning to the civilian sector. Real-world programs to help veterans successfully transition to civilian life must build a sense of community, have the ability to scale, and be able to reach the many veterans who ...[more]

PMID: 32769074

Similar Datasets

Project description:IntroductionThe state-of-the-art 3-step Theory of Suicide (3ST) describes why people consider suicide and who will act on their suicidal thoughts and attempt suicide. The central concepts of 3ST-psychological pain, hopelessness, connectedness, and capacity for suicide-are among the most important drivers of suicidal behaviour but they are missing from clinical suicide risk prediction models in use at the US Veterans Health Administration (VHA). These four concepts are not systematically recorded in structured fields of VHA's electronic healthcare records. Therefore, this study will develop a domain-specific ontology that will enable automated extraction of these concepts from clinical progress notes using natural language processing (NLP), and test whether NLP-based predictors for these concepts improve accuracy of existing VHA suicide risk prediction models.Methods and analysisOur mixed-method study has an exploratory sequential design where a qualitative component (aim 1) will inform quantitative analyses (aims 2 and 3). For aim 1, subject matter experts will manually annotate progress notes of clinical encounters with veterans who attempted or died by suicide to develop a domain-specific ontology for the 3ST concepts. During aim 2, we will use NLP to machine-annotate clinical progress notes and derive longitudinal representations for each patient with respect to the presence and intensity of hopelessness, psychological pain, connectedness and capacity for suicide in temporal proximity of suicide attempts and deaths by suicide. These longitudinal representations will be evaluated during aim 3 for their ability to improve existing VHA prediction models of suicide and suicide attempts, STORM (Stratification Tool for Opioid Risk Mitigation) and REACHVET (Recovery Engagement and Coordination for Health - Veterans Enhanced Treatment).Ethics and disseminationEthics approval for this study was granted by the Stanford University Institutional Review Board and the Research and Development Committee of the VA Palo Alto Health Care System. Results of the study will be disseminated through several outlets, including peer-reviewed publications and presentations at national conferences.

Project description:ContextIdentifying tranquil areas is important for landscape planning and policy-making. Research demonstrated discrepancies between modelled potential tranquil areas and where people experience tranquillity based on field surveys. Because surveys are resource-intensive, user-generated text data offers potential for extracting where people experience tranquillity.ObjectivesWe explore and model the relationship between landscape ecological measures and experienced tranquillity extracted from user-generated text descriptions.MethodsGeoreferenced, user-generated landscape descriptions from Geograph.UK were filtered using keywords related to tranquillity. We stratify resulting tranquil locations according to dominant land cover and quantify the influence of landscape characteristics including diversity and naturalness on explaining the presence of tranquillity. Finally, we apply natural language processing to identify terms linked to tranquillity keywords and compare the similarity of these terms across land cover classes.ResultsEvaluation of potential keywords yielded six keywords associated with experienced tranquillity, resulting in 15,350 extracted tranquillity descriptions. The two most common land cover classes associated with tranquillity were arable and horticulture, and improved grassland, followed by urban and suburban. In the logistic regression model across all land cover classes, freshwater, elevation and naturalness were positive predictors of tranquillity. Built-up area was a negative predictor. Descriptions of tranquillity were most similar between improved grassland and arable and horticulture, and most dissimilar between arable and horticulture and urban.ConclusionsThis study highlights the potential of applying natural language processing to extract experienced tranquillity from text, and demonstrates links between landscape ecological measures and tranquillity as a perceived landscape quality.Supplementary informationThe online version of this article (10.1007/s10980-020-01181-8) contains supplementary material, which is available to authorized users.

Project description:BackgroundManual chart review is labor-intensive and requires specialized knowledge possessed by highly trained medical professionals. The cost and infrastructure challenges required to implement this is prohibitive for most hospitals. Natural language processing (NLP) tools are distinctive in their ability to extract critical information from unstructured text in the electronic health records. As a simple proof-of-concept for the potential application of NLP technology in total hip arthroplasty (THA), we examined its ability to identify periprosthetic femur fractures (PPFFx) followed by more complex Vancouver classification.MethodsPPFFx were identified among all THAs performed at a single academic institution between 1998 and 2016. A randomly selected training cohort (1538 THAs with 89 PPFFx cases) was used to develop the prototype NLP algorithm and an additional randomly selected cohort (2982 THAs with 84 PPFFx cases) was used to further validate the algorithm. Keywords to identify, and subsequently classify, Vancouver type PPFFx about THA were defined. The gold standard was confirmed by experienced orthopedic surgeons using chart and radiographic review. The algorithm was applied to consult and operative notes to evaluate language used by surgeons as a means to predict the correct pathology in the absence of a listed, precise diagnosis. Given the variability inherent to fracture descriptions by different surgeons, an iterative process was used to improve the algorithm during the training phase following error identification. Validation statistics were calculated using manual chart review as the gold standard.ResultsIn distinguishing PPFFx, the NLP algorithm demonstrated 100% sensitivity and 99.8% specificity. Among 84 PPFFx test cases, the algorithm demonstrated 78.6% sensitivity and 94.8% specificity in determining the correct Vancouver classification.ConclusionNLP-enabled algorithms are a promising alternative to manual chart review for identifying THA outcomes. NLP algorithms applied to surgeon notes demonstrated excellent accuracy in delineating PPFFx, but accuracy was low for Vancouver classification subtype. This proof-of-concept study supports the use of NLP technology to extract THA-specific data elements from the unstructured text in electronic health records in an expeditious and cost-effective manner.Level of evidenceLevel III.

Project description:BackgroundMaternal mental disorders are considered a leading complication of childbirth and a common contributor to maternal death. In addition to undermining maternal welfare, untreated postpartum psychopathology can result in child emotional and physical neglect, and associated significant pediatric health costs. Some women may experience a traumatic childbirth and develop posttraumatic stress disorder (PTSD) symptoms following delivery (CB-PTSD). Although women are routinely screened for postpartum depression in the U.S., there is no recommended protocol to inform the identification of women who are likely to experience CB-PTSD. Advancements in computational methods of free text has shown promise in informing diagnosis of psychiatric conditions. Although the language in narratives of stressful events has been associated with post-trauma outcomes, whether the narratives of childbirth processed via machine learning can be useful for CB-PTSD screening is unknown.ObjectiveThis study examined the utility of written narrative accounts of personal childbirth experience for the identification of women with provisional CB-PTSD. To this end, we developed a model based on natural language processing (NLP) and machine learning (ML) algorithms to identify CB-PTSD via classification of birth narratives.Study designA total of 1,127 eligible postpartum women who enrolled in a study survey during the COVID-19 era provided short written childbirth narrative accounts in which they were instructed to focus on the most distressing aspects of their childbirth experience. They also completed a PTSD symptom screen to determine provisional CB-PTSD. After exclusion criteria were applied, data from 995 participants was analyzed. An ML-based Sentence-Transformer NLP model was used to represent narratives as vectors that served as inputs for a neural network ML model developed in this study to identify participants with provisional CB-PTSD.ResultsThe ML model derived from NLP of childbirth narratives achieved good performance: AUC 0.75, F1-score 0.76, sensitivity 0.8, and specificity 0.70. Moreover, women with provisional CB-PTSD generated longer narratives (t-test results: t=2 . 30, p=0 . 02 ) and used more negative emotional expressions (Wilcoxon test: 'sadness': p=8 . 90e- 04 , W=31,017 ; 'anger': p=1 . 32e- 02 , W=35,005 . 50 ) and death-related words (Wilcoxon test: p=3 . 48e- 05 , W=34,538 ) in describing their childbirth experience than those with no CB-PTSD.ConclusionsThis study provides proof of concept that personal childbirth narrative accounts generated in the early postpartum period and analyzed via advanced computational methods can detect with relatively high accuracy women who are likely to endorse CB-PTSD and those at low risk. This suggests that birth narratives could be promising for informing low-cost, non-invasive tools for maternal mental health screening, and more research that utilizes ML to predict early signs of maternal psychiatric morbidity is warranted.

Dataset Information

Natural Language Processing Tools for Assessing Progress and Outcome of Two Veteran Populations: Cohort Study From a Novel Online Intervention for Posttraumatic Growth.

Publications

Natural Language Processing Tools for Assessing Progress and Outcome of Two Veteran Populations: Cohort Study From a Novel Online Intervention for Posttraumatic Growth.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets