Dataset Information

Online Reviews of Mental Health Treatment Facilities: Narrative Themes Associated With Positive and Negative Ratings.

ABSTRACT:

Objective

Previous studies indicate that patients' satisfaction with mental health care is correlated with both treatment outcomes and quality of life. The aims of this study were to describe online reviews of mental health treatment facilities, including key themes in review content, and to evaluate the correlation between narrative review themes, facility characteristics, and review ratings.

Methods

United States National Mental Health Services Survey (N-MHSS) facilities were linked to corresponding Yelp pages, created between March 2007 and September 2019. Correlations between review ratings and both machine learning-generated latent Dirichlet allocation topics and N-MHSS-reported facility characteristics were measured by using Spearman's rank-order correlation coefficient. Significance was defined by a Bonferroni-adjusted p<0.001.

Results

Of 10,191 unique mental health treatment facilities, 1,383 (13.6%) had relevant Yelp pages with 8,133 corresponding reviews. The number of newly reviewed facilities and the number of new reviews increased throughout the study period. Narrative topics positively correlated with review ratings included caring staff (Spearman's ρ=0.39) and nonpharmacologic treatment (ρ=0.16). Topics negatively correlated with review ratings included rude staff (ρ=-0.14) and safety and abuse (ρ=-0.14). Of 126 N-MHSS survey items, 11 were positively correlated with review rating, including "outpatient mental health facility" (ρ=0.13), and 33 were negatively correlated with review rating, including accepting Medicare (ρ=-0.21).

Conclusions

Narrative topics provide information beyond what is currently collected through the N-MHSS. Topics associated with positive and negative reviews, such as staff attitude toward patients, can guide improvement in patients' satisfaction and engagement with mental health care.

SUBMITTER: Stokes DC

PROVIDER: S-EPMC9116241 | biostudies-literature | 2021 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Online Reviews of Mental Health Treatment Facilities: Narrative Themes Associated With Positive and Negative Ratings.

Stokes Daniel C DC Kishton Rachel R McCalpin Haley J HJ Pelullo Arthur P AP Meisel Zachary F ZF Beidas Rinad S RS Merchant Raina M RM

Psychiatric services (Washington, D.C.) 20210521 7

<h4>Objective</h4>Previous studies indicate that patients' satisfaction with mental health care is correlated with both treatment outcomes and quality of life. The aims of this study were to describe online reviews of mental health treatment facilities, including key themes in review content, and to evaluate the correlation between narrative review themes, facility characteristics, and review ratings.<h4>Methods</h4>United States National Mental Health Services Survey (N-MHSS) facilities were li ...[more]

PMID: 34015944

Similar Datasets

Project description:BackgroundYoung people frequently make use of the internet as part of their day-to-day activities, and this has extended to their help-seeking behavior. Offline help-seeking is known to be impeded by a number of barriers including stigma and a preference for self-reliance. Online help-seeking may offer an additional domain where young people can seek help for mental health difficulties without being encumbered by these same barriers.ObjectiveThe objective of this systematic literature review was to examine young peoples' online help-seeking behaviors for mental health concerns. It aimed to summarize young peoples' experiences and identify benefits and limitations of online help-seeking for this age group. It also examined the theoretical perspectives that have been applied to understand online help-seeking.MethodsA systematic review of peer-reviewed research papers from the following major electronic databases was conducted: PsycINFO, Cumulative Index of Nursing and Allied Health Literature, PubMed, Cochrane Library, Association for Computing Machinery Digital Library, and Institute of Electrical and Electronics Engineers Xplore. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed. The search was conducted in August 2017. The narrative synthesis approach to reviews was used to analyze the existing evidence to answer the review questions.ResultsOverall, 28 studies were included. The most common method of data collection was through the use of surveys. Study quality was moderate to strong. Text-based query via an internet search engine was the most commonly identified help-seeking approach. Social media, government or charity websites, live chat, instant messaging, and online communities were also used. Key benefits included anonymity and privacy, immediacy, ease of access, inclusivity, the ability to connect with others and share experiences, and a greater sense of control over the help-seeking journey. Online help-seeking has the potential to meet the needs of those with a preference for self-reliance or act as a gateway to further help-seeking. Barriers to help-seeking included a lack of mental health literacy, concerns about privacy and confidentiality, and uncertainty about the trustworthiness of online resources. Until now, there has been limited development and use of theoretical models to guide research on online help-seeking.ConclusionsApproaches to improving help-seeking by young people should consider the role of the internet and online resources as an adjunct to offline help-seeking. This review identifies opportunities and challenges in this space. It highlights the limited use of theoretical frameworks to help conceptualize online help-seeking. Self-determination theory and the help-seeking model provide promising starting points for the development of online help-seeking theories. This review discusses the use of these theories to conceptualize online help-seeking and identify key motivations and tensions that may arise when young people seek help online.

Project description:BackgroundThe COVID-19 pandemic has highlighted the importance of online medical services. Although some researchers have investigated how numerical ratings affect consumer choice, limited studies have focused on the effect of negative reviews that most concern physicians.ObjectiveThis study aimed to investigate how negative review features, including proportion (low/high), claim type (evaluative/factual), and physician response (absence/presence), influence consumers' physician evaluation process under conditions in which a physician's overall rating is high.MethodsUsing a 2×2×2 between-subject decision-controlled experiment, this study examined participants' judgment on physicians with different textual reviews. Collected data were analyzed using the t test and partial least squares-structural equation modeling.ResultsNegative reviews decreased consumers' physician selection intention. The negative review proportion (β=-0.371, P<.001) and claim type (β=-0.343, P<.001) had a greater effect on consumers' physician selection intention compared to the physician response (β=0.194, P<.001). A high negative review proportion, factual negative reviews, and the absence of a physician response significantly reduced consumers' physician selection intention compared to their counterparts. Consumers' locus attributions on the negative reviews affected their evaluation process. Physician attribution mediated the effects of review proportion (β=-0.150, P<.001), review claim type (β=-0.068, P=.01), and physician response (β=0.167, P<.001) on consumer choice. Reviewer attribution also mediated the effects of review proportion (β=-0.071, P<.001), review claim type (β=-0.025, P=.01), and physician response (β=0.096, P<.001) on consumer choice. The moderating effects of the physician response on the relationship between review proportion and physician attribution (β=-0.185, P<.001), review proportion and reviewer attribution (β=-0.110, P<.001), claim type and physician attribution (β=-0.123, P=.003), and claim type and reviewer attribution (β=-0.074, P=.04) were all significant.ConclusionsNegative review features and the physician response significantly influence consumer choice through the causal attribution to physicians and reviewers. Physician attribution has a greater effect on consumers' physician selection intention than reviewer attribution does. The presence of a physician response decreases the influence of negative reviews through direct and moderating effects. We propose some practical implications for physicians, health care providers, and online medical service platforms.

Project description:BackgroundThere have been public health interventions that aim to reduce barriers to health care access by extending opening hours of health care facilities. However, the impact of opening hours from the patient's perspective is not well understood.ObjectiveThis study aims to investigate the relationship between temporal accessibility of health care services and how patients rate the providers on Yelp, an online review website that is popular in the United States. Using crowdsourced open Internet data, such as Yelp, can help circumvent the traditional survey method.MethodsFrom Yelp's limited academic dataset, this study examined the pattern of visits to health care providers and performed a secondary analysis to examine the association between patient rating (measured by Yelp's rating) and temporal accessibility of health care services (measured by opening hours) using ordinal logistic regression models. Other covariates included were whether an appointment was required, the type of health care service, the region of the health care service provider, the number of reviews the health care service provider received in the past, the number of nearby competitors, the mean rating of competitors, and the standard deviation of competitors' ratings.ResultsFrom the 2085 health care service providers identified, opening hours during certain periods, the type of health care service, and the variability of competitors' ratings showed an association with patient rating. Most of the visits to health care service providers took place between normal working hours (9 AM-5 PM) from Sunday to Thursday, and the least on Saturday. A model fitted to the entire sample showed that increasing hours during normal working hours on Monday (OR 0.926, 95% CI 0.880-0.973, P=0.03), Saturday (OR 0.897, 95% CI 0.860-0.935, P<0.001), Sunday (OR 0.904, 95% CI 0.841-0.970, P=0.005), and outside normal working hours on Friday (OR 0.872, 95% CI 0.760-0.998, P=0.048) was associated with receiving lower ratings. But increasing hours during outside normal working hours on Sunday was associated with receiving higher ratings (OR 1.400, 95% CI 1.036-1.924, P=0.03). There were also observed differences in patient ratings among the health care services types, but not geographically or by appointment requirement.ConclusionsThis study shows that public health interventions, especially those involving opening hours, could use crowdsourced open Internet data to enhance the evidence base for decision making and evaluation in the future. This study illustrates one example of how Yelp data could be used to understand patient experiences with health care services, making a case for future research for exploring online reviews as a health dataset.

Project description:ImportanceThere are areas of skilled nursing facility (SNF) experience of importance to the public that are not currently included in public reporting initiatives on SNF quality. Whether patients, hospitals, and payers can leverage the information available from unsolicited online reviews to reduce avoidable rehospitalizations from SNFs is unknown.ObjectivesTo assess the association between rehospitalization rates and online ratings of SNFs; to compare the association of rehospitalization with ratings from a review website vs Medicare Nursing Home Compare (NHC) ratings; and to identify specific topics consistently reported in reviews of SNFs with the highest vs lowest rehospitalization rates using natural language processing.Design, setting, and participantsA retrospective cross-sectional study of 1536 SNFs with online reviews on Yelp (a website that allows consumers to rate and review businesses and services, scored on a 1- to 5-star rating scale, with 1 star indicating the lowest rating and 5 stars indicating the highest rating) posted between January 1, 2014, and December 31, 2018. The combined data set included 1536 SNFs with 8548 online reviews, NHC ratings, and readmission rates.Main outcomes and measuresA mean rating from the review website was calculated through the end of each year. Risk-standardized rehospitalization rates were obtained from NHC. Linear regression was used to measure the association between the rehospitalization rate of a SNF and the online ratings. Natural language processing was used to identify topics associated with reviews of SNFs in the top and bottom quintiles of rehospitalization rates.ResultsThe 1536 SNFs in the sample had a median of 6 reviews (interquartile range, 3-13 reviews), with a mean (SD) review website rating of 2.7 (1.1). The SNFs with the highest rating on both the review website and NHC had 2.0% lower rehospitalization rates compared with the SNFs with the lowest rating on both websites (21.3%; 95% CI, 20.7%-21.8%; vs 23.3%; 95% CI, 22.7%-24.0%; P = .04). Compared with the NHC ratings alone, review website ratings were associated with an additional 0.4% of the variation in rehospitalization rates across SNFs (adjusted R2 = 0.009 vs adjusted R2 = 0.013; P = .003). Thematic analysis of qualitative comments on the review website for SNFs with high vs low rehospitalization rates identified several areas of importance to the reviewers, such as the quality of physical infrastructure and equipment, staff attitudes and communication with caregivers.Conclusions and relevanceSkilled nursing facilities with the best rating on both a review website and NHC had slightly lower rehospitalization rates than SNFs with the best rating on NHC alone. However, there was marked variation in the volume of reviews, and many SNF characteristics were underrepresented. Further refinement of the review process is warranted.

Project description:BackgroundThe increasing development and use of digital health interventions requires good quality costing information to inform development and commissioning choices about resource allocation decisions. The Narrative Experiences Online (NEON) Intervention is a web-application that delivers recorded mental health recovery narratives to its users. Two randomized controlled trials are testing the NEON Intervention in people with experience of psychosis (NEON) and people experiencing non-psychosis mental health problems (NEON-O).AimThis study describes and estimates the cost components and total cost of developing and delivering the NEON Intervention.Materials and methodsTotal costs for the NEON Trial (739 participants) and NEON-O Trial (1,024 participants) were estimated by: identifying resource use categories involved in intervention development and delivery; accurate measurement or estimation of resource use; and a valuation of resource use to generate overall costs, using relevant unit costs. Resource use categories were identified through consultation with literature, costing reporting standards and iterative consultation with health researchers involved in NEON Intervention development and delivery. Sensitivity analysis was used to test assumptions made.ResultsThe total cost of developing the NEON Intervention was £182,851. The largest cost components were software development (27%); Lived Experience Advisory Panel workshops (23%); coding the narratives (9%); and researchers' time to source narratives (9%). The total cost of NEON Intervention delivery during the NEON Trial was £118,663 (£349 per NEON Intervention user). In the NEON-O Trial, the total delivery cost of the NEON Intervention was £123,444 (£241 per NEON Intervention user). The largest cost components include updating the narrative collection (50%); advertising (19%); administration (14%); and software maintenance (11%). Uncertainty in the cost of administration had the largest effect on delivery cost estimates.ConclusionOur work shows that developing and delivering a digital health intervention requires expertise and time commitment from a range of personnel. Teams developing digital narrative interventions need to allocate substantial resources to curating narrative collections.Implications for practiceThis study identifies the development and delivery resource use categories of a digital health intervention to promote the consistent reporting of costs and informs future decision-making about the costs of delivering the NEON Intervention at scale.Trial registrationNEON Trial: ISRCTN11152837, registered 13 August 2018, http://www.isrctn.com/ISRCTN11152837. NEON-O Trial: ISRCTN63197153, registered 9 January 2020, http://www.isrctn.com/ISRCTN63197153.

Dataset Information

Online Reviews of Mental Health Treatment Facilities: Narrative Themes Associated With Positive and Negative Ratings.

Objective

Methods

Results

Conclusions

Publications

Online Reviews of Mental Health Treatment Facilities: Narrative Themes Associated With Positive and Negative Ratings.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets