Dataset Information

The relationship between commercial website ratings and traditional hospital performance measures in the USA.

ABSTRACT: Our goal was to compare hospital scores from the most widely used commercial website in the USA to hospital scores from more systematic measures of patient experience and outcomes, and to assess what drives variation in the commercial website scores.For a national sample of US hospitals, we compared scores on Yelp.com, which aggregates website visitor ratings (1-5 stars), with traditional measures of hospital quality. We calculated correlations between hospital Yelp scores and the following: hospital percent high ratings (9 or 10, scale 0-10) on the 'Overall' item on the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey; hospital individual HCAHPS domain scores (eg, nurse communication, pain control); hospital 30-day mortality; and hospital 30-day readmission rates.Of hospitals reporting HCAHPS (n=3796), 962 (25%) had scores on Yelp. Among hospitals with >5 Yelp ratings, the correlation of percent high ratings between Yelp and HCAHPS was 0.49 (p<0.001). The percent high ratings within each HCAHPS domain increased monotonically with increasing Yelp scores (p?0.001 for all domains). Percent high ratings in Yelp and HCAHPS were statistically significantly correlated with lower mortality for myocardial infarction (MI; -0.19 for Yelp and -0.13 for HCAHPS) and pneumonia (-0.14 and -0.18), and fewer readmissions for MI (-0.17 and -0.39), heart failure (-0.31 and -0.39), and pneumonia (-0.18 and -0.27).These data suggest that rater experiences for Yelp and HCAHPS may be similar, and that consumers posting ratings on Yelp may observe aspects of care related to important patient outcomes.

SUBMITTER: Bardach NS

PROVIDER: S-EPMC4074426 | biostudies-literature | 2013 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The relationship between commercial website ratings and traditional hospital performance measures in the USA.

Bardach Naomi S NS Asteria-Peñaloza Renée R Boscardin W John WJ Dudley R Adams RA

BMJ quality & safety 20121123 3

<h4>Background</h4>Our goal was to compare hospital scores from the most widely used commercial website in the USA to hospital scores from more systematic measures of patient experience and outcomes, and to assess what drives variation in the commercial website scores.<h4>Methods</h4>For a national sample of US hospitals, we compared scores on Yelp.com, which aggregates website visitor ratings (1-5 stars), with traditional measures of hospital quality. We calculated correlations between hospital ...[more]

PMID: 23178860

Similar Datasets

Project description:Health-care organizations around the world are striving to achieve transformational performance improvement, often through adopting process improvement methodologies such as lean management. Indeed, lean management has been implemented in hospitals in many countries. But despite a shared methodology and the potential benefit of benchmarking lean implementation and its effects on hospital performance, cross-national lean benchmarking is rare. Health-care organizations in different countries operate in very different contexts, including different health-care system models, and these differences may be perceived as limiting the ability of improvers to benchmark lean implementation and related organizational performance. However, no empirical research is available on the international relevance and applicability of lean implementation and hospital performance measures. To begin understanding the opportunities and limitations related to cross-national benchmarking of lean in hospitals, we conducted a cross-national case study of the relevance and applicability of measures of lean implementation in hospitals and hospital performance. We report an exploratory case study of the relevance of lean implementation measures and the applicability of hospital performance measures using quantitative comparisons of data from Hospital District of Helsinki and Uusimaa (HUS) Helsinki University Hospital in Finland and a sample of 75 large academic hospitals in the USA. The relevance of lean-related measures was high across the two countries: almost 90% of the items developed for a US survey were relevant and available from HUS. A majority of the US-based measures for financial performance (66.7%), service provision/utilization (100.0%) and service provision/care processes (60.0%) were available from HUS. Differences in patient satisfaction measures prevented comparisons between HUS and the USA. Of 18 clinical outcome measures, only four (22%) were not comparable. Clinical outcome measures were less affected by the differences in health-care system models than measures related to service provision and financial performance. Lean implementation measures are highly relevant in health-care organizations operating in the USA and Finland, as is the applicability of a variety of performance improvement measures. Cross-national benchmarking in lean healthcare is feasible, but a careful assessment of contextual factors, including the health-care system model, and their impact on the applicability and relevance of chosen benchmarking measures is necessary. The differences between the US and Finnish health-care system models is most clearly reflected in financial performance measures and care process measures.

Project description:Hospital-level measures of patient satisfaction and quality are now reported publically by the Centers for Medicare and Medicaid Services. There are limited metrics specific to cancer patients. We examined whether publically reported hospital satisfaction and quality data were associated with surgical oncologic outcomes. The Nationwide Inpatient Sample was utilized to identify patients with solid tumors who underwent surgical resection in 2009 and 2010. The hospitals were linked to Hospital Compare, which collects data on patient satisfaction, perioperative quality, and 30-day mortality for medical conditions (pneumonia, myocardial infarction [MI], and congestive heart failure [CHF]). The risk-adjusted hospital-level rates of morbidity and mortality were calculated for each hospital and the means compared between the highest and lowest performing hospital quartiles and reported as absolute reduction in risk (ARR), the difference in risk of the outcome between the two groups. All statistical tests were two-sided. A total of 63197 patients treated at 448 hospitals were identified. For patients at high vs low performing hospitals based on Hospital Consumer Assessment of Healthcare Providers and Systems scores, the ARR in perioperative morbidity was 3.1% (95% confidence interval [CI] = 0.4% to 5.7%, P = .02). Similarly, the ARR for mortality based on the same measure was -0.4% (95% CI = -1.5% to 0.6%, P = .40). High performance on perioperative quality measures resulted in an ARR of 0% to 2.2% for perioperative morbidity (P > .05 for all). Similarly, there was no statistically significant association between hospital-level mortality rates for MI (ARR = 0.7%, 95% CI = -1.0% to 2.5%), heart failure (ARR = 1.0%, 95% CI = -0.6% to 2.7%), or pneumonia (ARR = 1.6%, 95% CI = -0.3% to 3.5%) and complications for oncologic surgery patients. Currently available measures of patient satisfaction and quality are poor predictors of outcomes for cancer patients undergoing surgery. Specific metrics for long-term oncologic outcomes and quality are needed.

Project description:BackgroundPrevious research internationally has only analyzed publicly available feedback on physician rating websites (PRWs). However, it appears that many PRWs are not publishing all the feedback they receive. Analysis of this rejected feedback could provide a better understanding of the types of feedback that are currently not published and whether this is appropriate.ObjectiveThe aim of this study was to examine (1) the number of patient feedback rejected from the Swiss PRW Medicosearch, (2) the evaluation tendencies of the rejected patient feedback, and (3) the types of issues raised in the rejected narrative comments.MethodsThe Swiss PRW Medicosearch provided all the feedback that had been rejected between September 16, 2008, and September 22, 2017. The feedback were analyzed and classified according to a theoretical categorization framework of physician-, staff-, and practice-related issues.ResultsBetween September 16, 2008, and September 22, 2017, Medicosearch rejected a total of 2352 patient feedback. The majority of feedback rejected (1754/2352, 74.6%) had narrative comments in the German language. However, 11.9% (279/2352) of the rejected feedback only provided a quantitative rating with no narrative comment. Overall, 25% (588/2352) of the rejected feedback were positive, 18.7% (440/2352) were neutral, and 56% (1316/2352) were negative. The average rating of the rejected feedback was 2.8 (SD 1.4). In total, 44 subcategories addressing the physician (n=20), staff (n=9), and practice (n=15) were identified. In total, 3804 distinct issues were identified within the 44 subcategories of the categorization framework; 75% (2854/3804) of the issues were related to the physician, 6.4% (242/3804) were related to the staff, and 18.6% (708/3804) were related to the practice. Frequently mentioned issues identified from the rejected feedback included (1) satisfaction with treatment (533/1903, 28%); (2) the overall assessment of the physician (392/1903, 20.6%); (3) recommending the physician (345/1903, 18.1%); (4) the physician's communication (261/1903, 13.7%); (5) the physician's caring attitude (220/1903, 11.6%); and (6) the physician's friendliness (203/1903, 10.6%).ConclusionsIt is unclear why the majority of the feedback were rejected. This is problematic and raises concerns that online patient feedback are being inappropriately manipulated. If online patient feedback is going to be collected, there needs to be clear policies and practices about how this is handled. It cannot be left to the whims of PRWs, who may have financial incentives to suppress negative feedback, to decide which feedback is or is not published online. Further research is needed to examine how many PRWs are using criteria for determining which feedback is published or not, what those criteria are, and what measures PRWs are using to address the manipulation of online patient feedback.

Dataset Information

The relationship between commercial website ratings and traditional hospital performance measures in the USA.

Publications

The relationship between commercial website ratings and traditional hospital performance measures in the USA.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets