Dataset Information

The Healthcare Complaints Analysis Tool: development and reliability testing of a method for service monitoring and organisational learning.

ABSTRACT:

Background

Letters of complaint written by patients and their advocates reporting poor healthcare experiences represent an under-used data source. The lack of a method for extracting reliable data from these heterogeneous letters hinders their use for monitoring and learning. To address this gap, we report on the development and reliability testing of the Healthcare Complaints Analysis Tool (HCAT).

Methods

HCAT was developed from a taxonomy of healthcare complaints reported in a previously published systematic review. It introduces the novel idea that complaints should be analysed in terms of severity. Recruiting three groups of educated lay participants (n=58, n=58, n=55), we refined the taxonomy through three iterations of discriminant content validity testing. We then supplemented this refined taxonomy with explicit coding procedures for seven problem categories (each with four levels of severity), stage of care and harm. These combined elements were further refined through iterative coding of a UK national sample of healthcare complaints (n= 25, n=80, n=137, n=839). To assess reliability and accuracy for the resultant tool, 14 educated lay participants coded a referent sample of 125 healthcare complaints.

Results

The seven HCAT problem categories (quality, safety, environment, institutional processes, listening, communication, and respect and patient rights) were found to be conceptually distinct. On average, raters identified 1.94 problems (SD=0.26) per complaint letter. Coders exhibited substantial reliability in identifying problems at four levels of severity; moderate and substantial reliability in identifying stages of care (except for 'discharge/transfer' that was only fairly reliable) and substantial reliability in identifying overall harm.

Conclusions

HCAT is not only the first reliable tool for coding complaints, it is the first tool to measure the severity of complaints. It facilitates service monitoring and organisational learning and it enables future research examining whether healthcare complaints are a leading indicator of poor service outcomes. HCAT is freely available to download and use.

SUBMITTER: Gillespie A

PROVIDER: S-EPMC5256238 | biostudies-literature | 2016 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The Healthcare Complaints Analysis Tool: development and reliability testing of a method for service monitoring and organisational learning.

Gillespie Alex A Reader Tom W TW

BMJ quality & safety 20160106 12

<h4>Background</h4>Letters of complaint written by patients and their advocates reporting poor healthcare experiences represent an under-used data source. The lack of a method for extracting reliable data from these heterogeneous letters hinders their use for monitoring and learning. To address this gap, we report on the development and reliability testing of the Healthcare Complaints Analysis Tool (HCAT).<h4>Methods</h4>HCAT was developed from a taxonomy of healthcare complaints reported in a p ...[more]

PMID: 26740496

Similar Datasets

Project description:BackgroundUniversal Health coverage (UHC) is the mantra of the twenty-first century yet knowing when it has been achieved or how to best influence its progression remains elusive. An innovative framework for High Performing Healthcare (HPHC) attempts to address these issues. It focuses on measuring four constructs of Accountable, Affordable, Accessible, and Reliable (AAAR) healthcare that contribute to better health outcomes and impact. The HPHC tool collects information on the perceived functionality of health system processes and provides real-time data analysis on the AAAR constructs, and on processes for health system resilience, responsiveness, and quality, that include roles of community, private sector, as well as both demand, and supply factors affecting health system performance. The tool attempts to capture the multidimensionality of UHC measurement and evidence that links health system strengthening activities to outcomes. This paper provides evidence on the reliability and validity of the tool.MethodsInternet survey with non-probability sampling was used for testing reliability and validity of the HPHC tool. The volunteers were recruited using international networks and listservs. Two hundred and thirteen people from public, private, civil society and international organizations volunteered from 35 low-and-middle-income countries. Analyses involved testing reliability and validity and validation from other international sources of information as well as applicability in different setting and contexts.ResultsThe HPHC tool's AAAR constructs, and their sub-domains showed high internal consistency (Cronbach alpha >.80) and construct validity. The tool scores normal distribution displayed variations among respondents. In addition, the tool demonstrated its precision and relevance in different contexts/countries. The triangulation of HPHC findings with other international data sources further confirmed the tool's validity.ConclusionsBesides being reliable and valid, the HPHC tool adds value to the state of health system measurement by focusing on linkages between AAAR processes and health outcomes. It ensures that health system stakeholders take responsibility and are accountable for better system performance, and the community is empowered to participate in decision-making process. The HPHC tool collects and analyzes data in real time with minimum costs, supports monitoring, and promotes adaptive management, policy, and program development for better health outcomes.

Project description:Bus services naturally tend to be unstable and are not always capable of adhering to schedules without control strategies. Therefore, bus users and bus service providers face travel time variation and irregularity. After a comprehensive review of the literature, a significant gap was recognized in the field of public transportation reliability. According to literature, there is no consistency in reliability definition and indicators. Companies have their own definition of bus service reliability, and they mostly neglect the passengers' perspective of reliability. Therefore, four reliability indicators were selected in this study to fill the gap in the literature and cover both passengers' and operators' perceptions of reliability: waiting time and on-board crowding level from passengers' perspective, and headway regularity index at stops (HRIS) and bus bunching/big gap percentage from operators' perspective. The primary objective of this research is to improve the reliability of high frequency of bus service and simulation tools currently being used by the public transportation companies. Therefore, a simulation model of bus service was developed to study the strategies to alleviate it. Four different types of strategies were selected and implemented according to Route U32 (Kuala Lumpur) specifications. Model out-put showed that control strategies such as headway-based dispatching could significantly improve headway regularity by almost 62% and the waiting time by 51% on average. Both holding strategies at key stops (previous and Prefol holding) have shown an almost similar impact on reliability indicators. Waiting time was reduced by 44% and 43% after the previous and Prefol Headway strategies were adopted, respectively. However, the implementation of the component of headway-based strategies at the terminal and key stops showed the best impact on reliability, in terms of passenger waiting time. Waiting time and excess waiting time were both significantly reduced by 52.86% and 81.44%, respectively. Nevertheless, the strategies did not show any significant positive effect on the level of crowding during morning peak hours.

Dataset Information

The Healthcare Complaints Analysis Tool: development and reliability testing of a method for service monitoring and organisational learning.

Background

Methods

Results

Conclusions

Publications

The Healthcare Complaints Analysis Tool: development and reliability testing of a method for service monitoring and organisational learning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets