Dataset Information

Estimating recruitment rates for routine use of patient reported outcome measures and the impact on provider comparisons.

ABSTRACT:

Background

The routine use of patient reported outcome measures (PROMs) aims to compare providers as regards the clinical need of their patients and their outcome. Simple methods of estimating recruitment rates based on aggregated data may be inaccurate. Our objectives were to: use patient-level linked data to evaluate these estimates; produce revised estimates of national and providers' recruitment rates; and explore whether or not recruitment bias exists.

Methods

Case study based on patients who were eligible to participate in the English National PROMs Programme for elective surgery (hip and knee replacement, groin hernia repair, varicose vein surgery) using data from pre-operative questionnaires and Hospital Episode Statistics. Data were linked to determine: the eligibility for including operations; eligibility of date of surgery; duplicate questionnaires; cancelled operations; correct assignment to provider. Influence of patient characteristics on recruitment rates were investigated.

Results

National recruitment rates based on aggregated data over-estimated the true rate because of the inclusion of ineligible operations (from 1.9% - 7.0% depending on operation) and operations being cancelled (1.9% - 3.6%). Estimates of national recruitment rates using inclusion criteria based on patient-level linked data were lower than those based on simple methods (eg hip replacement was 73% rather than 78%).Estimates of provider's recruitment rates based on aggregated data were also adversely affected by attributing patients to the wrong provider (2.4% - 4.9%). Use of linked data eliminated all estimates of over 100% recruitment, though providers still showed a wide range of rates.While the principal determinant of recruitment rates was the provider, some patients' socio-demographic characteristics had an influence on non-recruitment: non-white (Adjusted Odds Ratio 1.25-1.67, depending on operation); most deprived socio-economic group (OR 1.11-1.23); aged over 75 years (OR 1.28-1.79). However, there was no statistically significant association between providers' recruitment rates and patients' pre-operative clinical need.

Conclusions

Accurate recruitment rates require the use of linked data to establish consistent inclusion criteria for numerators and denominators. Non-recruitment will bias comparisons of providers' pre-operative case-mix and may bias comparisons of outcomes if unmeasured confounders are not evenly distributed between providers. It is important, therefore, to strive for high recruitment rates.

SUBMITTER: Hutchings A

PROVIDER: S-EPMC3923248 | biostudies-literature | 2014 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Estimating recruitment rates for routine use of patient reported outcome measures and the impact on provider comparisons.

Hutchings Andrew A Neuburger Jenny J van der Meulen Jan J Black Nick N

BMC health services research 20140211

<h4>Background</h4>The routine use of patient reported outcome measures (PROMs) aims to compare providers as regards the clinical need of their patients and their outcome. Simple methods of estimating recruitment rates based on aggregated data may be inaccurate. Our objectives were to: use patient-level linked data to evaluate these estimates; produce revised estimates of national and providers' recruitment rates; and explore whether or not recruitment bias exists.<h4>Methods</h4>Case study base ...[more]

PMID: 24511984

Similar Datasets

Project description:Background/objectivesRoutine use of patient-reported outcome measures (PROMs) to assess quality of health care systems is mandated in many countries and has been implemented successfully in many specialities. Ophthalmology currently lags behind. To support and inform future implementation, we investigated paediatric ophthalmic clinicians' experience of, and future training needs for, using child-appropriate vision PROMs and their views about the barriers and enablers to future routine implementation in clinical practice.MethodsWe conducted a pilot study, using an online survey to elicit the experience, attitudes, training needs and perceptions of barriers and enablers to routine PROMs use of ophthalmic health professionals in the Paediatric Ophthalmology Department at Great Ormond Street Hospital, London. A focus-group was undertaken to discuss survey results and preferences regarding presentation of PROM data. Analysis comprised descriptive statistics, presented alongside complementary qualitative data.ResultsEighteen clinicians in the department completed the survey. Twenty-seven took part in the focus group. Clinicians had limited experience of using PROMs but high confidence in the potential positive impact on communication with patients, monitoring chronic conditions and clinical decision-making. Clinicians identified operational issues (collection and analysis of data) and impact (interpretation and application of data) as the two key areas for consideration. Training and information requirements before implementation were clearly articulated, alongside the benefits of using digital/electronic data capture ahead of consultations to allow efficiency and automated analysis, and presentation in an appropriate visual format alongside clinical data to ensure meaningful use.ConclusionThe findings of this pilot study of ophthalmic clinicians working in a specialist paediatric ophthalmology department, suggest that ophthalmic clinicians recognise the potential benefits of routine PROMs use in clinical practice. Together with existing literature outside ophthalmology relating to overcoming barriers and exploiting enablers to routine implementation, findings may be applicable in planning routine PROM implementation in paediatric ophthalmology.

Project description:BACKGROUND:Retinoblastoma is a childhood retinal cancer with lifelong consequences such as vision loss and increased risk of second cancer. Patient-reported outcome measures (PROMs) are instruments that measure outcomes related to health directly reported by patients. The purpose of this study was to determine the scope, characteristics and quality of PROMs used in retinoblastoma and related fields of pediatric ophthalmology and pediatric oncology. METHODS:Databases MEDLINE and Embase were searched for studies in the English language that reported on PROMs used in retinoblastoma, pediatric oncology, or pediatric ophthalmology; grey literature and studies reporting on developmental PROM phases were excluded. PROMs were grouped by the construct measured and domains assessed, and classified as condition-specific or generic. A subsequent search was then conducted in MEDLINE and Embase for studies assessing measurement properties of the identified PROMs. PROMs with associated studies were assessed for their methodologic quality using the COnsensus-based standard for the Selection of health Measurement INstruments (COSMIN) strategy. RESULTS:Among 110 eligible studies uncovered by the database searches, 143 PROMs were identified: one retinoblastoma-specific, 56 ophthalmology- and 86 oncology-related. The most common construct measured was 'health-related quality of life' and the most common domain assessed was emotional well-being. Of the 143 PROMs, 100 had associated validation studies; the one retinoblastoma-specific PROM was not validated. Quality assessment revealed 34/100 PROMs received a score of sufficient quality in both subcategories of 'overall content validity'; 3/100 received a score of sufficient quality in both subcategories of 'internal structure'; 0/100 received a score of sufficient quality in all three subcategories of 'remaining measurement properties'. The Patient-Reported Outcome Measure Information System (PROMIS) Pediatric Profile-25 was the highest-scoring PROM identified, meeting COSMIN standards for 2/3 measurement property categories (and 5/7 subcategories). Eleven additional PROMs were identified which had sufficient scores in 1/3 measurement property categories (and 5/7 subcategories). CONCLUSION:The study identified several PROMs from the pediatric ophthalmology and pediatric oncology literature that could be relevant to the retinoblastoma population, but many have limits to their validation. Future development of a retinoblastoma-specific PROM, performed in partnership with retinoblastoma patients to support optimal content validity, could first focus on the selection and definition of the optimal construct to measure, followed potentially by adaptation and further validation of the relevant PROMs with strong methodologic quality identified in this study.

Project description:BackgroundObtaining patients' views of their health and outcomes of interventions utilising patient-reported outcome measures (PROMs) is a well-established method, but there is still uncertainty about the impact of PROMs on services and patient care. Studies are now needed of alternative ways of implementing PROMs. This paper describes a case study of the introduction of a new PROM to assess musculoskeletal (MSK) problems, known as the Musculoskeletal Health Questionnaire (MSK-HQ).MethodsFollowing an invitation from the Arthritis Research UK (ARUK), 11 groups and organisations agreed to become 'partners' in piloting the MSK-HQ. Twenty-nine interviews and a focus group were carried out with key informants from the partners. Interviews were supplemented with some documentary evidence of partners' meetings. Data were coded and analysed with NVivo software V.10. Analysis was carried out via a framework method.ResultsParticipants reported positive evidence that the MSK-HQ is feasible and practical for use in patient care with content that helped health professionals identify and address patients' main presenting problems. Although mediated and reported through health professionals' judgments, the questionnaire was also seen as very relevant and acceptable to a wide spectrum of patients.There was also broad support for the view that whilst the MSK-HQ is relevant to individual patient care, it could also, when aggregated, reflect the experiences of patients as a group and be used as evidence for third parties concerned with the provision and commissioning of services.The main difficulties revealed by the case study were in the form of logistics and sustainability. It was recognised that electronic systems would be more effective for administration and data processing but they were not feasible to develop and implement within reasonable timelines and available budgets. A sustainable approach to using the PROM required significant long-term commitment of budget, a coherent system, and active support from diverse organisations.ConclusionsThe current study supports the view that a bottom-up approach is a promising method to generate PROM-related insights that are relevant to patients and health professionals. The partnership approach to developing and using PROMs may have wider relevance and potential as a model of implementation.

Dataset Information

Estimating recruitment rates for routine use of patient reported outcome measures and the impact on provider comparisons.

Background

Methods

Results

Conclusions

Publications

Estimating recruitment rates for routine use of patient reported outcome measures and the impact on provider comparisons.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets