Dataset Information

Insightful practice: a reliable measure for medical revalidation.

ABSTRACT:

Background

Medical revalidation decisions need to be reliable if they are to reassure on the quality and safety of professional practice. This study tested an innovative method in which general practitioners (GPs) were assessed on their reflection and response to a set of externally specified feedback.

Setting and participants

60 GPs and 12 GP appraisers in the Tayside region of Scotland, UK.

Methods

A feedback dataset was specified as (1) GP-specific data collected by GPs themselves (patient and colleague opinion; open book self-evaluated knowledge test; complaints) and (2) Externally collected practice-level data provided to GPs (clinical quality and prescribing safety). GPs' perceptions of whether the feedback covered UK General Medical Council specified attributes of a 'good doctor' were examined using a mapping exercise. GPs' professionalism was examined in terms of appraiser assessment of GPs' level of insightful practice, defined as: engagement with, insight into and appropriate action on feedback data. The reliability of assessment of insightful practice and subsequent recommendations on GPs' revalidation by face-to-face and anonymous assessors were investigated using Generalisability G-theory.

Main outcome measures

Coverage of General Medical Council attributes by specified feedback and reliability of assessor recommendations on doctors' suitability for revalidation.

Results

Face-to-face assessment proved unreliable. Anonymous global assessment by three appraisers of insightful practice was highly reliable (G=0.85), as were revalidation decisions using four anonymous assessors (G=0.83).

Conclusions

Unlike face-to-face appraisal, anonymous assessment of insightful practice offers a valid and reliable method to decide GP revalidation. Further validity studies are needed.

SUBMITTER: Murphy DJ

PROVIDER: S-EPMC3404544 | biostudies-literature | 2012 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Insightful practice: a reliable measure for medical revalidation.

Murphy Douglas J DJ Guthrie Bruce B Sullivan Frank M FM Mercer Stewart W SW Russell Andrew A Bruce David A DA

BMJ quality & safety 20120531 8

<h4>Background</h4>Medical revalidation decisions need to be reliable if they are to reassure on the quality and safety of professional practice. This study tested an innovative method in which general practitioners (GPs) were assessed on their reflection and response to a set of externally specified feedback.<h4>Setting and participants</h4>60 GPs and 12 GP appraisers in the Tayside region of Scotland, UK.<h4>Methods</h4>A feedback dataset was specified as (1) GP-specific data collected by GPs ...[more]

PMID: 22653078

Similar Datasets

Project description:BackgroundIn 2012, the UK introduced medical revalidation, whereby to retain their licence all doctors are required to show periodically that they are up to date and fit to practise medicine. Early reports suggested that some doctors found the process overly onerous and chose to leave practice. This study investigates the effect of medical revalidation on the rate at which consultants (senior hospital doctors) leave NHS practice, and assesses any differences between the performance of consultants who left or remained in practice before and after the introduction of revalidation.MethodsWe used a retrospective cohort of administrative data from the Hospital Episode Statistics database on all consultants who were working in English NHS hospitals between April 2008 and March 2009 (n = 19,334), followed to March 2015. Proportional hazard models were used to identify the effect of medical revalidation on the time to exit from the NHS workforce, as implied by ceasing NHS clinical activity. The main exposure variable was consultants' time-varying revalidation status, which differentiates between periods when consultants were (a) not subject to revalidation-before the policy was introduced, (b) awaiting a revalidation recommendation and (c) had received a positive recommendation to be revalidated. Difference-in-differences analysis was used to compare the performance of those who left practice with those who remained in practice before and after the introduction of revalidation, as proxied by case-mix-adjusted 30-day mortality rates.ResultsAfter 2012, consultants who had not yet revalidated were at an increased hazard of ceasing NHS clinical practice (HR 2.33, 95% CI 2.12 to 2.57) compared with pre-policy levels. This higher risk remained after a positive recommendation (HR 1.85, 95% CI 1.65 to 2.06) but was statistically significantly reduced (p < 0.001). We found no statistically significant differences in mortality rates between those consultants who ceased practice and those who remained, after adjustment for multiple testing.ConclusionRevalidation appears to have led to greater numbers of doctors ceasing clinical practice, over and above other contemporaneous influences. Those ceasing clinical practice do not appear to have provided lower quality care, as approximated by mortality rates, when compared with those remaining in practice.

Project description:ObjectivesThe Menstrual Practice Needs Scale (MPNS) is a comprehensive measure of menstrual self-care experience including access to sufficient, comfortable materials to catch or absorb bleeding, supportive spaces for managing menstruation and for disposal and laundering of used materials. It addresses a critical measurement gap to improve quantitative menstrual health research and programme evaluation. The scale was validated in a population of adolescent schoolgirls. This study appraises its performance among adult women.DesignCross-sectional survey.Setting and participantsSeven cognitive interviews provided insights into the interpretability of scale items. A survey of 525 working women who had menstruated in the past 6 months (435 working in markets, 45 in schools and 45 working in healthcare facilities) in Mukono District, Uganda was used to test the dimensionality, reliability and validity of the measure.ResultsThe 36 scale items were well understood by the study population. Dimensionality was tested for the 28 items relevant to women disposing of menstrual materials and 32 items relevant to those washing and reusing materials. The original subscale structure fit with the data, however, fell short of recommended thresholds for those disposing of materials (root mean squared error of approximation, RMSEA=0.069; Comparative Fit Index, CFI=0.840; Trucker-Lewis Index, TLI=0.824). An alternative subscale structure was an acceptable fit for those disposing (RMSEA=0.051; CFI=0.911; TLI=0.897) and reusing materials (RMSEA=0.053; CFI=0.915; TLI=0.904). MPNS total and subscale scores demonstrated acceptable internal consistency. Higher scores reflected more positive menstrual experiences and were associated with well-being (total score r=0.24, p<0.001), not missing work due to the last menstrual period (total score OR=2.47 95% CI 1.42 to 4.30) and confidence to manage menstruation.ConclusionsThe MPNS offers a valid and reliable way to assess menstrual health needs. The revised factor structure can be used for samples of adult workers. Findings also highlight challenges in assessing the variety of experiences relevant to managing menstrual bleeding.

Project description:PURPOSE: To determine current knowledge and opinion on revalidation, and methods of cataract surgery audit in Scotland and to outline the current and future possibilities for electronic cataract surgery audit. METHODS: In 2010 we conducted a prospective, cross-sectional, Scottish-wide survey on revalidation knowledge and opinion, and cataract audit practice among all senior NHS ophthalmologists. Results were anonymised and recorded manually for analysis. RESULTS: In all, 61% of the ophthalmologists surveyed took part. Only 33% felt ready to take part in revalidation, whereas 76% felt they did not have adequate information about the process. Also, 71% did not feel revalidation would improve patient care, but 85% agreed that cataract surgery audit is essential for ophthalmic practice. In addition, 91% audit their cataract outcomes; 52% do so continuously. Further, 63% audit their subspecialist surgical results. Only 25% audit their cataract surgery practice electronically, and only 12% collect clinical data using a hospital PAS system. Funding and system incompatibility were the main reasons cited for the lack of electronic audit setup. Currently, eight separate hospital IT patient administration systems are used across 14 health boards in Scotland. CONCLUSION: Revalidation is set to commence in 2012. The Royal College of Ophthalmologists will use cataract outcome audit as a tool to ensure surgical competency for the process. Retrospective manual auditing of cataract outcome is time consuming, and can be avoided with an electronic system. Scottish ophthalmologists view revalidation with scepticism and appear to have inadequate knowledge of the process. However, they strongly agree with the concept of cataract surgery audit. The existing and future electronic applications that may support surgical audit are commercial electronic records, web-based applications, centrally funded software applications, and robust NHS connections between community and hospital.

Project description:BackgroundFrailty remains an elusive concept despite many efforts to define and measure it. The difficulty in translating the clinical profile of frail elderly people into a quantifiable assessment tool is due to the complex and heterogeneous nature of their health problems. Viewing frailty as a 'latent vulnerability' in older people this study aims to derive a model based measurement of frailty and examines its internal reliability in community dwelling elderly.MethodThe British Women's Heart and Health Study (BWHHS) cohort of 4286 women aged 60-79 years from 23 towns in Britain provided 35 frailty indicators expressed as binary categorical variables. These indicators were corrected for measurement error and assigned relative weights in its association with frailty. Exploratory factor analysis (EFA) reduced the data to a smaller number of factors and was subjected to confirmatory factor analysis (CFA) which restricted the model by fitting the EFA-driven structure to observed data. Cox regression analysis compared the hazard ratios for adverse outcomes of the newly developed British frailty index (FI) with a widely known FI. This process was replicated in the MRC Assessment study of older people, a larger cohort drawn from 106 general practices in Britain.ResultsSeven factors explained the association between frailty indicators: physical ability, cardiac symptoms/disease, respiratory symptoms/disease, physiological measures, psychological problems, co-morbidities and visual impairment. Based on existing concepts and statistical indices of fit, frailty was best described using a General Specific Model. The British FI would serve as a better population metric than the FI as it enables people with varying degrees of frailty to be better distinguished over a wider range of scores. The British FI was a better independent predictor of all-cause mortality, hospitalization and institutionalization than the FI in both cohorts.ConclusionsFrailty is a multidimensional concept represented by a wide range of latent (not directly observed) attributes. This new measure provides more precise information than is currently recognized, of which cluster of frailty indicators are important in older people. This study could potentially improve quality of life among older people through targeted efforts in early prevention and treatment of frailty.

Dataset Information

Insightful practice: a reliable measure for medical revalidation.

Background

Setting and participants

Methods

Main outcome measures

Results

Conclusions

Publications

Insightful practice: a reliable measure for medical revalidation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets