Dataset Information

Can we quantify harm in general practice records? An assessment of precision and power using computer simulation.

ABSTRACT:

Background

Estimating harm rates for specific patient populations and detecting significant changes in them over time are essential if patient safety in general practice is to be improved. Clinical record review (CRR) is arguably the most suitable method for these purposes, but the optimal values and combinations of its parameters (such as numbers of records and practices) remain unknown. Our aims were to: 1. Determine and quantify CRR parameters; 2. Assess the precision and power of feasible CRR scenarios; and 3. Quantify the minimum requirements for adequate precision and acceptable power.

Method

We explored precision and power of CRR scenarios using Monte Carlo simulation. A range of parameter values were combined in 864 different CRR scenarios, with 1000 random data sets generated for each, and harm rates were estimated and tested for change over time by fitting a generalised linear model with a Poisson response.

Results

CRR scenarios with ≥ 100 detected harm incidents had harm rate estimates with acceptable precision. Harm reductions of 20% or ≥ 50% were detected with adequate power by those CRR scenarios with at least 100 and 500 harm incidents respectively. The number of detected harm incidents was dependent on the baseline harm rate multiplied by: the period of time reviewed in each record; number of records reviewed per practice; number of practices who reviewed records; and the number of times each record was reviewed.

Conclusion

We developed a simple formula to calculate the minimum values of CRR parameters required to achieve adequate precision and acceptable power when monitoring harm rates. Our findings have practical implications for health care decision-makers, leaders and researchers aiming to measure and reduce harm at regional or national level.

SUBMITTER: de Wet C

PROVIDER: S-EPMC3635932 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveLittle is known about differences in hospital harm (injury, suffering, disability, disease or death arising from hospital care) when people from rural and urban locations require hospital care. This study aimed to assess whether hospital harm risk differed by patients' rural or urban location using general practice data.DesignSecondary analysis of a 3-year retrospective cross-sectional general practice records review study, designed with equal numbers of rural and urban patients and patients from small, medium and large practices. Hospital admissions, interhospital transfer and hospital harm were identified.SettingNew Zealand (NZ) general practice clinical records including hospital discharge data.ParticipantsRandomly selected patient records from randomly selected general practices across NZ. Patient enrolment at rural and urban general practices defined patient location.OutcomesAdmission and harm risk and rate ratios by rural-urban location were investigated using multivariable analyses adjusted for age, sex, ethnicity, deprivation, practice size. Preventable hospital harm, harm severity and harm associated with interhospital transfer were analysed.ResultsOf 9076 patient records, 1561 patients (17%) experienced hospital admissions with no significant association between patient location and hospital admission (rural vs urban adjusted risk ratio (aRR) 0.98 (95% CI 0.83 to 1.17)). Of patients admitted to hospital, 172 (11%) experienced hospital harm. Rural location was not associated with increased hospital harm risk (aRR 1.01 (95% CI 0.97 to 1.05)) or rate of hospital harm per admission (adjusted incidence rate ratio 1.09 (95% CI 0.83 to 1.43)). Nearly half (45%) of hospital harms became apparent only after discharge. No urban patients required interhospital transfer, but 3% of rural patients did. Interhospital transfer was associated with over twice the risk of hospital harm (age-adjusted aRR 2.33 (95% CI 1.37 to 3.98), p=0.003).ConclusionsRural patient location was not associated with increased hospital harm. This provides reassurance for rural communities and health planners. The exception was patients needing interhospital transfer, where risk was more than doubled, warranting further research.

Project description:ObjectiveTo investigate how electronic templates shape, enable and constrain consultations about chronic diseases.DesignEthnographic case study, combining field notes, video-recording, screen capture with a microanalysis of talk, body language and data entry-an approach called linguistic ethnography.SettingTwo general practices in England.Participants and methodsEthnographic observation of administrative areas and 36 nurse-led consultations was done. Twenty-four consultations were directly observed and 12 consultations were video-recorded alongside computer screen capture. Consultations were transcribed using conversation analysis conventions, with notes on body language and the electronic record. The analysis involved repeated rounds of viewing video, annotating field notes, transcription and microanalysis to identify themes. The data was interpreted using discourse analysis, with attention to the sociotechnical theory.ResultsConsultations centred explicitly or implicitly on evidence-based protocols inscribed in templates. Templates did not simply identify tasks for completion, but contributed to defining what chronic diseases were, how care was being delivered and what it meant to be a patient or professional in this context. Patients' stories morphed into data bytes; the particular became generalised; the complex was made discrete, simple and manageable; and uncertainty became categorised and contained. Many consultations resembled bureaucratic encounters, primarily oriented to completing data fields. We identified a tension, sharpened by the template, between different framings of the patient-as 'individual' or as 'one of a population'. Some clinicians overcame this tension, responding creatively to prompts within a dialogue constructed around the patient's narrative.ConclusionsDespite their widespread implementation, little previous research has examined how templates are actually used in practice. Templates do not simply document the tasks of chronic disease management but profoundly change the nature of this work. Designed to assure standards of 'quality' care they contribute to bureaucratisation of care and may marginalise aspects of quality care which lie beyond their focus. Creative work is required to avoid privileging 'institution-centred' care over patient-centred care.

Project description:Computer reminders are increasingly being applied in efforts to improve quality and patient safety. However, research is still needed to establish the effectiveness of different kinds of reminders in various settings. This study aimed to evaluate the effectiveness of computer reminders for improving adherence to a quality assessment scheme for point-of-care testing in general practice.The study was conducted as a randomized controlled crossover trial among general practices in the Capital Region of Denmark. The intervention consisted of sending computer reminders (ComRem) to practices not adhering to the guideline recommendations of split testing for hemoglobin and glucose. Practices were randomly allocated into two groups. During the first follow-up period, one of the groups received the ComRem intervention together with the general implementation activities (GIA), while the other group only received the GIA. For the second follow-up period, the intervention was switched between the two groups. Outcomes were measured as split test procedure adherence.A total of 142 practices were randomly allocated to the early intervention group and 144 practices to the late intervention group (the control group in the first follow-up period). In the first intervention period, the mean number of split tests performed in the group receiving ComRem group increased from 1.22 to 3.76 (out of eight possible tests) while the mean number of split tests increased from 1.11 to 2.35 in the group targeted by GIA only (p = 0.0059). After the crossover, a similar effect of reminders was observed. Furthermore, the developments in outcome measures over time showed a strong effect of computer reminders beyond the intervention periods.There was a significant effect of computer reminders on adherence to the quality assessment scheme for point-of-care testing. Thus, computer reminders seem to be useful for supporting the implementation of relatively simple procedures for quality and safety.ClinicalTrials.gov: http://NCT01152177.

Project description:BackgroundRoutine weight recording in electronic health records (EHRs) could assist general practitioners (GPs) in the identification, prevention, and management of overweight patients. However, the extent to which weight management is embedded in general practice in the Netherlands has not been investigated. The purpose of this study was to evaluate the frequency of weight recording in general practice in the Netherlands for patients who self-reported as being overweight. The specific objectives of this study were to assess whether weight recording varied according to patient characteristics, and to determine the frequency of weight recording over time for patients with and without a chronic condition related to being overweight.MethodsBaseline data from the Occupational and Environmental Health Cohort Study (2012) were combined with data from EHRs of general practices (2012-2015). Data concerned 3446 self-reported overweight patients who visited their GP in 2012, and 1516 patients who visited their GP every year between 2012 and 2015. Logistic multilevel regression analyses were performed to identify associations between patient characteristics and weight recording.ResultsIn 2012, weight was recorded in the EHRs of a quarter of patients who self-reported as being overweight. Greater age, lower education level, higher self-reported body mass index, and the presence of diabetes mellitus, chronic obstructive pulmonary disease, and/or cardiovascular disorders were associated with higher rates of weight recording. The strongest association was found for diabetes mellitus (adjusted OR = 10.3; 95% CI [7.3, 14.5]). Between 2012 and 2015, 90% of patients with diabetes mellitus had at least one weight measurement recorded in their EHR. In the group of patients without a chronic condition related to being overweight, this percentage was 33%.ConclusionsWeight was frequently recorded for overweight patients with a chronic condition, for whom regular weight measurement is recommended in clinical guidelines, and for which weight recording is a performance indicator as part of the payment system. For younger patients and those without a chronic condition related to being overweight, weight was less frequently recorded. For these patients, routine recording of weight in EHRs deserves more attention, with the aim to support early recognition and treatment of overweight.

Project description:BackgroundMaking health care safer is a key policy priority worldwide. In specialty training, medical educators may unintentionally impact on patient safety e.g. through failures of supervision; providing limited feedback on performance; and letting poorly developed behaviours continue unchecked. Doctors-in-training are also known to be susceptible to medical error. Ensuring that all essential educational issues are addressed during training is problematic given the scale of the tasks to be undertaken. Human error and the reliability of local systems may increase the risk of safety-critical topics being inadequately covered. However adherence to a checklist reminder may improve the reliability of task delivery and maximise harm reduction. We aimed to prioritise the most safety-critical issues to be addressed in the first 12-weeks of specialty training in the general practice environment and validate a related checklist reminder.MethodsWe used mixed methods with different groups of GP educators (n=127) and specialty trainees (n=9) in two Scottish regions to prioritise, develop and validate checklist content. Generation and refinement of checklist themes and items were undertaken on an iterative basis using a range of methods including small group work in dedicated workshops; a modified-Delphi process; and telephone interviews. The relevance of potential checklist items was rated using a 4-point scale content validity index to inform final inclusion.Results14 themes (e.g. prescribing safely; dealing with medical emergency; implications of poor record keeping; and effective & safe communication) and 47 related items (e.g. how to safety-net face-to-face or over the telephone; knowledge of practice systems for results handling; recognition of harm in children) were judged to be essential safety-critical educational issues to be covered. The mean content validity index ratio was 0.98.ConclusionA checklist was developed and validated for educational supervisors to assist in the reliable delivery of safety-critical educational issues in the opening 12-week period of training, and aligned with national curriculum competencies. The tool can also be adapted for use as a self-assessment instrument by trainees to guide patient safety-related learning needs. Dissemination and implementation of the checklist and self-rating scale are proceeding on a national, voluntary basis with plans to evaluate its feasibility and educational impact.