Dataset Information

Variation in methods, results and reporting in electronic health record-based studies evaluating routine care in gout: A systematic review.

ABSTRACT: OBJECTIVE:To perform a systematic review examining the variation in methods, results, reporting and risk of bias in electronic health record (EHR)-based studies evaluating management of a common musculoskeletal disease, gout. METHODS:Two reviewers systematically searched MEDLINE, Scopus, Web of Science, CINAHL, PubMed, EMBASE and Google Scholar for all EHR-based studies published by February 2019 investigating gout pharmacological treatment. Information was extracted on study design, eligibility criteria, definitions, medication usage, effectiveness and safety data, comprehensiveness of reporting (RECORD), and Cochrane risk of bias (registered PROSPERO CRD42017065195). RESULTS:We screened 5,603 titles/abstracts, 613 full-texts and selected 75 studies including 1.9M gout patients. Gout diagnosis was defined in 26 ways across the studies, most commonly using a single diagnostic code (n = 31, 41.3%). 48.4% did not specify a disease-free period before 'incident' diagnosis. Medication use was suboptimal and varied with disease definition while results regarding effectiveness and safety were broadly similar across studies despite variability in inclusion criteria. Comprehensiveness of reporting was variable, ranging from 73% (55/75) appropriately discussing the limitations of EHR data use, to 5% (4/75) reporting on key data cleaning steps. Risk of bias was generally low. CONCLUSION:The wide variation in case definitions and medication-related analysis among EHR-based studies has implications for reported medication use. This is amplified by variable reporting comprehensiveness and the limited consideration of EHR-relevant biases (e.g. data adequacy) in study assessment tools. We recommend accounting for these biases and performing a sensitivity analysis on case definitions, and suggest changes to assessment tools to foster this.

SUBMITTER: Crossfield SSR

PROVIDER: S-EPMC6812805 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Variation in methods, results and reporting in electronic health record-based studies evaluating routine care in gout: A systematic review.

Crossfield Samantha S R SSR Lai Lana Yin Hui LYH Kingsbury Sarah R SR Baxter Paul P Johnson Owen O Conaghan Philip G PG Pujades-Rodriguez Mar M

PloS one 20191024 10

<h4>Objective</h4>To perform a systematic review examining the variation in methods, results, reporting and risk of bias in electronic health record (EHR)-based studies evaluating management of a common musculoskeletal disease, gout.<h4>Methods</h4>Two reviewers systematically searched MEDLINE, Scopus, Web of Science, CINAHL, PubMed, EMBASE and Google Scholar for all EHR-based studies published by February 2019 investigating gout pharmacological treatment. Information was extracted on study desi ...[more]

PMID: 31648282

Similar Datasets

Project description:OBJECTIVE:Analysis of routinely collected electronic health record (EHR) data from primary care is reliant on the creation of codelists to define clinical features of interest. To improve scientific rigour, transparency and replicability, we describe and demonstrate a standardised reproducible methodology for clinical codelist development. DESIGN:We describe a three-stage process for developing clinical codelists. First, the clear definition a priori of the clinical feature of interest using reliable clinical resources. Second, development of a list of potential codes using statistical software to comprehensively search all available codes. Third, a modified Delphi process to reach consensus between primary care practitioners on the most relevant codes, including the generation of an 'uncertainty' variable to allow sensitivity analysis. SETTING:These methods are illustrated by developing a codelist for shortness of breath in a primary care EHR sample, including modifiable syntax for commonly used statistical software. PARTICIPANTS:The codelist was used to estimate the frequency of shortness of breath in a cohort of 28?216 patients aged over 18 years who received an incident diagnosis of lung cancer between 1 January 2000 and 30 November 2016 in the Clinical Practice Research Datalink (CPRD). RESULTS:Of 78 candidate codes, 29 were excluded as inappropriate. Complete agreement was reached for 44 (90%) of the remaining codes, with partial disagreement over 5 (10%). 13?091 episodes of shortness of breath were identified in the cohort of 28?216 patients. Sensitivity analysis demonstrates that codes with the greatest uncertainty tend to be rarely used in clinical practice. CONCLUSIONS:Although initially time consuming, using a rigorous and reproducible method for codelist generation 'future-proofs' findings and an auditable, modifiable syntax for codelist generation enables sharing and replication of EHR studies. Published codelists should be badged by quality and report the methods of codelist generation including: definitions and justifications associated with each codelist; the syntax or search method; the number of candidate codes identified; and the categorisation of codes after Delphi review.

Project description:ObjectiveRoutinely collected health data, collected for administrative and clinical purposes, without specific a priori research questions, are increasingly used for observational, comparative effectiveness, health services research, and clinical trials. The rapid evolution and availability of routinely collected data for research has brought to light specific issues not addressed by existing reporting guidelines. The aim of the present project was to determine the priorities of stakeholders in order to guide the development of the REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement.MethodsTwo modified electronic Delphi surveys were sent to stakeholders. The first determined themes deemed important to include in the RECORD statement, and was analyzed using qualitative methods. The second determined quantitative prioritization of the themes based on categorization of manuscript headings. The surveys were followed by a meeting of RECORD working committee, and re-engagement with stakeholders via an online commentary period.ResultsThe qualitative survey (76 responses of 123 surveys sent) generated 10 overarching themes and 13 themes derived from existing STROBE categories. Highest-rated overall items for inclusion were: Disease/exposure identification algorithms; Characteristics of the population included in databases; and Characteristics of the data. In the quantitative survey (71 responses of 135 sent), the importance assigned to each of the compiled themes varied depending on the manuscript section to which they were assigned. Following the working committee meeting, online ranking by stakeholders provided feedback and resulted in revision of the final checklist.ConclusionsThe RECORD statement incorporated the suggestions provided by a large, diverse group of stakeholders to create a reporting checklist specific to observational research using routinely collected health data. Our findings point to unique aspects of studies conducted with routinely collected health data and the perceived need for better reporting of methodological issues.

Project description:Backgroundfrailty is an especially problematic expression of population ageing. International guidelines recommend routine identification of frailty to provide evidence-based treatment, but currently available tools require additional resource.Objectivesto develop and validate an electronic frailty index (eFI) using routinely available primary care electronic health record data.Study design and settingretrospective cohort study. Development and internal validation cohorts were established using a randomly split sample of the ResearchOne primary care database. External validation cohort established using THIN database.Participantspatients aged 65-95, registered with a ResearchOne or THIN practice on 14 October 2008.Predictorswe constructed the eFI using the cumulative deficit frailty model as our theoretical framework. The eFI score is calculated by the presence or absence of individual deficits as a proportion of the total possible. Categories of fit, mild, moderate and severe frailty were defined using population quartiles.Outcomesoutcomes were 1-, 3- and 5-year mortality, hospitalisation and nursing home admission.Statistical analysishazard ratios (HRs) were estimated using bivariate and multivariate Cox regression analyses. Discrimination was assessed using receiver operating characteristic (ROC) curves. Calibration was assessed using pseudo-R(2) estimates.Resultswe include data from a total of 931,541 patients. The eFI incorporates 36 deficits constructed using 2,171 CTV3 codes. One-year adjusted HR for mortality was 1.92 (95% CI 1.81-2.04) for mild frailty, 3.10 (95% CI 2.91-3.31) for moderate frailty and 4.52 (95% CI 4.16-4.91) for severe frailty. Corresponding estimates for hospitalisation were 1.93 (95% CI 1.86-2.01), 3.04 (95% CI 2.90-3.19) and 4.73 (95% CI 4.43-5.06) and for nursing home admission were 1.89 (95% CI 1.63-2.15), 3.19 (95% CI 2.73-3.73) and 4.76 (95% CI 3.92-5.77), with good to moderate discrimination but low calibration estimates.Conclusionsthe eFI uses routine data to identify older people with mild, moderate and severe frailty, with robust predictive validity for outcomes of mortality, hospitalisation and nursing home admission. Routine implementation of the eFI could enable delivery of evidence-based interventions to improve outcomes for this vulnerable group.

Project description:ImportanceDespite billions spent in public investment, electronic health records (EHRs) have not delivered on the promise of large quality and safety improvement. Simultaneously, there is debate on whether public quality reporting is a useful tool to incentivize quality improvement.ObjectiveTo evaluate whether publicly reported feedback was associated with hospital improvement in an evaluation of medication-related clinical decision support (CDS) safety performance.Design, settings, and participantsThis nonrandomized controlled trial included US hospitals that participated in the Computerized Provider Order Entry (CPOE) Evaluation Tool in the Leapfrog Hospital Survey, a national quality reporting program that evaluates safety performance of hospital CDS using simulated orders and patients, in 2017 to 2018. A sharp regression discontinuity design was used to identify the association of receiving negative feedback with hospital performance improvement in the subsequent year. Data were analyzed from January through September 2020.ExposuresPublicly reported quality feedback.Main outcomes and measuresThe main outcome was improvement from 2017 to 2018 on the Leapfrog CPOE Evaluation Tool, using regression discontinuity model estimates of the association of receiving negative publicly reported feedback with quality improvement.ResultsA total of 1183 hospitals were included, with a mean (SD) CPOE score of 59.3% (16.3%) at baseline. Hospitals receiving negative feedback improved 8.44 (95% CI, 0.09 to 16.80) percentage points more in the subsequent year compared with hospitals that received positive feedback on the same evaluation. This change was driven by differences in improvement in basic CDS capabilities (β = 8.71 [95%CI, 1.67 to 18.73]) rather than advanced CDS (β = 6.15 [95% CI, -9.11 to 26.83]).Conclusions and relevanceIn this nonrandomized controlled trial, publicly reported feedback was associated with quality improvement, suggesting targeted measurement and reporting of process quality may be an effective policy lever to encourage improvement in specific areas. Clinical decision support represents an important tool in ensuring patient safety and decreasing adverse drug events, especially for complex patients and those with multiple chronic conditions who often receive several different drugs during an episode of care.

Project description:To compare three groupings of Electronic Health Record (EHR) billing codes for their ability to represent clinically meaningful phenotypes and to replicate known genetic associations. The three tested coding systems were the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes, the Agency for Healthcare Research and Quality Clinical Classification Software for ICD-9-CM (CCS), and manually curated "phecodes" designed to facilitate phenome-wide association studies (PheWAS) in EHRs.We selected 100 disease phenotypes and compared the ability of each coding system to accurately represent them without performing additional groupings. The 100 phenotypes included 25 randomly-chosen clinical phenotypes pursued in prior genome-wide association studies (GWAS) and another 75 common disease phenotypes mentioned across free-text problem lists from 189,289 individuals. We then evaluated the performance of each coding system to replicate known associations for 440 SNP-phenotype pairs.Out of the 100 tested clinical phenotypes, phecodes exactly matched 83, compared to 53 for ICD-9-CM and 32 for CCS. ICD-9-CM codes were typically too detailed (requiring custom groupings) while CCS codes were often not granular enough. Among 440 tested known SNP-phenotype associations, use of phecodes replicated 153 SNP-phenotype pairs compared to 143 for ICD-9-CM and 139 for CCS. Phecodes also generally produced stronger odds ratios and lower p-values for known associations than ICD-9-CM and CCS. Finally, evaluation of several SNPs via PheWAS identified novel potential signals, some seen in only using the phecode approach. Among them, rs7318369 in PEPD was associated with gastrointestinal hemorrhage.Our results suggest that the phecode groupings better align with clinical diseases mentioned in clinical practice or for genomic studies. ICD-9-CM, CCS, and phecode groupings all worked for PheWAS-type studies, though the phecode groupings produced superior results.

Project description:BackgroundElectronic medical records (EMRs) have been used for nearly three decades. Pharmacists use EMRs on a daily basis, but EMRs have only recently been incorporated into pharmacy education. Some pharmacy programs have implemented teaching electronic medical records (tEMRs), but best practices for incorporating tEMRs into pharmacy education remain unknown. The objectives of this study were to 1) assess pharmacy students' views and experiences with a tEMR; and 2) identify current learning activities and future priorities for tEMR use in pharmacy education.MethodsWe used a mixed-methods approach, including three, two-hour student focus groups and a 42-item web-based survey to examine student perspectives of the tEMR. All first, second, and third year professional pharmacy students were eligible to participate in the survey and a focus group. Web-based survey items were measured on a 7-point Likert scale, and quantitative analyses included descriptive statistics. Two researchers independently coded transcripts using both deductive and inductive approaches to identify emergent themes. These analysts met and resolved any coding discrepancies via consensus.ResultsFocus groups were conducted with 22 total students, with 6-8 students represented from each year of pharmacy training. The survey was completed by 156 students: 47 first year, 55 second year, and 54 third year. Overall, 48.7% of survey respondents altogether agreed or strongly agreed that using the tEMR enhanced their learning in pharmacy classes and laboratories. Qualitative data were organized into four major themes regarding tEMR adoption: current priorities for use within the pharmacy curriculum; tEMR benefits; tEMR barriers; and future priorities for tEMR use to prepare students for pharmacy practice.ConclusionsThis study reveals pharmacy students' perspectives and attitudes towards using a tEMR, the types of classroom activities that incorporate the tEMR, and students' future suggestions to enhance the design or application of the tEMR for their learning. Our research findings may aid other pharmacy programs and promote more effective use of tEMRs in pharmacy education. In the long-term, this study may strengthen pharmacy education on EMRs and thus increase the efficacy and safety of pharmacists' EMR use for patients' medication management.

Project description:Background/aimsElectronic-based recruitment methods are increasingly utilized in clinical trials to recruit and enroll research participants. The cost-effectiveness of electronic-based methods and impact on sample generalizability is unknown. We compared recruitment yields, cost-effectiveness, and demographic characteristics across several electronic and traditional recruitment methods.MethodsWe analyzed data from the diet gout trial recruitment campaign. The diet gout trial was a randomized, controlled, cross-over trial that examined the effects of a dietary approaches to stop hypertension (DASH)-like diet on uric acid levels in adults with gout. We used four electronic medical record and four non-electronic medical record-based recruitment methods to identify and recruit potentially eligible participants. We calculated the response rate, screening visit completion rate, and randomization rate for each method. We also determined cost per response, the screening, and randomization for each method. Finally, we compared the demographic characteristics among individuals who completed the screening visit by recruitment method.ResultsOf the 294 adults who responded to the recruitment campaign, 51% were identified from electronic medical record-based methods. Patient portal messaging, an electronic medical record-based method, resulted in the highest response rate (4%), screening visit completion rate (37%), and randomization rate (21%) among these eight methods. Electronic medical record-based methods ($60) were more cost-effective per response than non-electronic medical record-based methods ($107). Electronic-based methods, including patient portal messaging and Facebook, had the highest proportion of White individuals screened (52% and 60%). Direct mail to non-active patient portal increased enrollment of traditionally under-represented groups, including both women and African Americans.ConclusionAn electronic medical record-based recruitment strategy that utilized the electronic medical record for participant identification and postal mailing for participant outreach was cost-effective and increased participation of under-represented groups. This hybrid strategy represents a promising approach to improve the timely execution and broad generalizability of future clinical trials.

Project description:BACKGROUND:Electronic medical record (EMR) chronic disease measurement can help direct primary care prevention and treatment strategies and plan health services resource management. Incomplete data and poor consistency of coded disease values within EMR problem lists are widespread issues that limit primary and secondary uses of these data. These issues were shared by the McMaster University Sentinel and Information Collaboration (MUSIC), a primary care practice-based research network (PBRN) located in Hamilton, Ontario, Canada. OBJECTIVE:We sought to develop and evaluate the effectiveness of new EMR interface tools aimed at improving the quantity and the consistency of disease codes recorded within the disease registry across the MUSIC PBRN. METHODS:We used a single-arm prospective trial design with preintervention and postintervention data analysis to assess the effect of the intervention on disease recording volume and quality. The MUSIC network holds data on over 75,080 patients, 37,212 currently rostered. There were 4 MUSIC network clinician champions involved in gap analysis of the disease coding process and in the iterative design of new interface tools. We leveraged terminology standards and factored EMR workflow and usability into a new interface solution that aimed to optimize code selection volume and quality while minimizing physician time burden. The intervention was integrated as part of usual clinical workflow during routine billing activities. RESULTS:After implementation of the new interface (June 25, 2017), we assessed the disease registry codes at 3 and 6 months (intervention period) to compare their volume and quality to preintervention levels (baseline period). A total of 17,496 International Classification of Diseases, 9th Revision (ICD9) code values were recorded in the disease registry during the 11.5-year (2006 to mid-2017) baseline period. A large gain in disease recording occurred in the intervention period (8516/17,496, 48.67% over baseline), resulting in a total of 26,774 codes. The coding rate increased by a factor of 11.2, averaging 1419 codes per month over the baseline average rate of 127 codes per month. The proportion of preferred ICD9 codes increased by 17.03% in the intervention period (11,007/17,496, 62.91% vs 7417/9278, 79.94%; ?21=819.4; P<.001). A total of 45.03% (4178/9278) of disease codes were entered by way of the new screen prompt tools, with significant increases between quarters (Jul-Sep: 2507/6140, 40.83% vs Oct-Dec: 1671/3148, 53.08%; ?21=126.2; P<.001). CONCLUSIONS:The introduction of clinician co-designed, workflow-embedded disease coding tools is a very effective solution to the issues of poor disease coding and quality in EMRs. The substantial effectiveness in a routine care environment demonstrates usability, and the intervention detail described here should be generalizable to any setting. Significant improvements in problem list coding within primary care EMRs can be realized with minimal disruption to routine clinical workflow.

Dataset Information

Variation in methods, results and reporting in electronic health record-based studies evaluating routine care in gout: A systematic review.

Publications

Variation in methods, results and reporting in electronic health record-based studies evaluating routine care in gout: A systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets