The validation of electronic health records in accurately identifying patients eligible for colorectal cancer screening in safety net clinics.
Ontology highlight
ABSTRACT: Background
While electronic health records (EHRs) play a key role in increasing colorectal cancer (CRC) screening by identifying individuals who are overdue, important shortfalls remain.Objectives
As part of the Strategies and Opportunities to STOP Colon Cancer (STOP CRC) study, we assessed the accuracy of EHR codes in identifying patients eligible for CRC screening.Methods
We selected a stratified random sample of 800 study participants from 26 participating clinics, in the Pacific Northwest region of the USA. We compared data obtained through codes in the EHR to conduct a manual chart audit. A trained chart abstractor completed the abstraction of eligible and ineligible patients.Results
Of 520 individuals in need of CRC screening, identified via the EHR, 459 were confirmed through chart review (positive predictive value = 88%). Of 280 individuals flagged as up-to-date in their screening per EHR data, 269 were confirmed through chart review (negative predictive value = 96%). Among the 61 patients incorrectly classified as eligible, 83.6% of disagreements were due to evidence of a prior colonoscopy or referral that was not captured in recognizable fields in the EHR.Conclusions
Our findings highlight importance of better capture of past screening events in the EHR. While the need for better population-based data is not unique to CRC screening, it provides an important example of the use of population-based data not only for tracking care, but also for delivering interventions.
SUBMITTER: Petrik AF
PROVIDER: S-EPMC5161488 | biostudies-literature | 2016 Dec
REPOSITORIES: biostudies-literature
Publications
The validation of electronic health records in accurately identifying patients eligible for colorectal cancer screening in safety net clinics.
Petrik Amanda F AF Green Beverly B BB Vollmer William M WM Le Thuy T Bachman Barbara B Keast Erin E Rivelli Jennifer J Coronado Gloria D GD
Family practice 20160728 6
<h4>Background</h4>While electronic health records (EHRs) play a key role in increasing colorectal cancer (CRC) screening by identifying individuals who are overdue, important shortfalls remain.<h4>Objectives</h4>As part of the Strategies and Opportunities to STOP Colon Cancer (STOP CRC) study, we assessed the accuracy of EHR codes in identifying patients eligible for CRC screening.<h4>Methods</h4>We selected a stratified random sample of 800 study participants from 26 participating clinics, in ...[more]
Similar Datasets
Project description:ContextLow-income and racial/ethnic minority populations experience disproportionate colorectal cancer (CRC) burden and poorer survival. Novel behavioral strategies are needed to improve screening rates in these groups.BackgroundThe study aimed to test a theoretically based "implementation intentions" intervention for improving CRC screening among unscreened adults in urban safety-net clinics.DesignRandomized controlled trial.Setting/participantsAdults (N=470) aged ≥50 years, due for CRC screening, from urban safety-net clinics were recruited.InterventionThe intervention (conducted in 2009-2011) was delivered via touchscreen computers that tailored informational messages to decisional stage and screening barriers. The computer then randomized participants to generic health information on diet and exercise (Comparison group) or "implementation intentions" questions and planning (Experimental group) specific to the CRC screening test chosen (fecal immunochemical test or colonoscopy).Main outcome measuresThe primary study outcome was completion of CRC screening at 26 weeks based on test reports (analysis conducted in 2012-2013).ResultsThe study population had a mean age of 57 years and was 42% non-Hispanic African American, 28% non-Hispanic white, and 27% Hispanic. Those receiving the implementation intentions-based intervention had higher odds (AOR=1.83, 95% CI=1.23, 2.73) of completing CRC screening than the Comparison group. Those with higher self-efficacy for screening (AOR=1.57, 95% CI=1.03, 2.39), history of asthma (AOR=2.20, 95% CI=1.26, 3.84), no history of diabetes (AOR=1.86, 95% CI=1.21, 2.86), and reporting they had never heard that "cutting on cancer" makes it spread (AOR=1.78, 95% CI=1.16, 2.72) were more likely to complete CRC screening.ConclusionsThe results of this study suggest that programs incorporating an implementation intentions approach can contribute to successful completion of CRC screening even among very low-income and diverse primary care populations. Future initiatives to reduce CRC incidence and mortality disparities may be able to employ implementation intentions in large-scale efforts to encourage screening and prevention behaviors.
| S-EPMC4311575 | biostudies-literature
Project description:BackgroundQuality metrics, pay for performance (P4P), and value-based payments are prominent aspects of the current and future American healthcare system. However, linking clinic payment to clinic quality measures may financially disadvantage safety-net clinics and their patient population because safety-net clinics often have worse quality metric scores than non-safety net clinics. The Minnesota Safety Net Coalition's Quality Measurement Enhancement Project sought to collect data from primary care providers' (PCPs) experiences, which could assist Minnesota policymakers and state agencies as they create a new P4P system. Our research study aims are to identify PCPs' perspectives about 1) quality metrics at safety net clinics and non-safety net clinics, 2) how clinic quality measures affect patients and patient care, and 3) how payment for quality measures may influence healthcare.MethodsQualitative interviews with 14 PCPs (4 individual interviews and 3 focus groups) who had worked at both safety net and non-safety net primary care clinics in Minneapolis-St Paul Minnesota USA metropolitan area. Qualitative analyses identified major themes.ResultsThree themes with sub-themes emerged. Theme #1: Minnesota's current clinic quality scores are influenced more by patients and clinic systems than by clinicians. Theme #2: Collecting data for a set of specific quality measures is not the same as measuring quality healthcare. Subtheme #2.1: Current quality measures are not aligned with how patients and clinicians define quality healthcare. Theme #3: Current quality measures are a product of and embedded in social and structural inequities in the American health care system. Subtheme #3.1: The current inequitable healthcare system should not be reinforced with financial payments. Subtheme #3.2: Health equity requires new metrics and a new healthcare system. Overall, PCPs felt that the current inequitable quality metrics should be replaced by different metrics along with major changes to the healthcare system that could produce greater health equity.ConclusionAligning payment with the current quality metrics could perpetuate and exacerbate social inequities and health disparities. Policymakers should consider PCPs' perspectives and create a quality-payment framework that does not disadvantage patients who are affected by social and structural inequities as well as the clinics and providers who serve them.
| S-EPMC6222992 | biostudies-literature
Project description:ObjectiveTo assess the impact of provider incentive policy on smoking status documentation.Data sourcesPrimary data were extracted from structured electronic medical records (EMRs) from 15 community health centers (CHCs).Study designThis was an observational study of data from 2006 to 2013, assessing changes in documentation of smoking status over time.Data extraction methodsWe extracted structured EMR data for patients age 18 and older with at least one primary care visit.Principal findingsRates of documented smoking status rose from 30 percent in 2006 to 90 percent in 2013; the largest increase occurred from 2011 to 2012 following policy changes (21.3% [95% CI, 8.2%, 34.4%] from the overall trend). Rates varied by clinic and across patient subgroups.ConclusionsDocumentation of smoking status improved markedly after introduction of new federal standards. Further improvement in documentation is still needed, especially for males, nonwhite patients, those using opioids, and HIV + patients. More research is needed to study whether changes in documentation lead to improvements in counseling, cessation, and patient outcomes.
| S-EPMC7080378 | biostudies-literature
Project description:IntroductionPrevention of tuberculosis disease through diagnosis and treatment of latent tuberculosis infection is critical for achieving tuberculosis elimination in the U.S. Diagnosis and treatment of latent tuberculosis infection in safety-net primary care settings that serve patients at risk for tuberculosis may increase uptake of this prevention effort and accelerate progress toward elimination. Optimizing tuberculosis prevention in these settings requires measuring the latent tuberculosis infection care cascade (testing, diagnosis, and treatment) and identifying gaps to develop solutions to overcome barriers. We used electronic health record data to describe the latent tuberculosis infection care cascade and identify gaps among a network of safety-net primary care clinics.MethodsElectronic health record data for patients seen in the OCHIN Clinical Network, the largest network of safety-net clinics in the U.S., between 2012 and 2019 were extracted. electronic health record data were used to measure the latent tuberculosis infection care cascade: patients who met tuberculosis screening criteria on the basis of current recommendations were tested for tuberculosis infection, diagnosed with latent tuberculosis infection, and prescribed treatment for latent tuberculosis infection. Outcomes were stratified by diagnostic test and treatment regimen.ResultsAmong 1.9 million patients in the analytic cohort, 43.5% met tuberculosis screening criteria, but only 21.4% were tested for latent tuberculosis infection; less than half (40.4%) were tested using an interferon-gamma release assay. Among those with a valid result, 10.5% were diagnosed with latent tuberculosis infection, 29.1% of those were prescribed latent tuberculosis infection treatment, and only 33.6% were prescribed a recommended rifamycin-based regimen.ConclusionsElectronic health record data can be used to measure the latent tuberculosis infection care cascade. A large proportion of patients in this safety-net clinical network are at high risk for tuberculosis infection. Addressing identified gaps in latent tuberculosis infection testing and treatment may have a direct impact on improving tuberculosis prevention in primary care clinics and accelerate progress toward elimination.
| S-EPMC10630620 | biostudies-literature
Project description:BackgroundSafety net health systems face barriers to effective ambulatory medication reconciliation for vulnerable populations. Although some electronic health record (EHR) systems offer safety advantages, EHR use may affect the quality of patient-provider communication.ObjectiveThis mixed-methods observational study aimed to develop a conceptual framework of how clinicians balance the demands and risks of EHR and communication tasks during medication reconciliation discussions in a safety net system.MethodsThis study occurred 3 to 16 (median 9) months after new EHR implementation in five academic public hospital clinics. We video recorded visits between English-/Spanish-speaking patients and their primary/specialty care clinicians. We analyzed the proportion of medications addressed and coded time spent on nonverbal tasks during medication reconciliation as "multitasking EHR use," "silent EHR use," "non-EHR multitasking," and "focused patient-clinician talk." Finally, we analyzed communication patterns to develop a conceptual framework.ResultsWe examined 35 visits (17%, 6/35 Spanish) between 25 patients (mean age 57, SD 11 years; 44%, 11/25 women; 48%, 12/25 Hispanic; and 20%, 5/25 with limited health literacy) and 25 clinicians (48%, 12/25 primary care). Patients had listed a median of 7 (IQR 5-12) relevant medications, and clinicians addressed a median of 3 (interquartile range [IQR] 1-5) medications. The median duration of medication reconciliation was 2.1 (IQR 1.0-4.2) minutes, comprising a median of 10% (IQR 3%-17%) of visit time. Multitasking EHR use occurred in 47% (IQR 26%-70%) of the medication reconciliation time. Silent EHR use and non-EHR multitasking occurred a smaller proportion of medication reconciliation time, with a median of 0% for both. Focused clinician-patient talk occurred a median of 24% (IQR 0-39%) of medication reconciliation time. Five communication patterns with EHR medication reconciliation were observed: (1) typical EHR multitasking for medication reconciliation, (2) dynamic EHR use to negotiate medication discrepancies, (3) focused patient-clinician talk for medication counseling and addressing patient concerns, (4) responding to patient concerns while maintaining EHR use, and (5) using EHRs to engage patients during medication reconciliation. We developed a conceptual diagram representing the dilemma of the multitasking clinician during medication reconciliation.ConclusionsSafety net visits involve multitasking EHR use during almost half of medication reconciliation time. The multitasking clinician balances the cognitive and emotional demands posed by incoming information from multiple sources, attempts to synthesize and act on this information through EHR and communication tasks, and adopts strategies of silent EHR use and focused patient-clinician talk that may help mitigate the risks of multitasking. Future studies should explore diverse patient perspectives about clinician EHR multitasking, clinical outcomes related to EHR multitasking, and human factors and systems engineering interventions to improve the safety of EHR use during the complex process of medication reconciliation.
| S-EPMC5962827 | biostudies-literature
Project description:BackgroundExisting tools to measure patient-centered medical home (PCMH) adoption are not designed for research evaluation in safety-net clinics.ObjectiveDevelop a scale to measure PCMH adoption in safety-net clinics.Research designCross-sectional survey.SubjectsSixty-five clinics in five states.Main measuresFifty-two-item Safety Net Medical Home Scale (SNMHS). The total score ranges from 0 (worst) to 100 (best) and is an average of multiple subscales (0-100): Access and Communication, Patient Tracking and Registry, Care Management, Test and Referral Tracking, Quality Improvement, and External Coordination. The scale was tested for internal consistency reliability and tested for convergent validity using The Assessment of Chronic Illness Care (ACIC) and the Patient-Centered Medical Home Assessment (PCMH-A). The scale was applied to centers in the sample. In addition, linear regression models were used to measure the association between clinic characteristics and medical home adoption.ResultsThe SNMHS had high internal consistency reliability (Cronbach's alpha = 0.84). The SNMHS score correlated moderately with the ACIC score (r = 0.64, p < 0.0001) and the PCMH-A (r = 0.56, p < 0.001). The mean SNMHS score was 61 ± SD 13. Among the subscales, External Coordination (66 ± 16) and Access and Communication (65 ± 14) had the highest mean scores, while Quality Improvement (55 ± 17) and Care Management (55 ± 16) had lower mean scores. Clinic characteristics positively associated with total SNMHS score were having more providers (β 15.8 95% CI 8.1-23.4 >8 provider FTEs compared to <4 FTEs) and participation in financial incentive programs (β 8.4 95% 1.6-15.3).ConclusionThe SNMHS demonstrated reliability and convergent validity for measuring PCMH adoption in safety-net clinics. Some clinics have significant PCMH adoption. However, room for improvement exists in most domains, especially for clinics with fewer providers.
| S-EPMC3235610 | biostudies-literature
Project description:ObjectivesEvaluate effects of a multicomponent intervention (human papillomavirus [HPV] vaccine-specific brochure and recalls) on HPV vaccination and secondarily examine if race/ethnicity moderates effects.MethodsUnvaccinated girls aged 11 to 18 years attending 4 safety-net pediatric clinics and their parent/guardian (n = 814 dyads) were randomized to (1) active comparison (general adolescent vaccine brochure), or (2) intervention consisting of a HPV vaccine-specific brochure, telephone recalls to parents who declined, and recalls to patients overdue for doses 2 and 3. HPV 1-dose and 3-dose coverages were assessed via electronic health records 12 months after randomization. Multivariate logistic regressions estimated adjusted odds and marginal predicted vaccine coverage by study arm and race/ethnicity.ResultsIntent-to-treat analyses found no main effect of the HPV vaccine-specific brochure on 1-dose coverage (42.0% vs 40.6%); however, secondary analyses found race/ethnicity was a significant moderator such that the intervention was effective only for Hispanic individuals (adjusted odds ratio [AOR] 1.43; 95% confidence interval [CI] 1.02-2.02), and not effective for black individuals (AOR 0.64; 95% CI 0.41-1.13). Recalls to parents who declined the vaccine during the index visit were not effective, but recalls to patients overdue for doses 2 and 3 were effective at increasing 3-dose coverage regardless of race/ethnicity (AOR 1.99; 95% CI 1.16-3.45).ConclusionsEducational materials describing only the HPV vaccine were effective for Hispanic but not black individuals. Future research should test mechanisms that may mediate intervention effects for different racial/ethnic groups, such as different informational needs or vaccine schemas (experiences, beliefs, norms).
| S-EPMC7313721 | biostudies-literature
Project description:BackgroundDiagnosis performances of case-identifying algorithms developed in healthcare database are usually assessed by comparing identified cases with an external data source. When this is not feasible, intra-database validation can present an appropriate alternative.ObjectivesTo illustrate through two practical examples how to perform intra-database validations of case-identifying algorithms using reconstituted Electronic Health Records (rEHRs).MethodsPatients with 1) multiple sclerosis (MS) relapses and 2) metastatic castration-resistant prostate cancer (mCRPC) were identified in the French nationwide healthcare database (SNDS) using two case-identifying algorithms. A validation study was then conducted to estimate diagnostic performances of these algorithms through the calculation of their positive predictive value (PPV) and negative predictive value (NPV). To that end, anonymized rEHRs were generated based on the overall information captured in the SNDS over time (e.g. procedure, hospital stays, drug dispensing, medical visits) for a random selection of patients identified as cases or non-cases according to the predefined algorithms. For each disease, an independent validation committee reviewed the rEHRs of 100 cases and 100 non-cases in order to adjudicate on the status of the selected patients (true case/ true non-case), blinded with respect to the result of the corresponding algorithm.ResultsAlgorithm for relapses identification in MS showed a 95% PPV and 100% NPV. Algorithm for mCRPC identification showed a 97% PPV and 99% NPV.ConclusionThe use of rEHRs to conduct an intra-database validation appears to be a valuable tool to estimate the performances of a case-identifying algorithm and assess its validity, in the absence of alternative.
| S-EPMC8088022 | biostudies-literature
Project description:BACKGROUND:Electronic health records (EHR) detect the onset of acute kidney injury (AKI) in hospitalized patients, and may identify those at highest risk of mortality and renal replacement therapy (RRT), for earlier targeted intervention. METHODS:Prospective observational study to derive prediction models for hospital mortality and RRT, in inpatients aged ≥18 years with AKI detected by EHR over 1 year in a tertiary institution, fulfilling modified KDIGO criterion based on serial serum creatinine (sCr) measures. RESULTS:We studied 3333 patients with AKI, of 77,873 unique patient admissions, giving an AKI incidence of 4%. KDIGO AKI stages at detection were 1(74%), 2(15%), 3(10%); corresponding peak AKI staging in hospital were 61, 20, 19%. 392 patients (12%) died, and 174 (5%) received RRT. Multivariate logistic regression identified AKI onset in ICU, haematological malignancy, higher delta sCr (sCr rise from AKI detection till peak), higher serum potassium and baseline eGFR, as independent predictors of both mortality and RRT. Additionally, older age, higher serum urea, pneumonia and intraabdominal infections, acute cardiac diseases, solid organ malignancy, cerebrovascular disease, current need for RRT and admission under a medical specialty predicted mortality. The AUROC for RRT prediction was 0.94, averaging 0.93 after 10-fold cross-validation. Corresponding AUROC for mortality prediction was 0.9 and 0.9 after validation. Decision tree analysis for RRT prediction achieved a balanced accuracy of 70.4%, and identified delta-sCr ≥ 148 μmol/L as the key factor that predicted RRT. CONCLUSION:Case fatality was high with significant renal deterioration following hospital-wide AKI. EHR clinical model was highly accurate for both RRT prediction and for mortality; allowing excellent risk-stratification with potential for real-time deployment.
| S-EPMC6357378 | biostudies-literature
Project description:BACKGROUND: When medically unexplained physical symptoms (MUPS) become persistent, it may have major implications for the patient, the general practitioner (GP) and for society.Early identification of patients with MUPS in electronic medical records (EMRs) might contribute to prevention of persistent MUPS by creating awareness among GPs and providing an opportunity to start stepped care management. However, procedures for identification of patients with MUPS in EMRs are not well established yet. In this validation study we explore the test characteristics of an EMR screening method to identify patients with MUPS. METHODS: The EMR screening method consists of three steps. First, all patients ? 18 years were included when they had five or more contacts in the last 12 months. Second, patients with known chronic conditions were excluded. Finally, patients were included with a MUPS syndrome or when they had three or more complaints suggestive for MUPS. We compared the results of the EMR screening method with scores on the Patient Health Questionnaire-15 (PHQ-15), which we used as reference test. We calculated test characteristics for various cut-off points. RESULTS: From the 1223 patients in our dataset who completed the PHQ-15, 609 (49/8%) scored ? 5 on the PHQ-15. The EMR screening method detected 131/1223 (10.7%) as patients with MUPS. Of those, 102 (77.9%) scored ? 5 on the PHQ-15 and 53 (40.5%) scored ? 10. When compared with the PHQ-15 cut-off point ? 10, sensitivity and specificity were 0.30 and 0.93 and positive and negative predictive values were 0.40 and 0.89, respectively. CONCLUSIONS: The EMR screening method to identify patients with MUPS has a high specificity. However, many potential MUPS patients will be missed. Before using this method as a screening instrument for selecting patients who might benefit from structured care, its sensitivity needs to be improved while maintaining its specificity.
| S-EPMC4052805 | biostudies-literature