Challenges in assessing the process-outcome link in practice.
Ontology highlight
ABSTRACT:
SUBMITTER: Parast L
PROVIDER: S-EPMC4351283 | biostudies-literature | 2015 Mar
REPOSITORIES: biostudies-literature
Publications
Challenges in assessing the process-outcome link in practice.
Parast Layla L Doyle Brian B Damberg Cheryl L CL Shetty Kanaka K Ganz David A DA Wenger Neil S NS Shekelle Paul G PG
Journal of general internal medicine 20150107 3
The expanded use of clinical process-of-care measures to assess the quality of health care in the context of public reporting and pay-for-performance applications has led to a desire to demonstrate the value of such efforts in terms of improved patient outcomes. The inability to observe associations between improved delivery of clinical processes and improved clinical outcomes in practice has raised concerns about the value of holding providers accountable for delivery of clinical processes of c ...[more]
Similar Datasets
Project description:Neurodegeneration has been reported in young animals after exposure to all commonly used general anesthetic agents. The brain may be particularly vulnerable to anesthetic toxicity during peak synaptogenesis (in gestation and infancy). Human studies of long-term neurodevelopmental outcome following general anesthesia in early childhood report contradictory findings. This review assesses the strengths and deficiencies in human research methodologies to inform future studies. We identified 76 studies, published between 1990 and 2017, of long-term neurodevelopmental outcome following early childhood or in utero general anesthesia exposure: 49 retrospective, 9 ambidirectional, 17 prospective cohort studies, and 1 randomized controlled trial. Forty-nine studies were explicitly concerned with anesthetic-induced neurotoxicity. Full texts were appraised for methodological challenges and possible solutions. Major challenges identified included delineating effects of anesthesia from surgery, defining the timing and duration of exposure, selection of a surgical cohort and intervention, addressing multiple confounding life course factors, detecting modest neurotoxic effects with small sample sizes (median, 131 children; interquartile range, 50-372), selection of sensitive neurodevelopmental outcomes at appropriate ages for different developmental domains, insufficient length of follow-up (median age, 6 years; interquartile range, 2-12 years), and sample attrition. We discuss potential solutions to these challenges. Further adequately powered, multicenter, prospective randomized controlled trials of anesthetic-induced neurotoxicity in children are required. However, we believe that the inherent methodological challenges of studying anesthetic-induced neurotoxicity necessitate the parallel use of well-designed observational cohort studies.
| S-EPMC6436726 | biostudies-literature
Project description:BACKGROUND: Dupuytren's disease of the hand is a common condition affecting the palmar fascia, resulting in progressive flexion deformities of the digits and hence limitation of hand function. The optimal treatment remains unclear as outcomes studies have used a variety of measures for assessment. METHODS: A literature search was performed for all publications describing surgical treatment, percutaneous needle aponeurotomy or collagenase injection for primary or recurrent Dupuytren's disease where outcomes had been monitored using functional measures. RESULTS: Ninety-one studies met the inclusion criteria. Twenty-two studies reported outcomes using patient reported outcome measures (PROMs) ranging from validated questionnaires to self-reported measures for return to work and self-rated disability. The Disability of Arm, Shoulder and Hand (DASH) score was the most utilised patient-reported function measure (n=11). Patient satisfaction was reported by eighteen studies but no single method was used consistently. Range of movement was the most frequent physical measure and was reported in all 91 studies. However, the methods of measurement and reporting varied, with seventeen different techniques being used. Other physical measures included grip and pinch strength and sensibility, again with variations in measurement protocols. The mean follow-up time ranged from 2 weeks to 17 years. CONCLUSIONS: There is little consistency in the reporting of outcomes for interventions in patients with Dupuytren's disease, making it impossible to compare the efficacy of different treatment modalities. Although there are limitations to the existing generic patient reported outcomes measures, a combination of these together with a disease-specific questionnaire, and physical measures of active and passive individual joint Range of movement (ROM), grip and sensibility using standardised protocols should be used for future outcomes studies. As Dupuytren's disease tends to recur following treatment as well as extend to involve other areas of the hand, follow-up times should be standardised and designed to capture both short and long term outcomes.
| S-EPMC3637830 | biostudies-other
Project description:Whether sunscreen use affects melanoma risk has been widely studied with contradictory results. To answer this question we performed a systematic review of all published studies, accounting for sources of heterogeneity and bias. We searched for original articles investigating the sunscreen-melanoma association in humans to February 28, 2018. We then used random-effects meta-analysis to combine estimates of the association, stratified by study design. Stratified meta-analysis and meta-regression were used to identify sources of heterogeneity. We included 21,069 melanoma cases from 28 studies published 1979-2018: 23 case-control (11 hospital-based, 12 population-based), 1 ecological, 3 cohort and 1 randomised controlled trial (RCT). There was marked heterogeneity across study designs and among case-control studies but adjustment for confounding by sun exposure, sunburns and phenotype systematically moved estimates toward decreased melanoma risk among sunscreen users. Ever- vs. never-use of sunscreen was inversely associated with melanoma in hospital-based case-control studies (adjusted odds ratio (OR) = 0.57, 95%confidence interval (CI) 0.37-0.87, pheterogeneity < 0.001), the ecological study (rate ratio = 0.48, 95%CI 0.35-0.66), and the RCT (hazard ratio (HR) = 0.49, 95%CI 0.24-1.01). It was not associated in population-based case-control studies (OR = 1.17, 95%CI 0.90-1.51, pheterogeneity < 0.001) and was positively associated in the cohort studies (HR = 1.27, 95%CI 1.07-1.51, pheterogeneity = 0.236). The association differed by latitude (pinteraction = 0.042), region (pinteraction = 0.008), adjustment for naevi/freckling (pinteraction = 0.035), and proportion of never-sunscreen-users (pinteraction = 0·012). Evidence from observational studies on sunscreen use and melanoma risk was weak and heterogeneous, consistent with the challenges of controlling for innate confounding by indication. The only RCT showed a protective effect of sunscreen.
| S-EPMC6451658 | biostudies-literature
Project description:We conducted the Reproducibility Project: Cancer Biology to investigate the replicability of preclinical research in cancer biology. The initial aim of the project was to repeat 193 experiments from 53 high-impact papers, using an approach in which the experimental protocols and plans for data analysis had to be peer reviewed and accepted for publication before experimental work could begin. However, the various barriers and challenges we encountered while designing and conducting the experiments meant that we were only able to repeat 50 experiments from 23 papers. Here we report these barriers and challenges. First, many original papers failed to report key descriptive and inferential statistics: the data needed to compute effect sizes and conduct power analyses was publicly accessible for just 4 of 193 experiments. Moreover, despite contacting the authors of the original papers, we were unable to obtain these data for 68% of the experiments. Second, none of the 193 experiments were described in sufficient detail in the original paper to enable us to design protocols to repeat the experiments, so we had to seek clarifications from the original authors. While authors were extremely or very helpful for 41% of experiments, they were minimally helpful for 9% of experiments, and not at all helpful (or did not respond to us) for 32% of experiments. Third, once experimental work started, 67% of the peer-reviewed protocols required modifications to complete the research and just 41% of those modifications could be implemented. Cumulatively, these three factors limited the number of experiments that could be repeated. This experience draws attention to a basic and fundamental concern about replication - it is hard to assess whether reported findings are credible.
| S-EPMC8651289 | biostudies-literature
Project description:Clinical research infrastructure is one of the unsung heroes of the scientific response to the current COVID-19 pandemic. The extensive, long-term funding into research support structures, skilled people, and technology allowed the United Kingdom research response to move off the starting blocks at pace by utilizing pre-existing platforms. The increasing focus from funders on evaluating the outcomes and impact of research infrastructure investment requires both a reframing and progression of the current models in order to address the contribution of the underlying support infrastructure. The majority of current evaluation/outcome models focus on a "pipeline" approach using a methodology which follows the traditional research funding route with the addition of quantitative metrics. These models fail to embrace the complexity caused by the interplay of previous investment, the coalescing of project outputs from different funders, the underlying infrastructure investment, and the parallel development across different parts of the system. Research infrastructure is the underpinning foundation of a project-driven research system and requires long-term, sustained funding and capital investment to maintain scientific and technological expertise. Therefore, the short-term focus on quantitative metrics that are easy to collect and interpret and that can be assessed in a roughly 5-year funding cycle needs to be addressed. The significant level of investment in research infrastructure necessitates investment to develop bespoke methodologies that develop fit-for-purpose, longer-term/continual approach(es) to evaluation. Real-world research should reflect real-world evaluation and allow for the accrual of a narrative of value indicators that build a picture of the contribution of infrastructure to research outcomes. The linear approach is not fit for purpose, the research endeavour is a complex, twisted road, and the evaluation approach needs to embrace this complexity through the development of realist approaches and the rapidly evolving data ecosystem. This paper sets out methodological challenges and considers the need to develop bespoke methodological approaches to allow a richer assessment of impact, contribution, attribution, and evaluation of research infrastructure. This paper is the beginning of a conversation that invites the community to "take up the mantle" and tackle the complexity of real-world research translation and evaluation.
| S-EPMC8371591 | biostudies-literature
Project description:Strategies and Opportunities to STOP Colon Cancer in Priority Populations (STOP CRC) was a pragmatic cluster-randomized trial conducted at federally qualified health centers and designed to "Reach" as many unscreened patients as possible by directly mailing them fecal screening tests. STOP CRC used an electronic health record registry to identify individuals' needing CRC screening and mail interventions to them. The registry was updated daily removing individuals completing CRC screening or those who no longer were clinic patients. Reach, a component RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance), is defined as the absolute number, percent, and representativeness of individuals "willing to participate in" or "exposed to" an initiative. We describe the complexities of measuring Reach in a pragmatic trial. Overall 21,134 patients were on the registry list for at least one day, with 18,226 remaining after removing patients completing screening before any mailings. Observed Reached (the percent of individuals exposed to the intervention) using each denominator was 30.7% and 35.6% respectively. Reach improved only modestly after accounting for factors that made it impossible for clinics to send mailings. Few differences were observed in demographic and health care utilization factors among individuals Reached versus not Reached, suggesting that health center Implementation was more influential than patients' willingness or ability to participate. A pragmatic definition of Reach that accounted for dynamic changes the absolute number eligible and the proportion exposed was more useful than traditional definitions of Reach. Actual Reach was dependent on Implementation and not patient level characteristics. Clinical Trials Registration Number: ClincalTrials.gov (NCT01742065).
| S-EPMC6558213 | biostudies-literature
Project description:BackgroundPatients with osteoporosis can sustain fractures following falls or other minimal trauma. This risk of fracture can be reduced through appropriate diagnostic testing, pharmacologic therapy, and other readily measured standards of care.ObjectivesOur aim was to develop a credible clinical performance assessment to measure physicians' quality of osteoporosis care, and determine reasonable performance standards for both competent and excellent care.DesignThis was a retrospective cohort study.ParticipantsThree hundred and eighty one general internists and subspecialists with time-limited board certification were included in the study.Main measuresPerformance rates on eight evidence-based measures were obtained from the American Board of Internal Medicine (ABIM) Osteoporosis Practice Improvement Module® (PIM), a web-based tool that uses medical chart reviews to help physicians assess and improve care. We applied a patented methodology, using an adaptation of the Angoff standard-setting method and the Dunn-Rankin method, with an expert panel skilled in osteoporosis care to form a composite and establish standards for both competent and excellent care. Physician and practice characteristics, including a practice infrastructure score based on the Physician Practice Connections Readiness Survey (PPC-RS), were used to examine the validity of the inferences made from the composite scores.Key resultsThe mean composite score was 67.54 out of 100 maximum points with a reliability of 0.92. The standard for competent care was 46.87, and for excellent care it was 83.58. Both standards had high classification accuracies (0.95). Sixteen percent of physicians performed below the competent care standard, while 22 % met the excellent care standard. Specialists scored higher than generalists, and better practice infrastructure was associated with higher composite scores, providing some validity evidence.ConclusionsWe developed a rigorous methodology for assessing physicians' osteoporosis care. Clinical performance feedback relative to absolute standards of care provides physicians with a meaningful approach to self-evaluation to improve patient care.
| S-EPMC4617929 | biostudies-literature
Project description:AimsThe Catheter Ablation vs. Antiarrhythmic Drug Therapy for Atrial Fibrillation (CABANA) trial aimed to assess the impact of ablation on morbidity and mortality. This observational study was conducted in parallel to CABANA to assess trial generalizability.Methods and resultsUsing a large US administrative database, we identified 183 760 patients with atrial fibrillation (AF) treated with ablation or medical therapy (antiarrhythmic or rate control drugs) between 1 August 2009 and 30 April 2016 (CABANA enrolment period). Propensity score weighting was used to balance patients treated with ablation (N = 12 032) or medical therapy alone (N = 171 728) on 90 dimensions. Ablation was associated with a reduction in the composite endpoint of all-cause mortality, stroke, major bleeding, and cardiac arrest [hazard ratio (HR) 0.75, 95% confidence interval (CI) 0.70-0.81; P < 0.001]. The majority of patients (73.8%) were potentially trial eligible; among whom the risk reduction associated with ablation was greatest (HR 0.70, 95% CI 0.63-0.77; P < 0.001). Among the 3.8% of patients who failed to meet the inclusion criterion, i.e. patients under 65 years without stroke risk factors, the event rates were low and there was no significant relationship with ablation (HR 0.67, 95% CI 0.29-1.56; P = 0.35). Among the 22.4% patients who met at least one of the trial exclusion criteria, there was a lesser but statistically significant reduction associated with ablation (HR 0.85, 95% CI 0.75-0.95; P = 0.01).ConclusionIn routine clinical care, ablation was associated with a reduction in the primary CABANA composite endpoint of all-cause mortality, stroke, major bleeding, and cardiac arrest, particularly in patients who were eligible for the trial.
| S-EPMC6475520 | biostudies-literature
Project description:To examine the process and outcomes of care of COPD patients by Advanced Practice Providers (APPs) and primary care physicians.We conducted a cross sectional retrospective cohort study of Medicare beneficiaries with COPD who had at least one hospitalization in 2010. We examined the process measures of receipt of spirometry evaluation, influenza and pneumococcal vaccine, use of COPD medications, and referral to a pulmonary specialist visit. Outcome measures were emergency department (ER) visit, number of hospitalizations and 30-day readmission in 2010.A total of 7,257 Medicare beneficiaries with COPD were included. Of these, 1,999 and 5,258 received primary care from APPs and primary care physicians, respectively. Patients in the APP group were more likely to be white, younger, male, residing in non-metropolitan areas and have fewer comorbidities. In terms of process of care measures, APPs were more likely to prescribe short acting bronchodilators (adjusted odds ratio [aOR] = 1.18, 95%Confidence Interval [CI] 1.05-1.32), oxygen therapy (aOR = 1.25, 95% CI 1.12-1.40) and consult a pulmonary specialist (aOR = 1.39, 95% CI 1.23-1.56), but less likely to give influenza and pneumococcal vaccinations. Patients receiving care from APPs had lower rates of ER visits for COPD (aOR = 0.84, 95%CI 0.71-0.98) and had a higher follow-up rate with pulmonary specialist within 30 days of hospitalization for COPD (aOR = 1.25, 95%CI 1.07-1.48) than those cared for by physicians.Compared to patients cared for by physicians, patients cared for by APPs were more likely to receive short acting bronchodilator, oxygen therapy and been referred to pulmonologist, however they had lower rates of vaccination probably due to lower age group. Patients cared for by APPs were less like to visit an ER for COPD compared to patients care for by physicians, conversely there was no differences in hospitalization or readmission for COPD between MDs and APPs.
| S-EPMC4765888 | biostudies-other
Project description:Analyzing the microbiome of diverse species and environments using next-generation sequencing techniques has significantly enhanced our understanding on metabolic, physiological and ecological roles of environmental microorganisms. However, the analysis of the microbiome is affected by experimental conditions (e.g. sequencing errors and genomic repeats) and computationally intensive and cumbersome downstream analysis (e.g. quality control, assembly, binning and statistical analyses). Moreover, the introduction of new sequencing technologies and protocols led to a flood of new methodologies, which also have an immediate effect on the results of the analyses. The aim of this work is to review the most important workflows for 16S rRNA sequencing and shotgun and long-read metagenomics, as well as to provide best-practice protocols on experimental design, sample processing, sequencing, assembly, binning, annotation and visualization. To simplify and standardize the computational analysis, we provide a set of best-practice workflows for 16S rRNA and metagenomic sequencing data (available at https://github.com/grimmlab/MicrobiomeBestPracticeReview).
| S-EPMC7820839 | biostudies-literature