Challenges in assessing the process-outcome link in practice.
Ontology highlight
ABSTRACT:
SUBMITTER: Parast L
PROVIDER: S-EPMC4351283 | biostudies-literature | 2015 Mar
REPOSITORIES: biostudies-literature
Publications
Challenges in assessing the process-outcome link in practice.
Parast Layla L Doyle Brian B Damberg Cheryl L CL Shetty Kanaka K Ganz David A DA Wenger Neil S NS Shekelle Paul G PG
Journal of general internal medicine 20150107 3
The expanded use of clinical process-of-care measures to assess the quality of health care in the context of public reporting and pay-for-performance applications has led to a desire to demonstrate the value of such efforts in terms of improved patient outcomes. The inability to observe associations between improved delivery of clinical processes and improved clinical outcomes in practice has raised concerns about the value of holding providers accountable for delivery of clinical processes of c ...[more]
Similar Datasets
Project description:Neurodegeneration has been reported in young animals after exposure to all commonly used general anesthetic agents. The brain may be particularly vulnerable to anesthetic toxicity during peak synaptogenesis (in gestation and infancy). Human studies of long-term neurodevelopmental outcome following general anesthesia in early childhood report contradictory findings. This review assesses the strengths and deficiencies in human research methodologies to inform future studies. We identified 76 studies, published between 1990 and 2017, of long-term neurodevelopmental outcome following early childhood or in utero general anesthesia exposure: 49 retrospective, 9 ambidirectional, 17 prospective cohort studies, and 1 randomized controlled trial. Forty-nine studies were explicitly concerned with anesthetic-induced neurotoxicity. Full texts were appraised for methodological challenges and possible solutions. Major challenges identified included delineating effects of anesthesia from surgery, defining the timing and duration of exposure, selection of a surgical cohort and intervention, addressing multiple confounding life course factors, detecting modest neurotoxic effects with small sample sizes (median, 131 children; interquartile range, 50-372), selection of sensitive neurodevelopmental outcomes at appropriate ages for different developmental domains, insufficient length of follow-up (median age, 6 years; interquartile range, 2-12 years), and sample attrition. We discuss potential solutions to these challenges. Further adequately powered, multicenter, prospective randomized controlled trials of anesthetic-induced neurotoxicity in children are required. However, we believe that the inherent methodological challenges of studying anesthetic-induced neurotoxicity necessitate the parallel use of well-designed observational cohort studies.
| S-EPMC6436726 | biostudies-literature
Project description:BACKGROUND: Dupuytren's disease of the hand is a common condition affecting the palmar fascia, resulting in progressive flexion deformities of the digits and hence limitation of hand function. The optimal treatment remains unclear as outcomes studies have used a variety of measures for assessment. METHODS: A literature search was performed for all publications describing surgical treatment, percutaneous needle aponeurotomy or collagenase injection for primary or recurrent Dupuytren's disease where outcomes had been monitored using functional measures. RESULTS: Ninety-one studies met the inclusion criteria. Twenty-two studies reported outcomes using patient reported outcome measures (PROMs) ranging from validated questionnaires to self-reported measures for return to work and self-rated disability. The Disability of Arm, Shoulder and Hand (DASH) score was the most utilised patient-reported function measure (n=11). Patient satisfaction was reported by eighteen studies but no single method was used consistently. Range of movement was the most frequent physical measure and was reported in all 91 studies. However, the methods of measurement and reporting varied, with seventeen different techniques being used. Other physical measures included grip and pinch strength and sensibility, again with variations in measurement protocols. The mean follow-up time ranged from 2 weeks to 17 years. CONCLUSIONS: There is little consistency in the reporting of outcomes for interventions in patients with Dupuytren's disease, making it impossible to compare the efficacy of different treatment modalities. Although there are limitations to the existing generic patient reported outcomes measures, a combination of these together with a disease-specific questionnaire, and physical measures of active and passive individual joint Range of movement (ROM), grip and sensibility using standardised protocols should be used for future outcomes studies. As Dupuytren's disease tends to recur following treatment as well as extend to involve other areas of the hand, follow-up times should be standardised and designed to capture both short and long term outcomes.
| S-EPMC3637830 | biostudies-other
Project description:The efficacy of neoadjuvant treatment for NSCLC can be pathologically assessed in resected tissue. Major pathologic response (MPR) and pathologic complete response (pCR), defined as less than or equal to 10% and 0% viable tumor cells, respectively, are increasingly being used in NSCLC clinical trials to establish them as surrogate end points for efficacy to shorten time to outcome. Nevertheless, sampling and MPR calculation methods vary between studies. The International Association for the Study of Lung Cancer recently published detailed recommendations for pathologic assessment of NSCLC after neoadjuvant treatment, with methodology being critical. To increase methodological rigor further, we developed a novel MPR calculator tool (MPRCT) for standardized, comprehensive collection of percentages of viable tumor, necrosis, and stroma in the tumor bed. In addition, tumor width and length in the tumor bed are measured and unweighted and weighted MPR averages are calculated, the latter to account for the varying proportions of tumor beds on slides. We propose sampling the entire visible tumor bed for tumors having pCR regardless of size, 100% of tumors less than or equal to 3 cm in diameter, and at least 50% of tumors more than 3 cm. We describe the uses of this tool, including potential formal analyses of MPRCT data to determine the optimum sampling strategy that balances sensitivity against excessive use of resources. Solutions to challenging scenarios in pathologic assessment are proposed. This MPRCT will facilitate standardized, systematic, comprehensive collection of pathologic response data with a standardized methodology to validate studies designed to establish MPR and pCR as surrogate end points of neoadjuvant treatment efficacy.
| S-EPMC9044000 | biostudies-literature
Project description:Whether sunscreen use affects melanoma risk has been widely studied with contradictory results. To answer this question we performed a systematic review of all published studies, accounting for sources of heterogeneity and bias. We searched for original articles investigating the sunscreen-melanoma association in humans to February 28, 2018. We then used random-effects meta-analysis to combine estimates of the association, stratified by study design. Stratified meta-analysis and meta-regression were used to identify sources of heterogeneity. We included 21,069 melanoma cases from 28 studies published 1979-2018: 23 case-control (11 hospital-based, 12 population-based), 1 ecological, 3 cohort and 1 randomised controlled trial (RCT). There was marked heterogeneity across study designs and among case-control studies but adjustment for confounding by sun exposure, sunburns and phenotype systematically moved estimates toward decreased melanoma risk among sunscreen users. Ever- vs. never-use of sunscreen was inversely associated with melanoma in hospital-based case-control studies (adjusted odds ratio (OR) = 0.57, 95%confidence interval (CI) 0.37-0.87, pheterogeneity < 0.001), the ecological study (rate ratio = 0.48, 95%CI 0.35-0.66), and the RCT (hazard ratio (HR) = 0.49, 95%CI 0.24-1.01). It was not associated in population-based case-control studies (OR = 1.17, 95%CI 0.90-1.51, pheterogeneity < 0.001) and was positively associated in the cohort studies (HR = 1.27, 95%CI 1.07-1.51, pheterogeneity = 0.236). The association differed by latitude (pinteraction = 0.042), region (pinteraction = 0.008), adjustment for naevi/freckling (pinteraction = 0.035), and proportion of never-sunscreen-users (pinteraction = 0·012). Evidence from observational studies on sunscreen use and melanoma risk was weak and heterogeneous, consistent with the challenges of controlling for innate confounding by indication. The only RCT showed a protective effect of sunscreen.
| S-EPMC6451658 | biostudies-literature
Project description:We conducted the Reproducibility Project: Cancer Biology to investigate the replicability of preclinical research in cancer biology. The initial aim of the project was to repeat 193 experiments from 53 high-impact papers, using an approach in which the experimental protocols and plans for data analysis had to be peer reviewed and accepted for publication before experimental work could begin. However, the various barriers and challenges we encountered while designing and conducting the experiments meant that we were only able to repeat 50 experiments from 23 papers. Here we report these barriers and challenges. First, many original papers failed to report key descriptive and inferential statistics: the data needed to compute effect sizes and conduct power analyses was publicly accessible for just 4 of 193 experiments. Moreover, despite contacting the authors of the original papers, we were unable to obtain these data for 68% of the experiments. Second, none of the 193 experiments were described in sufficient detail in the original paper to enable us to design protocols to repeat the experiments, so we had to seek clarifications from the original authors. While authors were extremely or very helpful for 41% of experiments, they were minimally helpful for 9% of experiments, and not at all helpful (or did not respond to us) for 32% of experiments. Third, once experimental work started, 67% of the peer-reviewed protocols required modifications to complete the research and just 41% of those modifications could be implemented. Cumulatively, these three factors limited the number of experiments that could be repeated. This experience draws attention to a basic and fundamental concern about replication - it is hard to assess whether reported findings are credible.
| S-EPMC8651289 | biostudies-literature
Project description:Many longitudinal studies often require jointly modeling a biomarker and an event outcome, in order to provide more accurate inference and dynamic prediction of disease progression. Cystic fibrosis (CF) studies have illustrated the benefits of these models, primarily examining the joint evolution of lung-function decline and survival. We propose a novel joint model within the shared-parameter framework that accommodates nonlinear lung-function trajectories, in order to provide more accurate inference on lung-function decline over time and to examine the association between evolution of lung function and risk of a pulmonary exacerbation (PE) event recurrence. Specifically, a two-level Gaussian process (GP) is used to estimate the nonlinear longitudinal trajectories and a flexible link function is introduced for a more accurate depiction of the binary process on the event outcome. Bayesian model assessment is used to evaluate each component of the joint model in simulation studies and an application to longitudinal data on patients receiving care from a CF center. A nonlinear structure is suggested by both longitudinal continuous and binary evaluations. Including a flexible link function improves model fit to these data. The proposed hierarchical GP model with a flexible power link function where Laplace distribution is the baseline (spep) has the best fit of all joint models considered, characterizing how accelerated lung-function decline corresponds to increased odds of experiencing another PE.
| S-EPMC8803535 | biostudies-literature
Project description:To examine the process and outcomes of care of COPD patients by Advanced Practice Providers (APPs) and primary care physicians.We conducted a cross sectional retrospective cohort study of Medicare beneficiaries with COPD who had at least one hospitalization in 2010. We examined the process measures of receipt of spirometry evaluation, influenza and pneumococcal vaccine, use of COPD medications, and referral to a pulmonary specialist visit. Outcome measures were emergency department (ER) visit, number of hospitalizations and 30-day readmission in 2010.A total of 7,257 Medicare beneficiaries with COPD were included. Of these, 1,999 and 5,258 received primary care from APPs and primary care physicians, respectively. Patients in the APP group were more likely to be white, younger, male, residing in non-metropolitan areas and have fewer comorbidities. In terms of process of care measures, APPs were more likely to prescribe short acting bronchodilators (adjusted odds ratio [aOR] = 1.18, 95%Confidence Interval [CI] 1.05-1.32), oxygen therapy (aOR = 1.25, 95% CI 1.12-1.40) and consult a pulmonary specialist (aOR = 1.39, 95% CI 1.23-1.56), but less likely to give influenza and pneumococcal vaccinations. Patients receiving care from APPs had lower rates of ER visits for COPD (aOR = 0.84, 95%CI 0.71-0.98) and had a higher follow-up rate with pulmonary specialist within 30 days of hospitalization for COPD (aOR = 1.25, 95%CI 1.07-1.48) than those cared for by physicians.Compared to patients cared for by physicians, patients cared for by APPs were more likely to receive short acting bronchodilator, oxygen therapy and been referred to pulmonologist, however they had lower rates of vaccination probably due to lower age group. Patients cared for by APPs were less like to visit an ER for COPD compared to patients care for by physicians, conversely there was no differences in hospitalization or readmission for COPD between MDs and APPs.
| S-EPMC4765888 | biostudies-other
Project description:Clinical research infrastructure is one of the unsung heroes of the scientific response to the current COVID-19 pandemic. The extensive, long-term funding into research support structures, skilled people, and technology allowed the United Kingdom research response to move off the starting blocks at pace by utilizing pre-existing platforms. The increasing focus from funders on evaluating the outcomes and impact of research infrastructure investment requires both a reframing and progression of the current models in order to address the contribution of the underlying support infrastructure. The majority of current evaluation/outcome models focus on a "pipeline" approach using a methodology which follows the traditional research funding route with the addition of quantitative metrics. These models fail to embrace the complexity caused by the interplay of previous investment, the coalescing of project outputs from different funders, the underlying infrastructure investment, and the parallel development across different parts of the system. Research infrastructure is the underpinning foundation of a project-driven research system and requires long-term, sustained funding and capital investment to maintain scientific and technological expertise. Therefore, the short-term focus on quantitative metrics that are easy to collect and interpret and that can be assessed in a roughly 5-year funding cycle needs to be addressed. The significant level of investment in research infrastructure necessitates investment to develop bespoke methodologies that develop fit-for-purpose, longer-term/continual approach(es) to evaluation. Real-world research should reflect real-world evaluation and allow for the accrual of a narrative of value indicators that build a picture of the contribution of infrastructure to research outcomes. The linear approach is not fit for purpose, the research endeavour is a complex, twisted road, and the evaluation approach needs to embrace this complexity through the development of realist approaches and the rapidly evolving data ecosystem. This paper sets out methodological challenges and considers the need to develop bespoke methodological approaches to allow a richer assessment of impact, contribution, attribution, and evaluation of research infrastructure. This paper is the beginning of a conversation that invites the community to "take up the mantle" and tackle the complexity of real-world research translation and evaluation.
| S-EPMC8371591 | biostudies-literature
Project description:Strategies and Opportunities to STOP Colon Cancer in Priority Populations (STOP CRC) was a pragmatic cluster-randomized trial conducted at federally qualified health centers and designed to "Reach" as many unscreened patients as possible by directly mailing them fecal screening tests. STOP CRC used an electronic health record registry to identify individuals' needing CRC screening and mail interventions to them. The registry was updated daily removing individuals completing CRC screening or those who no longer were clinic patients. Reach, a component RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance), is defined as the absolute number, percent, and representativeness of individuals "willing to participate in" or "exposed to" an initiative. We describe the complexities of measuring Reach in a pragmatic trial. Overall 21,134 patients were on the registry list for at least one day, with 18,226 remaining after removing patients completing screening before any mailings. Observed Reached (the percent of individuals exposed to the intervention) using each denominator was 30.7% and 35.6% respectively. Reach improved only modestly after accounting for factors that made it impossible for clinics to send mailings. Few differences were observed in demographic and health care utilization factors among individuals Reached versus not Reached, suggesting that health center Implementation was more influential than patients' willingness or ability to participate. A pragmatic definition of Reach that accounted for dynamic changes the absolute number eligible and the proportion exposed was more useful than traditional definitions of Reach. Actual Reach was dependent on Implementation and not patient level characteristics. Clinical Trials Registration Number: ClincalTrials.gov (NCT01742065).
| S-EPMC6558213 | biostudies-literature
Project description:In many scientific fields, it is a common practice to collect a sequence of 0-1 binary responses from a subject across time, space, or a collection of covariates. Researchers are interested in finding out how the expected binary outcome is related to covariates, and aim at better prediction in the future 0-1 outcomes. Gaussian processes have been widely used to model nonlinear systems; in particular to model the latent structure in a binary regression model allowing nonlinear functional relationship between covariates and the expectation of binary outcomes. A critical issue in modeling binary response data is the appropriate choice of link functions. Commonly adopted link functions such as probit or logit links have fixed skewness and lack the flexibility to allow the data to determine the degree of the skewness. To address this limitation, we propose a flexible binary regression model which combines a generalized extreme value link function with a Gaussian process prior on the latent structure. Bayesian computation is employed in model estimation. Posterior consistency of the resulting posterior distribution is demonstrated. The flexibility and gains of the proposed model are illustrated through detailed simulation studies and two real data examples. Empirical results show that the proposed model outperforms a set of alternative models, which only have either a Gaussian process prior on the latent regression function or a Dirichlet prior on the link function.
| S-EPMC4914475 | biostudies-literature