Challenges in assessing the process-outcome link in practice.
Ontology highlight
ABSTRACT:
SUBMITTER: Parast L
PROVIDER: S-EPMC4351283 | biostudies-literature | 2015 Mar
REPOSITORIES: biostudies-literature
Publications
Challenges in assessing the process-outcome link in practice.
Parast Layla L Doyle Brian B Damberg Cheryl L CL Shetty Kanaka K Ganz David A DA Wenger Neil S NS Shekelle Paul G PG
Journal of general internal medicine 20150107 3
The expanded use of clinical process-of-care measures to assess the quality of health care in the context of public reporting and pay-for-performance applications has led to a desire to demonstrate the value of such efforts in terms of improved patient outcomes. The inability to observe associations between improved delivery of clinical processes and improved clinical outcomes in practice has raised concerns about the value of holding providers accountable for delivery of clinical processes of c ...[more]
Similar Datasets
Project description:Neurodegeneration has been reported in young animals after exposure to all commonly used general anesthetic agents. The brain may be particularly vulnerable to anesthetic toxicity during peak synaptogenesis (in gestation and infancy). Human studies of long-term neurodevelopmental outcome following general anesthesia in early childhood report contradictory findings. This review assesses the strengths and deficiencies in human research methodologies to inform future studies. We identified 76 studies, published between 1990 and 2017, of long-term neurodevelopmental outcome following early childhood or in utero general anesthesia exposure: 49 retrospective, 9 ambidirectional, 17 prospective cohort studies, and 1 randomized controlled trial. Forty-nine studies were explicitly concerned with anesthetic-induced neurotoxicity. Full texts were appraised for methodological challenges and possible solutions. Major challenges identified included delineating effects of anesthesia from surgery, defining the timing and duration of exposure, selection of a surgical cohort and intervention, addressing multiple confounding life course factors, detecting modest neurotoxic effects with small sample sizes (median, 131 children; interquartile range, 50-372), selection of sensitive neurodevelopmental outcomes at appropriate ages for different developmental domains, insufficient length of follow-up (median age, 6 years; interquartile range, 2-12 years), and sample attrition. We discuss potential solutions to these challenges. Further adequately powered, multicenter, prospective randomized controlled trials of anesthetic-induced neurotoxicity in children are required. However, we believe that the inherent methodological challenges of studying anesthetic-induced neurotoxicity necessitate the parallel use of well-designed observational cohort studies.
| S-EPMC6436726 | biostudies-literature
Project description:Reporting the results of quality indicators can narrow the gap in the quality of care between hospitals. While most studies rely on outcome indicators, they may not accurately measure the quality of care. Process indicators are not only strongly associated with treatment outcomes, but are also more sensitive to whether patients are treated accurately, enabling timely intervention. Our study aims to investigate whether process indicators provide a more reasonable assessment of hospital quality of care compared to outcome indicators. Data were sourced from the Specific Disease Medical Service Quality Management and Control System in China. A total of 113,942 patients with breast cancer treated in 298 hospitals between January 2019 and April 2023 were included in this retrospective study. The rankability of 11 process indicators was calculated and used as a weight to create a new composite indicator. The composite indicators and outcome measures were compared using the O/E ratio categories. Finally, in order to determine the impact of different years on the results, a sensitivity analysis was conducted using bootstrap sampling. The rankability ( ρ ) values of the eleven process indicators showed significant differences, with the highest ρ value for preoperative cytological or histological examination before surgery (0.919). The ρ value for the outcome indicator was 0.011. The rankability-weighting method yielded a comprehensive score ( ρ = 0.883). The comparison with categorical results of the outcome indicator has different performance classifications for 113 hospitals (37.92%) for composite scores and 140 (46.98%) for preoperative cytological or histological examinationbefore surgery. Process indicators are more suitable than outcome indicators for assessing the quality of breast cancer care in hospitals. Healthcare providers can use process indicators to identify specific areas for improvement, thereby driving continuous quality improvement efforts.
| S-EPMC11333708 | biostudies-literature
Project description:BACKGROUND: Dupuytren's disease of the hand is a common condition affecting the palmar fascia, resulting in progressive flexion deformities of the digits and hence limitation of hand function. The optimal treatment remains unclear as outcomes studies have used a variety of measures for assessment. METHODS: A literature search was performed for all publications describing surgical treatment, percutaneous needle aponeurotomy or collagenase injection for primary or recurrent Dupuytren's disease where outcomes had been monitored using functional measures. RESULTS: Ninety-one studies met the inclusion criteria. Twenty-two studies reported outcomes using patient reported outcome measures (PROMs) ranging from validated questionnaires to self-reported measures for return to work and self-rated disability. The Disability of Arm, Shoulder and Hand (DASH) score was the most utilised patient-reported function measure (n=11). Patient satisfaction was reported by eighteen studies but no single method was used consistently. Range of movement was the most frequent physical measure and was reported in all 91 studies. However, the methods of measurement and reporting varied, with seventeen different techniques being used. Other physical measures included grip and pinch strength and sensibility, again with variations in measurement protocols. The mean follow-up time ranged from 2 weeks to 17 years. CONCLUSIONS: There is little consistency in the reporting of outcomes for interventions in patients with Dupuytren's disease, making it impossible to compare the efficacy of different treatment modalities. Although there are limitations to the existing generic patient reported outcomes measures, a combination of these together with a disease-specific questionnaire, and physical measures of active and passive individual joint Range of movement (ROM), grip and sensibility using standardised protocols should be used for future outcomes studies. As Dupuytren's disease tends to recur following treatment as well as extend to involve other areas of the hand, follow-up times should be standardised and designed to capture both short and long term outcomes.
| S-EPMC3637830 | biostudies-other
Project description:The efficacy of neoadjuvant treatment for NSCLC can be pathologically assessed in resected tissue. Major pathologic response (MPR) and pathologic complete response (pCR), defined as less than or equal to 10% and 0% viable tumor cells, respectively, are increasingly being used in NSCLC clinical trials to establish them as surrogate end points for efficacy to shorten time to outcome. Nevertheless, sampling and MPR calculation methods vary between studies. The International Association for the Study of Lung Cancer recently published detailed recommendations for pathologic assessment of NSCLC after neoadjuvant treatment, with methodology being critical. To increase methodological rigor further, we developed a novel MPR calculator tool (MPRCT) for standardized, comprehensive collection of percentages of viable tumor, necrosis, and stroma in the tumor bed. In addition, tumor width and length in the tumor bed are measured and unweighted and weighted MPR averages are calculated, the latter to account for the varying proportions of tumor beds on slides. We propose sampling the entire visible tumor bed for tumors having pCR regardless of size, 100% of tumors less than or equal to 3 cm in diameter, and at least 50% of tumors more than 3 cm. We describe the uses of this tool, including potential formal analyses of MPRCT data to determine the optimum sampling strategy that balances sensitivity against excessive use of resources. Solutions to challenging scenarios in pathologic assessment are proposed. This MPRCT will facilitate standardized, systematic, comprehensive collection of pathologic response data with a standardized methodology to validate studies designed to establish MPR and pCR as surrogate end points of neoadjuvant treatment efficacy.
| S-EPMC9044000 | biostudies-literature
Project description:Whether sunscreen use affects melanoma risk has been widely studied with contradictory results. To answer this question we performed a systematic review of all published studies, accounting for sources of heterogeneity and bias. We searched for original articles investigating the sunscreen-melanoma association in humans to February 28, 2018. We then used random-effects meta-analysis to combine estimates of the association, stratified by study design. Stratified meta-analysis and meta-regression were used to identify sources of heterogeneity. We included 21,069 melanoma cases from 28 studies published 1979-2018: 23 case-control (11 hospital-based, 12 population-based), 1 ecological, 3 cohort and 1 randomised controlled trial (RCT). There was marked heterogeneity across study designs and among case-control studies but adjustment for confounding by sun exposure, sunburns and phenotype systematically moved estimates toward decreased melanoma risk among sunscreen users. Ever- vs. never-use of sunscreen was inversely associated with melanoma in hospital-based case-control studies (adjusted odds ratio (OR) = 0.57, 95%confidence interval (CI) 0.37-0.87, pheterogeneity < 0.001), the ecological study (rate ratio = 0.48, 95%CI 0.35-0.66), and the RCT (hazard ratio (HR) = 0.49, 95%CI 0.24-1.01). It was not associated in population-based case-control studies (OR = 1.17, 95%CI 0.90-1.51, pheterogeneity < 0.001) and was positively associated in the cohort studies (HR = 1.27, 95%CI 1.07-1.51, pheterogeneity = 0.236). The association differed by latitude (pinteraction = 0.042), region (pinteraction = 0.008), adjustment for naevi/freckling (pinteraction = 0.035), and proportion of never-sunscreen-users (pinteraction = 0·012). Evidence from observational studies on sunscreen use and melanoma risk was weak and heterogeneous, consistent with the challenges of controlling for innate confounding by indication. The only RCT showed a protective effect of sunscreen.
| S-EPMC6451658 | biostudies-literature
Project description:Many longitudinal studies often require jointly modeling a biomarker and an event outcome, in order to provide more accurate inference and dynamic prediction of disease progression. Cystic fibrosis (CF) studies have illustrated the benefits of these models, primarily examining the joint evolution of lung-function decline and survival. We propose a novel joint model within the shared-parameter framework that accommodates nonlinear lung-function trajectories, in order to provide more accurate inference on lung-function decline over time and to examine the association between evolution of lung function and risk of a pulmonary exacerbation (PE) event recurrence. Specifically, a two-level Gaussian process (GP) is used to estimate the nonlinear longitudinal trajectories and a flexible link function is introduced for a more accurate depiction of the binary process on the event outcome. Bayesian model assessment is used to evaluate each component of the joint model in simulation studies and an application to longitudinal data on patients receiving care from a CF center. A nonlinear structure is suggested by both longitudinal continuous and binary evaluations. Including a flexible link function improves model fit to these data. The proposed hierarchical GP model with a flexible power link function where Laplace distribution is the baseline (spep) has the best fit of all joint models considered, characterizing how accelerated lung-function decline corresponds to increased odds of experiencing another PE.
| S-EPMC8803535 | biostudies-literature
Project description:Differences in health status at older ages are a result of genetic predispositions and physiological responses to exposure accumulation over the lifespan. These vary across individuals and lead to health status heterogeneity as people age. Chronological age (CA) is a standard indicator that reflects overall risks of morbidity and mortality. However, CA is only a crude proxy for individuals' latent physiological deterioration. An alternative to CA is biological age (BA), an indicator of accumulated age-related biological change reflected in markers of major physiological systems. We propose and validate two BA estimators that improve upon existing ones. These estimators (i) are based on a structural equation model (SEM) that represents the relation between BA and CA, (ii) circumvent the need to impose arbitrary assumptions about the relation between CA and BA, and (iii) provide tools to empirically test the validity of assumptions the researcher may wish to invoke. We use the US National Health and Nutrition Examination Survey 1988-1994 and compare results with three commonly used methods to compute BA (principal components-PCA, multiple regression-MLR, and Klemera-Doubal's method-KD). We show that SEM-based estimates of BA differ significantly from those generated by PCA and MLR and are comparable to, but have better predictive power than KD's. The proposed estimators are flexible, allow testing of assumptions about functional forms relating BA and CA, and admit a rich interpretation as indicators of accelerated aging.
| S-EPMC9896935 | biostudies-literature
Project description:We conducted the Reproducibility Project: Cancer Biology to investigate the replicability of preclinical research in cancer biology. The initial aim of the project was to repeat 193 experiments from 53 high-impact papers, using an approach in which the experimental protocols and plans for data analysis had to be peer reviewed and accepted for publication before experimental work could begin. However, the various barriers and challenges we encountered while designing and conducting the experiments meant that we were only able to repeat 50 experiments from 23 papers. Here we report these barriers and challenges. First, many original papers failed to report key descriptive and inferential statistics: the data needed to compute effect sizes and conduct power analyses was publicly accessible for just 4 of 193 experiments. Moreover, despite contacting the authors of the original papers, we were unable to obtain these data for 68% of the experiments. Second, none of the 193 experiments were described in sufficient detail in the original paper to enable us to design protocols to repeat the experiments, so we had to seek clarifications from the original authors. While authors were extremely or very helpful for 41% of experiments, they were minimally helpful for 9% of experiments, and not at all helpful (or did not respond to us) for 32% of experiments. Third, once experimental work started, 67% of the peer-reviewed protocols required modifications to complete the research and just 41% of those modifications could be implemented. Cumulatively, these three factors limited the number of experiments that could be repeated. This experience draws attention to a basic and fundamental concern about replication - it is hard to assess whether reported findings are credible.
| S-EPMC8651289 | biostudies-literature
Project description:To examine the process and outcomes of care of COPD patients by Advanced Practice Providers (APPs) and primary care physicians.We conducted a cross sectional retrospective cohort study of Medicare beneficiaries with COPD who had at least one hospitalization in 2010. We examined the process measures of receipt of spirometry evaluation, influenza and pneumococcal vaccine, use of COPD medications, and referral to a pulmonary specialist visit. Outcome measures were emergency department (ER) visit, number of hospitalizations and 30-day readmission in 2010.A total of 7,257 Medicare beneficiaries with COPD were included. Of these, 1,999 and 5,258 received primary care from APPs and primary care physicians, respectively. Patients in the APP group were more likely to be white, younger, male, residing in non-metropolitan areas and have fewer comorbidities. In terms of process of care measures, APPs were more likely to prescribe short acting bronchodilators (adjusted odds ratio [aOR] = 1.18, 95%Confidence Interval [CI] 1.05-1.32), oxygen therapy (aOR = 1.25, 95% CI 1.12-1.40) and consult a pulmonary specialist (aOR = 1.39, 95% CI 1.23-1.56), but less likely to give influenza and pneumococcal vaccinations. Patients receiving care from APPs had lower rates of ER visits for COPD (aOR = 0.84, 95%CI 0.71-0.98) and had a higher follow-up rate with pulmonary specialist within 30 days of hospitalization for COPD (aOR = 1.25, 95%CI 1.07-1.48) than those cared for by physicians.Compared to patients cared for by physicians, patients cared for by APPs were more likely to receive short acting bronchodilator, oxygen therapy and been referred to pulmonologist, however they had lower rates of vaccination probably due to lower age group. Patients cared for by APPs were less like to visit an ER for COPD compared to patients care for by physicians, conversely there was no differences in hospitalization or readmission for COPD between MDs and APPs.
| S-EPMC4765888 | biostudies-other
Project description:Homologous recombination (HR) is a fundamental process common to all species. HR aims to faithfully repair DNA double strand breaks. HR involves the formation of nucleoprotein filaments on DNA single strands (ssDNA) resected from the break. The nucleoprotein filaments search for homologous regions in the genome and promote strand exchange with the ssDNA homologous region in an unbroken copy of the genome. HR has been the object of intensive studies for decades. Because multi-scale dynamics is a fundamental aspect of this process, studying HR is highly challenging, both experimentally and using computational approaches. Nevertheless, knowledge has built up over the years and has recently progressed at an accelerated pace, borne by increasingly focused investigations using new techniques such as single molecule approaches. Linking this knowledge to the atomic structure of the nucleoprotein filament systems and the succession of unstable, transient intermediate steps that takes place during the HR process remains a challenge; modeling retains a very strong role in bridging the gap between structures that are stable enough to be observed and in exploring transition paths between these structures. However, working on ever-changing long filament systems submitted to kinetic processes is full of pitfalls. This review presents the modeling tools that are used in such studies, their possibilities and limitations, and reviews the advances in the knowledge of the HR process that have been obtained through modeling. Notably, we will emphasize how cooperative behavior in the HR nucleoprotein filament enables modeling to produce reliable information.
| S-EPMC10573387 | biostudies-literature