Temporal bias in case-control design: preventing reliable predictions of the future.
Ontology highlight
ABSTRACT:
SUBMITTER: Yuan W
PROVIDER: S-EPMC7889612 | biostudies-literature | 2021 Feb
REPOSITORIES: biostudies-literature
Publications
Temporal bias in case-control design: preventing reliable predictions of the future.
Yuan William W Beaulieu-Jones Brett K BK Yu Kun-Hsing KH Lipnick Scott L SL Palmer Nathan N Loscalzo Joseph J Cai Tianxi T Kohane Isaac S IS
Nature communications 20210217 1
One of the primary tools that researchers use to predict risk is the case-control study. We identify a flaw, temporal bias, that is specific to and uniquely associated with these studies that occurs when the study period is not representative of the data that clinicians have during the diagnostic process. Temporal bias acts to undermine the validity of predictions by over-emphasizing features close to the outcome of interest. We examine the impact of temporal bias across the medical literature, ...[more]
Similar Datasets
Project description:In genetic association studies with densely typed genetic markers, it is often of substantial interest to examine not only the primary phenotype but also the secondary traits for their association with the genetic markers. For more efficient sample ascertainment of the primary phenotype, a case-control design or its variants, such as the extreme-value sampling design for a quantitative trait, are often adopted. The secondary trait analysis without correcting for the sample ascertainment may yield a biased association estimator. We propose a new method aiming at correcting the potential bias due to the inadequate adjustment of the sample ascertainment. The method yields explicit correction formulas that can be used to both screen the genetic markers and rapidly evaluate the sensitivity of the results to the assumed baseline case-prevalence rate in the population. Simulation studies demonstrate good performance of the proposed approach in comparison with the more computationally intensive approaches, such as the compensator approaches and the maximum prospective likelihood approach. We illustrate the application of the approach by analysis of the genetic association of prostate specific antigen in a case-control study of prostate cancer in the African American population.
| S-EPMC4006579 | biostudies-literature
Project description:PURPOSE:The nested case-control study design, in which a fixed number of controls are matched to each case, is often used to analyze exposure-response associations within a cohort. It has become common practice to sample four or five controls per case; however, previous research has shown that in certain instances, significant gains in relative efficiency can be realized when more controls are matched to each case. This study expanded upon this and investigated the effect of (i) the number of cases, (ii) the strength of the exposure-response, and (iii) the skewness of the exposure distribution on the bias and relative efficiency of the conditional likelihood estimator from a nested case-control study. METHODS:Cohorts were simulated and analyzed using conditional logistic regression. RESULTS:The relative efficiency decreased and bias away from the null increased, as the true exposure-response parameter increased and the skewness of the exposure distribution of the risk-sets increased. This became more pronounced when the number of cases in the cohort was small. CONCLUSIONS:Gains in relative efficiency and a reduction in bias can be realized by sampling more than four or five controls per case generally used, especially when there are few cases, a strong exposure-response relation, and a skewed exposure variable.
| S-EPMC4558410 | biostudies-literature
Project description:Any given human individual carries multiple genetic variants that disrupt protein-coding genes, through structural variation, as well as nucleotide variants and indels. Predicting the phenotypic consequences of a gene disruption remains a significant challenge. Current approaches employ information from a range of biological networks to predict which human genes are haploinsufficient (meaning two copies are required for normal function) or essential (meaning at least one copy is required for viability). Using recently available study gene sets, we show that these approaches are strongly biased towards providing accurate predictions for well-studied genes. By contrast, we derive a haploinsufficiency score from a combination of unbiased large-scale high-throughput datasets, including gene co-expression and genetic variation in over 6000 human exomes. Our approach provides a haploinsufficiency prediction for over twice as many genes currently unassociated with papers listed in Pubmed as three commonly-used approaches, and outperforms these approaches for predicting haploinsufficiency for less-studied genes. We also show that fine-tuning the predictor on a set of well-studied 'gold standard' haploinsufficient genes does not improve the prediction for less-studied genes. This new score can readily be used to prioritize gene disruptions resulting from any genetic variant, including copy number variants, indels and single-nucleotide variants.
| S-EPMC4551909 | biostudies-literature
Project description:An inexpensive and reliable method for molecular crystal structure predictions (CSPs) has been developed. The new CSP protocol starts from a two-dimensional graph of crystal's monomer(s) and utilizes no experimental information. Using results of quantum mechanical calculations for molecular dimers, an accurate two-body, rigid-monomer ab initio-based force field (aiFF) for the crystal is developed. Since CSPs with aiFFs are essentially as expensive as with empirical FFs, tens of thousands of plausible polymorphs generated by the crystal packing procedures can be optimized. Here we show the robustness of this protocol which found the experimental crystal within the 20 most stable predicted polymorphs for each of the 15 investigated molecules. The ranking was further refined by performing periodic density-functional theory (DFT) plus dispersion correction (pDFT+D) calculations for these 20 top-ranked polymorphs, resulting in the experimental crystal ranked as number one for all the systems studied (and the second polymorph, if known, ranked in the top few). Alternatively, the polymorphs generated can be used to improve aiFFs, which also leads to rank one predictions. The proposed CSP protocol should result in aiFFs replacing empirical FFs in CSP research.
| S-EPMC9163189 | biostudies-literature
Project description:BackgroundImpact of immeasurable time bias (IMTB) is yet to be examined in self-controlled designs.MethodsWe conducted case-crossover, case-time-control, and case-case-time-control analyses using Korea's healthcare database. Two empirical examples among elderly patients were used: 1) benzodiazepines-hip fracture; 2) benzodiazepines-mortality. For cases, the date of hip fracture diagnosis or death was defined as the index date, and the inherited date of their matched cases for controls or future cases. Exposure was assessed in the 1-30 day (hazard) and 61-90 day (control) windows preceding the index date. A non-missing exposure setting included in- and outpatient prescriptions and the pseudo-outpatient setting included only the outpatients. Conditional logistic regression was done to estimate odds ratios (ORs) with 95% confidence intervals (CIs), where the relative difference in OR among the two settings was calculated to quantify the IMTB.ResultsThe IMTB had negligible impacts in the hip fracture example in the case-crossover (non-missing exposure setting OR 1.27; 95% CI, 1.12-1.44; pseudo-outpatient setting OR 1.21; 95% CI, 1.06-1.39; magnitude 0.05), case-time-control (OR 1.18; 95% CI, 0.98-1.44; OR 1.13; 95% CI, 0.92-1.38; 0.04, respectively), and case-case-time-control analyses (OR 0.99; 95% CI, 0.80-1.23; OR 0.94; 95% CI, 0.75-1.18; 0.05, respectively). In the mortality example, IMTB had significant impacts in the case-crossover (non-missing exposure setting OR 1.44; 95% CI, 1.36-1.52; pseudo-outpatient setting OR 0.72; 95% CI, 0.67-0.78; magnitude 1.00), case-time-control (OR 1.38; 95% CI, 1.26-1.51; OR 0.68; 95% CI, 0.61-0.76; 1.03, respectively), and case-case-time-control analyses (OR 1.27; 95% CI, 1.15-1.40; OR 0.62; 95% CI, 0.55-0.69; 1.05, respectively).ConclusionAlthough IMTB had negligible impacts on the drug's effect on acute events, as these are unlikely to be accompanied with hospitalizations, it negatively biased the drug's effect on mortality, an outcome with prodromal phases, in the three self-controlled designs.
| S-EPMC9794445 | biostudies-literature
Project description:IntroductionSimulation is a valuable and novel tool in the expanding approach to racism and bias education for medical practitioners. We present a simulation case focused on identifying and addressing the implicit bias of a consultant to teach bias mitigation skills and limit harm to patients and families.MethodsLearners were presented with a case of a classic toddler's fracture in an African American child. The learners interacted with an orthopedic resident who insisted on child welfare involvement, with nonspecific and increasingly biased concerns about the child/family. The learners were expected to identify that this case was not concerning for nonaccidental trauma and that the orthopedic resident was demonstrating bias. They were expected to communicate with both the resident and the parent effectively to defuse the situation and prevent harm from reaching the family. A debrief and an anonymous survey followed the case.ResultsSeventy-five learners participated, including pediatric and emergency medicine residents, fellows, attendings, and medical students. After the case, the majority of learners expressed confidence that they could recognize racial bias in the care of a patient (90%), ensure patient care was not influenced by racial bias (88%), and utilize a tool to frame a concern about bias (79%).DiscussionParticipants felt that this simulation was relevant and effective and overall left the experience feeling confident in their abilities to identify and manage racially biased patient care. This anti-racist simulation offers an important skill-building opportunity that has been well received by learners.
| S-EPMC10507144 | biostudies-literature
Project description:Longitudinal clinical investigations often rely on patient reports to screen for postdischarge adverse outcomes events, yet few studies have examined the accuracy of such patient reports.Patients with acute myocardial infarction (MI) in the TRANSLATE-ACS study were asked during structured interviews at 6 weeks, 6 months, and 12 months postdischarge to report any rehospitalizations. The accuracy of patient-reported rehospitalizations within 1 year of postdischarge was determined using claims-based medical bill validation as the reference standard. The cumulative incidence of rehospitalizations was compared when identified by patient report versus medical bills. Patients were categorized by the accuracy in reporting events (accurate, under-, or over- reporters) and characteristics were compared between groups. Among 10 643 MI patients, 4565 (43%) reported 7734 rehospitalizations. The sensitivity and positive predictive value of patient-reported rehospitalizations were low at 67% and 59%, respectively. A higher cumulative incidence of rehospitalization was observed when identified by patient report versus medical bills (43% vs 37%; P<0.001). Overall, 18% of patients over-reported and 10% under-reported the number of hospitalizations. Compared with accurate reporters, under-reporters were more likely to be older, female, African American, unemployed, or a non-high-school graduate, and had greater prevalence of clinical comorbidities such as diabetes and past cardiovascular disease.The accuracy of patient-reported rehospitalizations was low with patients both under- and over-reporting events. Longitudinal clinical research studies need additional mechanisms beyond patient report to accurately identify rehospitalization events.URL: https://clinicaltrials.gov. Unique identifier: NCT01088503.
| S-EPMC4859389 | biostudies-literature
Project description:Survival bias is a long-recognized problem in case-control studies, and many varieties of bias can come under this umbrella term. We focus on one of them, termed Neyman's bias or "prevalence-incidence bias." It occurs in case-control studies when exposure affects both disease and disease-induced mortality, and we give a formula for the observed, biased odds ratio under such conditions. We compare our result with previous investigations into this phenomenon and consider models under which this bias may or may not be important. Finally, we propose three hypothesis tests to identify when Neyman's bias may be present in case-control studies. We apply these tests to three data sets, one of stroke mortality, another of brain tumors, and the last of atrial fibrillation, and find some evidence of Neyman's bias in the former two cases, but not the last case.
| S-EPMC6150474 | biostudies-literature
Project description:Arctic and subarctic ecosystems are experiencing substantial changes in hydrology, vegetation, permafrost conditions, and carbon cycling, in response to climatic change and other anthropogenic drivers, and these changes are likely to continue over this century. The total magnitude of these changes results from multiple interactions among these drivers. Field measurements can address the overall responses to different changing drivers, but are less capable of quantifying the interactions among them. Currently, a comprehensive assessment of the drivers of ecosystem changes, and the magnitude of their direct and indirect impacts on subarctic ecosystems, is missing. The Torneträsk area, in the Swedish subarctic, has an unrivalled history of environmental observation over 100 years, and is one of the most studied sites in the Arctic. In this study, we summarize and rank the drivers of ecosystem change in the Torneträsk area, and propose research priorities identified, by expert assessment, to improve predictions of ecosystem changes. The research priorities identified include understanding impacts on ecosystems brought on by altered frequency and intensity of winter warming events, evapotranspiration rates, rainfall, duration of snow cover and lake-ice, changed soil moisture, and droughts. This case study can help us understand the ongoing ecosystem changes occurring in the Torneträsk area, and contribute to improve predictions of future ecosystem changes at a larger scale. This understanding will provide the basis for the future mitigation and adaptation plans needed in a changing climate.
| S-EPMC7782653 | biostudies-literature
Project description:BackgroundCross-validation tools are used increasingly to validate and compare genetic evaluation methods but analytical properties of cross-validation methods are rarely described. There is also a lack of cross-validation tools for complex problems such as prediction of indirect effects (e.g. maternal effects) or for breeding schemes with small progeny group sizes.ResultsWe derive the expected value of several quadratic forms by comparing genetic evaluations including "partial" and "whole" data. We propose statistics that compare genetic evaluations including "partial" and "whole" data based on differences in means, covariance, and correlation, and term the use of these statistics "method LR" (from linear regression). Contrary to common belief, the regression of true on estimated breeding values is (on expectation) lower than 1 for small or related validation sets, due to family structures. For validation sets that are sufficiently large, we show that these statistics yield estimators of bias, slope or dispersion, and population accuracy for estimated breeding values. Similar results hold for prediction of future phenotypes although we show that estimates of bias, slope or dispersion using prediction of future phenotypes are sensitive to incorrect heritabilities or precorrection for fixed effects. We present an example for a set of 2111 Brahman beef cattle for which, in repeated partitioning of the data into training and validation sets, there is very good agreement of statistics of method LR with prediction of future phenotypes.ConclusionsAnalytical properties of cross-validation measures are presented. We present a new method named LR for cross-validation that is automatic, easy to use, and which yields the quantities of interest. The method compares predictions based on partial and whole data, which results in estimates of accuracy and biases. Prediction of observed records may yield biased results due to precorrection or use of incorrect heritabilities.
| S-EPMC6219059 | biostudies-literature