Dataset Information

Predicting the accuracy of genomic predictions.

ABSTRACT:

Background

Mathematical models are needed for the design of breeding programs using genomic prediction. While deterministic models for selection on pedigree-based estimates of breeding values (PEBV) are available, these have not been fully developed for genomic selection, with a key missing component being the accuracy of genomic EBV (GEBV) of selection candidates. Here, a deterministic method was developed to predict this accuracy within a closed breeding population based on the accuracy of GEBV and PEBV in the reference population and the distance of selection candidates from their closest ancestors in the reference population.

Methods

The accuracy of GEBV was modeled as a combination of the accuracy of PEBV and of EBV based on genomic relationships deviated from pedigree (DEBV). Loss of the accuracy of DEBV from the reference to the target population was modeled based on the effective number of independent chromosome segments in the reference population (M_e). Measures of M_e derived from the inverse of the variance of relationships and from the accuracies of GEBV and PEBV in the reference population, derived using either a Fisher information or a selection index approach, were compared by simulation.

Results

Using simulation, both the Fisher and the selection index approach correctly predicted accuracy in the target population over time, both with and without selection. The index approach, however, resulted in estimates of M_e that were less affected by heritability, reference size, and selection, and which are, therefore, more appropriate as a population parameter. The variance of relationships underpredicted M_e and was greatly affected by selection. A leave-one-out cross-validation approach was proposed to estimate required accuracies of EBV in the reference population. Aspects of the methods were validated using real data.

Conclusions

A deterministic method was developed to predict the accuracy of GEBV in selection candidates in a closed breeding population. The population parameter M_e that is required for these predictions can be derived from an available reference data set, and applied to other reference data sets and traits for that population. This method can be used to evaluate the benefit of genomic prediction and to optimize genomic selection breeding programs.

SUBMITTER: Dekkers JCM

PROVIDER: S-EPMC8244147 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND: Nellore cattle play an important role in beef production in tropical systems and there is great interest in determining if genomic selection can contribute to accelerate genetic improvement of production and fertility in this breed. We present the first results of the implementation of genomic prediction in a Bos indicus (Nellore) population. METHODS: Influential bulls were genotyped with the Illumina Bovine HD chip in order to assess genomic predictive ability for weight and carcass traits, gestation length, scrotal circumference and two selection indices. 685 samples and 320 238 single nucleotide polymorphisms (SNPs) were used in the analyses. A forward-prediction scheme was adopted to predict the genomic breeding values (DGV). In the training step, the estimated breeding values (EBV) of bulls were deregressed (dEBV) and used as pseudo-phenotypes to estimate marker effects using four methods: genomic BLUP with or without a residual polygenic effect (GBLUP20 and GBLUP0, respectively), a mixture model (Bayes C) and Bayesian LASSO (BLASSO). Empirical accuracies of the resulting genomic predictions were assessed based on the correlation between DGV and dEBV for the testing group. RESULTS: Accuracies of genomic predictions ranged from 0.17 (navel at weaning) to 0.74 (finishing precocity). Across traits, Bayesian regression models (Bayes C and BLASSO) were more accurate than GBLUP. The average empirical accuracies were 0.39 (GBLUP0), 0.40 (GBLUP20) and 0.44 (Bayes C and BLASSO). Bayes C and BLASSO tended to produce deflated predictions (i.e. slope of the regression of dEBV on DGV greater than 1). Further analyses suggested that higher-than-expected accuracies were observed for traits for which EBV means differed significantly between two breeding subgroups that were identified in a principal component analysis based on genomic relationships. CONCLUSIONS: Bayesian regression models are of interest for future applications of genomic selection in this population, but further improvements are needed to reduce deflation of their predictions. Recurrent updates of the training population would be required to enable accurate prediction of the genetic merit of young animals. The technical feasibility of applying genomic prediction in a Bos indicus (Nellore) population was demonstrated. Further research is needed to permit cost-effective selection decisions using genomic information.

Project description:BackgroundImproving feedlot performance, carcase weight and quality is a primary goal of the beef industry worldwide. Here, we used data from 3408 Australian Angus steers from seven years of birth (YOB) cohorts (2011-2017) with a minimal level of sire linkage and that were genotyped for 45,152 SNPs. Phenotypic records included two feedlot and five carcase traits, namely average daily gain (ADG), average daily dry matter intake (DMI), carcase weight (CWT), carcase eye muscle area (EMA), carcase Meat Standard Australia marbling score (MBL), carcase ossification score (OSS) and carcase subcutaneous rib fat depth (RIB). Using a 7-way cross-validation based on YOB cohorts, we tested the quality of genomic predictions using the linear regression (LR) method compared to the traditional method (Pearson's correlation between the genomic estimated breeding value (GEBV) and its associated adjusted phenotype divided by the square root of heritability); explored the factors, such as heritability, validation cohort, and phenotype that affect estimates of accuracy, bias, and dispersion calculated with the LR method; and suggested a novel interpretation for translating differences in accuracy into phenotypic differences, based on GEBV quartiles (Q1Q4).ResultsHeritability (h2) estimates were generally moderate to high (from 0.29 for ADG to 0.53 for CWT). We found a strong correlation (0.73, P-value < 0.001) between accuracies using the traditional method and those using the LR method, although the LR method was less affected by random variation within and across years and showed a better ability to discriminate between extreme GEBV quartiles. We confirmed that bias of GEBV was not significantly affected by h2, validation cohort or trait. Similarly, validation cohort was not a significant source of variation for any of the GEBV quality metrics. Finally, we observed that the phenotypic differences were larger for higher accuracies.ConclusionsOur estimates of h2 and GEBV quality metrics suggest a potential for accurate genomic selection of Australian Angus for feedlot performance and carcase traits. In addition, the Q1Q4 measure presented here easily translates into possible gains of genomic selection in terms of phenotypic differences and thus provides a more tangible output for commercial beef cattle producers.

Project description:Interpreting the clinical consequences of genetic variants is the central problem in modern clinical genomics, for both hereditary diseases and oncology. However, clinical validation lags behind the pace of discovery, leading to distressing uncertainty for patients, physicians and researchers. This "interpretation gap" changes over time as evidence accumulates, and variants initially deemed of uncertain (VUS) significance may be subsequently reclassified in pathogenic/benign. We previously developed RENOVO, a random forest-based tool able to predict variant pathogenicity based on publicly available information from GnomAD and dbNFSP, and tested on variants that have changed their classification status over time. Here, we comprehensively evaluated the accuracy of RENOVO predictions on variants that have been reclassified over the last four years. we retrieved 16 retrospective instances of the ClinVar database, every 3 months since March 2020 to March 2024, and analyzed time trends of variant classifications. We identified variants that changed their status over time and compared RENOVO predictions generated in 2020 with the actual reclassifications. VUS have become the most represented class in ClinVar (44.97% vs. 9.75% (likely) pathogenic and 40,33% (likely) benign). The rate of VUS reclassification is linear and slow compared to the rate of VUS reporting, exponential and currently ~ 30x faster, creating a growing divide between what can be sequenced vs. what can be interpreted. Out of 10,196 VUS variants in January 2020 that have undergone a clinically meaningful reclassification to march 2024, RENOVO correctly classified 82.6% in 2020. In addition, RENOVO correctly identified the majority of the few variants that switched clinically meaningful classes (e.g., from benign to pathogenic and vice versa). We highlight variant classes and clinically relevant genes for which RENOVO provides particularly accurate estimates. In particularly, genes characterized by large prevalence of high- or low-impact variants (e.g., POLE, NOTCH1, FANCM etc.). Suboptimal RENOVO predictions mostly concern genes validated through dedicated consortia (e.g., BRCA1/2), in which RENOVO would anyway have a limited impact. Time trend analysis demonstrates that the current model of variant interpretation cannot keep up with variant discovery. Machine learning-based tools like RENOVO confirm high accuracy that can aid in clinical practice and research.

Project description:Detecting and evaluating errors in action execution is essential for learning. Through complex interactions of the inverse and the forward model, the human motor system can predict and subsequently adjust ongoing or subsequent actions. Inputs to such a prediction are efferent and afferent signals from various sources. The aim of the current study was to examine the impact of visual as well as a combination of efferent and proprioceptive input signals to error prediction in a complex motor task. Predicting motor errors has been shown to be correlated with a neural signal known as the error-related negativity (Ne/ERN). Here, we tested how the Ne/ERN amplitude was modulated by the availability of different sensory signals in a semi-virtual throwing task where the action outcome (hit or miss of the target) was temporally delayed relative to movement execution allowing participants to form predictions about the outcome prior to the availability of knowledge of results. 19 participants practiced the task and electroencephalogram was recorded in two test conditions. In the Visual condition, participants received only visual input by passively observing the throwing movement. In the EffProp condition, participants actively executed the task while visual information about the real and the virtual effector was occluded. Hence, only efferent and proprioceptive signals were available. Results show a significant modulation of the Ne/ERN in the Visual condition while no effect could be observed in the EffProp condition. In addition, amplitudes of the feedback-related negativity in response to the actual outcome feedback were found to be inversely related to the Ne/ERN amplitudes. Our findings indicate that error prediction is modulated by the availability of input signals to the forward model. The observed amplitudes were found to be attenuated in comparison to previous studies, in which all efferent and sensory inputs were present. Furthermore, we assume that visual signals are weighted higher than proprioceptive signals, at least in goal-oriented tasks with visual targets.