Browse
Submit Data
Databases
API
Help

Dataset Information

20 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Effective degrees of freedom: a flawed metaphor.

ABSTRACT: To most applied statisticians, a fitting procedure's degrees of freedom is synonymous with its model complexity, or its capacity for overfitting to data. In particular, it is often used to parameterize the bias-variance tradeoff in model selection. We argue that, on the contrary, model complexity and degrees of freedom may correspond very poorly. We exhibit and theoretically explore various fitting procedures for which degrees of freedom is not monotonic in the model complexity parameter, and can exceed the total dimension of the ambient space even in very simple settings. We show that the degrees of freedom for any non-convex projection method can be unbounded.

SUBMITTER: Janson L

PROVIDER: S-EPMC4787623 | biostudies-literature | 2015 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Effective degrees of freedom: a flawed metaphor.

Janson Lucas L Fithian William W Hastie Trevor J TJ

Biometrika 20150504 2

To most applied statisticians, a fitting procedure's degrees of freedom is synonymous with its model complexity, or its capacity for overfitting to data. In particular, it is often used to parameterize the bias-variance tradeoff in model selection. We argue that, on the contrary, model complexity and degrees of freedom may correspond very poorly. We exhibit and theoretically explore various fitting procedures for which degrees of freedom is not monotonic in the model complexity parameter, and ca ...[more]

PMID: 26977114

Similar Datasets

Effective degrees of freedom of the Pearson's correlation coefficient under autocorrelation.

Project description:The dependence between pairs of time series is commonly quantified by Pearson's correlation. However, if the time series are themselves dependent (i.e. exhibit temporal autocorrelation), the effective degrees of freedom (EDF) are reduced, the standard error of the sample correlation coefficient is biased, and Fisher's transformation fails to stabilise the variance. Since fMRI time series are notoriously autocorrelated, the issue of biased standard errors - before or after Fisher's transformation - becomes vital in individual-level analysis of resting-state functional connectivity (rsFC) and must be addressed anytime a standardised Z-score is computed. We find that the severity of autocorrelation is highly dependent on spatial characteristics of brain regions, such as the size of regions of interest and the spatial location of those regions. We further show that the available EDF estimators make restrictive assumptions that are not supported by the data, resulting in biased rsFC inferences that lead to distorted topological descriptions of the connectome on the individual level. We propose a practical "xDF" method that accounts not only for distinct autocorrelation in each time series, but instantaneous and lagged cross-correlation. We find the xDF correction varies substantially over node pairs, indicating the limitations of global EDF corrections used previously. In addition to extensive synthetic and real data validations, we investigate the impact of this correction on rsFC measures in data from the Young Adult Human Connectome Project, showing that accounting for autocorrelation dramatically changes fundamental graph theoretical measures relative to no correction.

| S-EPMC6693558 | biostudies-literature

The Limits of Effective Degrees of Freedom in UCA based Orbital Angular Momentum Multiplexed Communications.

Project description:Orbital angular momentum (OAM) multiplexing technique has recently emerged and generated widespread interests since the OAM was discovered as a property of electromagnetic wave and acoustic wave. It was widely acknowledged that OAM multiplexing can achieve very high effective degrees of freedom (EDOF) and improve the spectral efficiency in optical, radio and acoustic communications. However, in the field of free-space optical (FSO) communications, it was demonstrated that OAM multiplexing is not the optimal multiplexing technique and the spatial bandwidth product (SBP) limits the EDOF. Is there any EDOF limits of OAM multiplexing in radio and acoustic communications? Could OAM multiplexing be safely scaled to far field? Here, we discover that the azimuthal resolution of OAM mode generator in OAM multiplexing limits its EDOF. Furthermore, we also verify that the OAM multiplexing in radio and acoustic communication fails to enable a long distance transmission and high EDOF simultaneously incurred by the inherently imperfect OAM mode generator.

| S-EPMC7090009 | biostudies-literature

Thermoelectric degrees of freedom determining thermoelectric efficiency.

Project description:For over half a century, the development of thermoelectric materials has based on the dimensionless figure of merit zT , assuming that the efficiency is mainly determined by this single parameter. Here, we show that the thermoelectric conversion efficiency is determined by three independent parameters, Zgen , τ, and β, which we call the three thermoelectric degrees of freedom (DoFs). Zgen is the well-defined mean of the traditional zT under nonzero temperature differences. The two additional parameters τ and β are gradients of material properties and crucial to evaluating the heat current altered by nonzero Thomson heat and asymmetric Joule heat escape. Each parameter is a figure of merit. Therefore, increasing one of the three DoFs leads to higher efficiency. Our finding explains why the single-parameter theory is inaccurate. Further, it suggests an alternative direction in material discovery and device design in thermoelectrics, such as high τ and β, beyond zT .

| S-EPMC8382987 | biostudies-literature

Effective Degrees of Freedom and Its Application to Conditional AIC for Linear Mixed-Effects Models with Correlated Error Structures.

Project description:The effective degrees of freedom is a useful concept for describing model complexity. Recently the number of effective degrees of freedom has been shown to relate to the concept of conditional Akaike information (cAI) in the mixed effects models. This relationship was made explicit under linear mixed-effects models with i.i.d. errors, and later also extended to the generalized linear and the proportional hazards mixed models. We show that under linear mixed-effects models with correlated errors, the number of effective degrees of freedom is asymptotically equal to the trace of the usual `hat' matrix plus the number of parameters in the error covariance matrix. Using it one can define a crude version of the conditional AIC (cAIC), which is known to be inaccurate due to the estimation of unknown variance parameters. We compare this crude version to several corrected versions of cAIC for linear mixed models with correlated errors, including one that is asymptotically unbiased counting for the unknown parameters, but one which is also difficult to compute without specific programming for each case of the error correlation structure.

| S-EPMC4217225 | biostudies-literature

Replicator degrees of freedom allow publication of misleading failures to replicate.

Project description:In recent years, the field of psychology has begun to conduct replication tests on a large scale. Here, we show that "replicator degrees of freedom" make it far too easy to obtain and publish false-negative replication results, even while appearing to adhere to strict methodological standards. Specifically, using data from an ongoing debate, we show that commonly exercised flexibility at the experimental design and data analysis stages of replication testing can make it appear that a finding was not replicated when, in fact, it was. The debate that we focus on is representative, on key dimensions, of a large number of other replication tests in psychology that have been published in recent years, suggesting that the lessons of this analysis may be far reaching. The problems with current practice in replication science that we uncover here are particularly worrisome because they are not adequately addressed by the field's standard remedies, including preregistration. Implications for how the field could develop more effective methodological standards for replication are discussed.

| S-EPMC6925985 | biostudies-literature

Quantum Computation Based on Photons with Three Degrees of Freedom.

Project description:Quantum systems are important resources for quantum computer. Different from previous encoding forms using quantum systems with one degree of freedom (DoF) or two DoFs, we investigate the possibility of photon systems encoding with three DoFs consisting of the polarization DoF and two spatial DoFs. By exploring the optical circular birefringence induced by an NV center in a diamond embedded in the photonic crystal cavity, we propose several hybrid controlled-NOT (hybrid CNOT) gates operating on the two-photon or one-photon system. These hybrid CNOT gates show that three DoFs may be encoded as independent qubits without auxiliary DoFs. Our result provides a useful way to reduce quantum simulation resources by exploring complex quantum systems for quantum applications requiring large qubit systems.

| S-EPMC4865807 | biostudies-other

Coherent conformational degrees of freedom as a structural basis for allosteric communication.

Project description:Conformational changes in allosteric regulation can to a large extent be described as motion along one or a few coherent degrees of freedom. The states involved are inherent to the protein, in the sense that they are visited by the protein also in the absence of effector ligands. Previously, we developed the measure binding leverage to find sites where ligand binding can shift the conformational equilibrium of a protein. Binding leverage is calculated for a set of motion vectors representing independent conformational degrees of freedom. In this paper, to analyze allosteric communication between binding sites, we introduce the concept of leverage coupling, based on the assumption that only pairs of sites that couple to the same conformational degrees of freedom can be allosterically connected. We demonstrate how leverage coupling can be used to analyze allosteric communication in a range of enzymes (regulated by both ligand binding and post-translational modifications) and huge molecular machines such as chaperones. Leverage coupling can be calculated for any protein structure to analyze both biological and latent catalytic and regulatory sites.

| S-EPMC3234217 | biostudies-literature

Optimal control predicts human performance on objects with internal degrees of freedom.

Project description:On a daily basis, humans interact with a vast range of objects and tools. A class of tasks, which can pose a serious challenge to our motor skills, are those that involve manipulating objects with internal degrees of freedom, such as when folding laundry or using a lasso. Here, we use the framework of optimal feedback control to make predictions of how humans should interact with such objects. We confirm the predictions experimentally in a two-dimensional object manipulation task, in which subjects learned to control six different objects with complex dynamics. We show that the non-intuitive behavior observed when controlling objects with internal degrees of freedom can be accounted for by a simple cost function representing a trade-off between effort and accuracy. In addition to using a simple linear, point-mass optimal control model, we also used an optimal control model, which considers the non-linear dynamics of the human arm. We find that the more realistic optimal control model captures aspects of the data that cannot be accounted for by the linear model or other previous theories of motor control. The results suggest that our everyday interactions with objects can be understood by optimality principles and advocate the use of more realistic optimal control models for the study of human motor neuroscience.

| S-EPMC2694986 | biostudies-literature

Cooperative adaptive responses in gene regulatory networks with many degrees of freedom.

Project description:Cells generally adapt to environmental changes by first exhibiting an immediate response and then gradually returning to their original state to achieve homeostasis. Although simple network motifs consisting of a few genes have been shown to exhibit such adaptive dynamics, they do not reflect the complexity of real cells, where the expression of a large number of genes activates or represses other genes, permitting adaptive behaviors. Here, we investigated the responses of gene regulatory networks containing many genes that have undergone numerical evolution to achieve high fitness due to the adaptive response of only a single target gene; this single target gene responds to changes in external inputs and later returns to basal levels. Despite setting a single target, most genes showed adaptive responses after evolution. Such adaptive dynamics were not due to common motifs within a few genes; even without such motifs, almost all genes showed adaptation, albeit sometimes partial adaptation, in the sense that expression levels did not always return to original levels. The genes split into two groups: genes in the first group exhibited an initial increase in expression and then returned to basal levels, while genes in the second group exhibited the opposite changes in expression. From this model, genes in the first group received positive input from other genes within the first group, but negative input from genes in the second group, and vice versa. Thus, the adaptation dynamics of genes from both groups were consolidated. This cooperative adaptive behavior was commonly observed if the number of genes involved was larger than the order of ten. These results have implications in the collective responses of gene expression networks in microarray measurements of yeast Saccharomyces cerevisiae and the significance to the biological homeostasis of systems with many components.

| S-EPMC3616990 | biostudies-literature

SpookyNet: Learning force fields with electronic degrees of freedom and nonlocal effects.

Project description:Machine-learned force fields combine the accuracy of ab initio methods with the efficiency of conventional force fields. However, current machine-learned force fields typically ignore electronic degrees of freedom, such as the total charge or spin state, and assume chemical locality, which is problematic when molecules have inconsistent electronic states, or when nonlocal effects play a significant role. This work introduces SpookyNet, a deep neural network for constructing machine-learned force fields with explicit treatment of electronic degrees of freedom and nonlocality, modeled via self-attention in a transformer architecture. Chemically meaningful inductive biases and analytical corrections built into the network architecture allow it to properly model physical limits. SpookyNet improves upon the current state-of-the-art (or achieves similar performance) on popular quantum chemistry data sets. Notably, it is able to generalize across chemical and conformational space and can leverage the learned chemical insights, e.g. by predicting unknown spin states, thus helping to close a further important remaining gap for today's machine learning models in quantum chemistry.

| S-EPMC8671403 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data