Browse
Submit Data
Databases
API
Help

Dataset Information

12 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

The Fermi-Dirac distribution provides a calibrated probabilistic output for binary classifiers.

ABSTRACT: Binary classification is one of the central problems in machine-learning research and, as such, investigations of its general statistical properties are of interest. We studied the ranking statistics of items in binary classification problems and observed that there is a formal and surprising relationship between the probability of a sample belonging to one of the two classes and the Fermi-Dirac distribution determining the probability that a fermion occupies a given single-particle quantum state in a physical system of noninteracting fermions. Using this equivalence, it is possible to compute a calibrated probabilistic output for binary classifiers. We show that the area under the receiver operating characteristics curve (AUC) in a classification problem is related to the temperature of an equivalent physical system. In a similar manner, the optimal decision threshold between the two classes is associated with the chemical potential of an equivalent physical system. Using our framework, we also derive a closed-form expression to calculate the variance for the AUC of a classifier. Finally, we introduce FiDEL (Fermi-Dirac-based ensemble learning), an ensemble learning algorithm that uses the calibrated nature of the classifier's output probability to combine possibly very different classifiers.

SUBMITTER: Kim SC

PROVIDER: S-EPMC8403970 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Fermi-arc supercurrent oscillations in Dirac semimetal Josephson junctions.

Project description:One prominent hallmark of topological semimetals is the existence of unusual topological surface states known as Fermi arcs. Nevertheless, the Fermi-arc superconductivity remains elusive. Here, we report the critical current oscillations from surface Fermi arcs in Nb-Dirac semimetal Cd3As2-Nb Josephson junctions. The supercurrent from bulk states are suppressed under an in-plane magnetic field ~0.1 T, while the supercurrent from the topological surface states survives up to 0.5 T. Contrary to the minimum normal-state conductance, the Fermi-arc carried supercurrent shows a maximum critical value near the Dirac point, which is consistent with the fact that the Fermi arcs have maximum density of state at the Dirac point. Moreover, the critical current exhibits periodic oscillations with a parallel magnetic field, which is well understood by considering the in-plane orbital effect from the surface states. Our results suggest the Dirac semimetal combined with superconductivity should be promising for topological quantum devices.

| S-EPMC7051961 | biostudies-literature

Probabilistic classifiers with high-dimensional data.

Project description:For medical classification problems, it is often desirable to have a probability associated with each class. Probabilistic classifiers have received relatively little attention for small n large p classification problems despite of their importance in medical decision making. In this paper, we introduce 2 criteria for assessment of probabilistic classifiers: well-calibratedness and refinement and develop corresponding evaluation measures. We evaluated several published high-dimensional probabilistic classifiers and developed 2 extensions of the Bayesian compound covariate classifier. Based on simulation studies and analysis of gene expression microarray data, we found that proper probabilistic classification is more difficult than deterministic classification. It is important to ensure that a probabilistic classifier is well calibrated or at least not "anticonservative" using the methods developed here. We provide this evaluation for several probabilistic classifiers and also evaluate their refinement as a function of sample size under weak and strong signal conditions. We also present a cross-validation method for evaluating the calibration and refinement of any probabilistic classifier on any data set.

| S-EPMC3138069 | biostudies-literature

Stable reliability diagrams for probabilistic classifiers.

Project description:A probability forecast or probabilistic classifier is reliable or calibrated if the predicted probabilities are matched by ex post observed frequencies, as examined visually in reliability diagrams. The classical binning and counting approach to plotting reliability diagrams has been hampered by a lack of stability under unavoidable, ad hoc implementation decisions. Here, we introduce the CORP approach, which generates provably statistically consistent, optimally binned, and reproducible reliability diagrams in an automated way. CORP is based on nonparametric isotonic regression and implemented via the pool-adjacent-violators (PAV) algorithm-essentially, the CORP reliability diagram shows the graph of the PAV-(re)calibrated forecast probabilities. The CORP approach allows for uncertainty quantification via either resampling techniques or asymptotic theory, furnishes a numerical measure of miscalibration, and provides a CORP-based Brier-score decomposition that generalizes to any proper scoring rule. We anticipate that judicious uses of the PAV algorithm yield improved tools for diagnostics and inference for a very wide range of statistical and machine learning methods.

| S-EPMC7923594 | biostudies-literature

Strong and fragile topological Dirac semimetals with higher-order Fermi arcs.

Project description:Dirac and Weyl semimetals both exhibit arc-like surface states. However, whereas the surface Fermi arcs in Weyl semimetals are topological consequences of the Weyl points themselves, the surface Fermi arcs in Dirac semimetals are not directly related to the bulk Dirac points, raising the question of whether there exists a topological bulk-boundary correspondence for Dirac semimetals. In this work, we discover that strong and fragile topological Dirac semimetals exhibit one-dimensional (1D) higher-order hinge Fermi arcs (HOFAs) as universal, direct consequences of their bulk 3D Dirac points. To predict HOFAs coexisting with topological surface states in solid-state Dirac semimetals, we introduce and layer a spinful model of an s-d-hybridized quadrupole insulator (QI). We develop a rigorous nested Jackiw-Rebbi formulation of QIs and HOFA states. Employing ab initio calculations, we demonstrate HOFAs in both the room- (α) and intermediate-temperature (α″) phases of Cd3As2, KMgBi, and rutile-structure ([Formula: see text]-) PtO2.

| S-EPMC6994491 | biostudies-literature

Dirac semimetal in ?-CuI without surface Fermi arcs.

Project description:Anomalous surface states with Fermi arcs are commonly considered to be a fingerprint of Dirac semimetals (DSMs). In contrast to Weyl semimetals, however, Fermi arcs of DSMs are not topologically protected. Using first-principles calculations, we predict that ?-cuprous iodide (?-CuI) is a peculiar DSM whose surface states form closed Fermi pockets instead of Fermi arcs. In such a fermiological Dirac semimetal, the deformation mechanism from Fermi arcs to Fermi pockets stems from a large cubic term preserving all crystal symmetries and from the small energy difference between the surface and bulk Dirac points. The cubic term in ?-CuI, usually negligible in prototypical DSMs, becomes relevant because of the particular crystal structure. As such, we establish a concrete material example manifesting the lack of topological protection for surface Fermi arcs in DSMs.

| S-EPMC6099897 | biostudies-other

Universal Fermi-surface anisotropy renormalization for interacting Dirac fermions with long-range interactions.

Project description:Recent experimental [I. Jo et al, Phys. Rev. Lett. 119, 016402 (2017)] and numerical [M. Ippoliti, S. D. Geraedts, R. N. Bhatt, Phys. Rev. B 95, 201104 (2017)] evidence suggests an intriguing universal relationship between the Fermi surface anisotropy of the noninteracting parent 2-dimensional (2D) electron gas and the strongly correlated composite Fermi liquid formed in a strong magnetic field close to half-filling. Inspired by these observations, we explore more generally the question of anisotropy renormalization in interacting 2D Fermi systems. Using a recently developed [H. -K. Tang et al, Science 361, 570 (2018)] nonperturbative and numerically exact projective quantum Monte Carlo simulation as well as other numerical and analytic techniques, only for Dirac fermions with long-range Coulomb interactions do we find a universal square-root decrease of the Fermi-surface anisotropy. For the [Formula: see text] composite Fermi liquid, this result is surprising since a Dirac fermion ground state was only recently proposed as an alternative to the usual Halperin-Lee-Read state. Our proposed universality can be tested in several anisotropic Dirac materials including graphene, topological insulators, organic conductors, and magic-angle twisted bilayer graphene.

| S-EPMC6936362 | biostudies-literature

Butterfly magnetoresistance, quasi-2D Dirac Fermi surface and topological phase transition in ZrSiS.

Project description:Magnetoresistance (MR), the change of a material's electrical resistance in response to an applied magnetic field, is a technologically important property that has been the topic of intense study for more than a quarter century. We report the observation of an unusual "butterfly"-shaped titanic angular magnetoresistance (AMR) in the nonmagnetic Dirac material, ZrSiS, which we find to be the most conducting sulfide known, with a 2-K resistivity as low as 48(4) n??cm. The MR in ZrSiS is large and positive, reaching nearly 1.8 × 105 percent at 9 T and 2 K at a 45° angle between the applied current (I || a) and the applied field (90° is H || c). Approaching 90°, a "dip" is seen in the AMR, which, by analyzing Shubnikov de Haas oscillations at different angles, we find to coincide with a very sharp topological phase transition unlike any seen in other known Dirac/Weyl materials. We find that ZrSiS has a combination of two-dimensional (2D) and 3D Dirac pockets comprising its Fermi surface and that the combination of high-mobility carriers and multiple pockets in ZrSiS allows for large property changes to occur as a function of angle between applied fields. This makes it a promising platform to study the physics stemming from the coexistence of 2D and 3D Dirac electrons as well as opens the door to creating devices focused on switching between different parts of the Fermi surface and different topological states.

| S-EPMC5161428 | biostudies-literature

Fermi-crossing Type-II Dirac fermions and topological surface states in NiTe<sub>2</sub>.

Project description:Transition-metal dichalcogenides (TMDs) offer an ideal platform to experimentally realize Dirac fermions. However, typically these exotic quasiparticles are located far away from the Fermi level, limiting the contribution of Dirac-like carriers to the transport properties. Here we show that NiTe2 hosts both bulk Type-II Dirac points and topological surface states. The underlying mechanism is shared with other TMDs and based on the generic topological character of the Te p-orbital manifold. However, unique to NiTe2, a significant contribution of Ni d orbital states shifts the energy of the Type-II Dirac point close to the Fermi level. In addition, one of the topological surface states intersects the Fermi energy and exhibits a remarkably large spin splitting of 120 meV. Our results establish NiTe2 as an exciting candidate for next-generation spintronics devices.

| S-EPMC7395785 | biostudies-literature

Population-calibrated multiple imputation for a binary/categorical covariate in categorical regression models.

Project description:Multiple imputation (MI) has become popular for analyses with missing data in medical research. The standard implementation of MI is based on the assumption of data being missing at random (MAR). However, for missing data generated by missing not at random mechanisms, MI performed assuming MAR might not be satisfactory. For an incomplete variable in a given data set, its corresponding population marginal distribution might also be available in an external data source. We show how this information can be readily utilised in the imputation model to calibrate inference to the population by incorporating an appropriately calculated offset termed the "calibrated-? adjustment." We describe the derivation of this offset from the population distribution of the incomplete variable and show how, in applications, it can be used to closely (and often exactly) match the post-imputation distribution to the population level. Through analytic and simulation studies, we show that our proposed calibrated-? adjustment MI method can give the same inference as standard MI when data are MAR, and can produce more accurate inference under two general missing not at random missingness mechanisms. The method is used to impute missing ethnicity data in a type 2 diabetes prevalence case study using UK primary care electronic health records, where it results in scientifically relevant changes in inference for non-White ethnic groups compared with standard MI. Calibrated-? adjustment MI represents a pragmatic approach for utilising available population-level information in a sensitivity analysis to explore potential departures from the MAR assumption.

| S-EPMC6492126 | biostudies-literature

The role of balanced training and testing data sets for binary classifiers in bioinformatics.

Project description:Training and testing of conventional machine learning models on binary classification problems depend on the proportions of the two outcomes in the relevant data sets. This may be especially important in practical terms when real-world applications of the classifier are either highly imbalanced or occur in unknown proportions. Intuitively, it may seem sensible to train machine learning models on data similar to the target data in terms of proportions of the two binary outcomes. However, we show that this is not the case using the example of prediction of deleterious and neutral phenotypes of human missense mutations in human genome data, for which the proportion of the binary outcome is unknown. Our results indicate that using balanced training data (50% neutral and 50% deleterious) results in the highest balanced accuracy (the average of True Positive Rate and True Negative Rate), Matthews correlation coefficient, and area under ROC curves, no matter what the proportions of the two phenotypes are in the testing data. Besides balancing the data by undersampling the majority class, other techniques in machine learning include oversampling the minority class, interpolating minority-class data points and various penalties for misclassifying the minority class. However, these techniques are not commonly used in either the missense phenotype prediction problem or in the prediction of disordered residues in proteins, where the imbalance problem is substantial. The appropriate approach depends on the amount of available data and the specific problem at hand.

| S-EPMC3706434 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data