Developing Multistage Tests Using D-Scoring Method.
Ontology highlight
ABSTRACT:
SUBMITTER: Han KCT
PROVIDER: S-EPMC6713982 | biostudies-literature | 2019 Oct
REPOSITORIES: biostudies-literature
Publications
Developing Multistage Tests Using <i>D</i>-Scoring Method.
Han Kyung Chris T KCT Dimitrov Dimiter M DM Al-Mashary Faisal F
Educational and psychological measurement 20190422 5
The <i>D</i>-scoring method for scoring and equating tests with binary items proposed by Dimitrov offers some of the advantages of item response theory, such as item-level difficulty information and score computation that reflects the item difficulties, while retaining the merits of classical test theory such as the simplicity of number correct score computation and relaxed requirements for model sample sizes. Because of its unique combination of those merits, the <i>D</i>-scoring method has see ...[more]
Similar Datasets
Project description:The ability of scoring functions to correctly select and rank docking poses of small molecules in protein binding sites is highly target dependent, which presents a challenge for structure-based drug discovery. Here we describe a virtual screening method that combines an energy-based docking scoring function with a molecular interaction fingerprint (IFP) to identify new ligands based on G protein-coupled receptor (GPCR) crystal structures. The consensus scoring method is prospectively evaluated by: 1) the discovery of chemically novel, fragment-like, high affinity histamine H1 receptor (H1R) antagonists/inverse agonists, 2) the selective structure-based identification of ß2-adrenoceptor (ß2R) agonists, and 3) the experimental validation and comparison of the combined and individual scoring approaches. Systematic retrospective virtual screening simulations allowed the definition of scoring cut-offs for the identification of H1R and ß2R ligands and the selection of an optimal ß-adrenoceptor crystal structure for the discrimination between ß2R agonists and antagonists. The consensus approach resulted in the experimental validation of 53% of the ß2R and 73% of the H1R virtual screening hits with up to nanomolar affinities and potencies. The selective identification of ß2R agonists shows the possibilities of structure-based prediction of GPCR ligand function by integrating protein-ligand binding mode information.
| S-EPMC4919634 | biostudies-literature
Project description:BACKGROUND: Over-diagnosis and treatment of prostate cancer has been a major problem in prostate cancer care and management. Currently the most relevant prognostic factor to predict a patient's risk of death due to prostate cancer is the Gleason score of the biopsied tissue samples. However, pathological analysis is subjective, and the Gleason score is only a qualitative estimate of the cancer malignancy. Molecular biomarkers and diagnostic tests that can accurately predict prostate tumor aggressiveness are rather limited. METHOD: We report here for the first time the development of a nanoparticle test that not only can distinguish prostate cancer from normal and benign conditions, but also has the potential to predict the aggressiveness of prostate cancer quantitatively. To conduct the test, a prostate tissue lysate sample is spiked into a blood serum or human IgG solution and the spiked sample is incubated with a citrate-protected gold nanoparticle solution. IgG is known to adsorb to citrate-protected gold nanoparticles to form a "protein corona" on the nanoparticle surface. From this study, we discovered that certain tumor-specific molecules can interact with IgG and change the adsorption behavior of IgG to the gold nanoparticles. This change is reflected in the nanoparticle size of the assay solution and detected by a dynamic light scattering technique. Assay data were analyzed by one-way ANOVA for multiple variant analysis, and using the Student t-test or nonparametric Mann-Whitney U-tests for pairwise analyses. RESULTS: An inverse, quantitative correlation of the average nanoparticle size of the assay solution with tumor status and histological diagnostic grading was observed from the nanoparticle test. IgG solutions spiked with prostate tumor tissue exhibit significantly smaller nanoparticle size than the solutions spiked with normal and benign tissues. The higher grade the tumor is, the smaller the nanoparticle size is. The test particularly revealed large differences among the intermediate Grade 2 tumors, and suggested the need to treat them differently. CONCLUSION: Development of a new nanoparticle test may provide a quantitative measure of the prostate cancer aggressiveness. If validated in a larger study of patients with prostate cancer, this test could become a new diagnostic tool in conjunction with Gleason Score pathology diagnostics to better distinguish aggressive cancer from indolent tumor.
| S-EPMC3337274 | biostudies-literature
Project description:BACKGROUND: Cesarean section rates are increasing worldwide, and a rapid increase has been observed in Iran. Disagreement exists between clinicians about when to use cesarean section. We aimed to identify the appropriateness criteria for the use of cesarean section in Iran. METHOD: A consensus development study using a modified version of the RAND Appropriateness Method (RAM). We generated scenarios from valid clinical guidelines and expert opinions. A panel of experts participated in consensus development: first round via mail (12 members), second round face-to-face (9 members). We followed the RAM recommendations for the development of the scenario lists, rating scales, and statistical analyses. RESULTS: 294 scenarios relevant to cesarean section were identified. 191 scenarios were considered appropriate, of which 125 scenarios were agreed upon. The panel found cesarean inappropriate for 21% of scenarios, and 'equivocal' for 14% of scenarios. CONCLUSION: RAM is useful for identifying stakeholder views in settings with limited resources. The participants' views on appropriateness of certain indications differed with available evidence. A large number of scenarios without agreement may partly explain why it has been difficult to curb the growth in cesarean section rate.
| S-EPMC2949786 | biostudies-other
Project description:Algorithmic scoring methods are widely used in the finance industry for several decades in order to prevent risk and to automate and optimize decisions. Regulatory requirements as given by the Basel Committee on Banking Supervision (BCBS) or the EU data protection regulations have led to an increasing interest and research activity on understanding black box machine learning models by means of explainable machine learning. Even though this is a step into a right direction, such methods are not able to guarantee for a fair scoring as machine learning models are not necessarily unbiased and may discriminate with respect to certain subpopulations such as a particular race, gender, or sexual orientation-even if the variable itself is not used for modeling. This is also true for white box methods like logistic regression. In this study, a framework is presented that allows analyzing and developing models with regard to fairness. The proposed methodology is based on techniques of causal inference and some of the methods can be linked to methods from explainable machine learning. A definition of counterfactual fairness is given together with an algorithm that results in a fair scoring model. The concepts are illustrated by means of a transparent simulation and a popular real-world example, the German Credit data using traditional scorecard models based on logistic regression and weight of evidence variable pre-transform. In contrast to previous studies in the field for our study, a corrected version of the data is presented and used. With the help of the simulation, the trade-off between fairness and predictive accuracy is analyzed. The results indicate that it is possible to remove unfairness without a strong performance decrease unless the correlation of the discriminative attributes on the other predictor variables in the model is not too strong. In addition, the challenge in explaining the resulting scoring model and the associated fairness implications to users is discussed.
| S-EPMC8552888 | biostudies-literature
Project description:Semantic similarity measures are useful to assess the physiological relevance of protein-protein interactions (PPIs). They quantify similarity between proteins based on their function using annotation systems like the Gene Ontology (GO). Proteins that interact in the cell are likely to be in similar locations or involved in similar biological processes compared to proteins that do not interact. Thus the more semantically similar the gene function annotations are among the interacting proteins, more likely the interaction is physiologically relevant. However, most semantic similarity measures used for PPI confidence assessment do not consider the unequal depth of term hierarchies in different classes of cellular location, molecular function, and biological process ontologies of GO and thus may over-or under-estimate similarity.We describe an improved algorithm, Topological Clustering Semantic Similarity (TCSS), to compute semantic similarity between GO terms annotated to proteins in interaction datasets. Our algorithm, considers unequal depth of biological knowledge representation in different branches of the GO graph. The central idea is to divide the GO graph into sub-graphs and score PPIs higher if participating proteins belong to the same sub-graph as compared to if they belong to different sub-graphs.The TCSS algorithm performs better than other semantic similarity measurement techniques that we evaluated in terms of their performance on distinguishing true from false protein interactions, and correlation with gene expression and protein families. We show an average improvement of 4.6 times the F1 score over Resnik, the next best method, on our Saccharomyces cerevisiae PPI dataset and 2 times on our Homo sapiens PPI dataset using cellular component, biological process and molecular function GO annotations.
| S-EPMC2998529 | biostudies-literature
Project description:Although, existing methods have been successful in predicting phage (or bacteriophage) virion proteins (PVPs) using various types of protein features and complex classifiers, such as support vector machine and naïve Bayes, these two methods do not allow interpretability. However, the characterization and analysis of PVPs might be of great significance to understanding the molecular mechanisms of bacteriophage genetics and the development of antibacterial drugs. Hence, we herein proposed a novel method (PVPred-SCM) based on the scoring card method (SCM) in conjunction with dipeptide composition to identify and characterize PVPs. In PVPred-SCM, the propensity scores of 400 dipeptides were calculated using the statistical discrimination approach. Rigorous independent validation test showed that PVPred-SCM utilizing only dipeptide composition yielded an accuracy of 77.56%, indicating that PVPred-SCM performed well relative to the state-of-the-art method utilizing a number of protein features. Furthermore, the propensity scores of dipeptides were used to provide insights into the biochemical and biophysical properties of PVPs. Upon comparison, it was found that PVPred-SCM was superior to the existing methods considering its simplicity, interpretability, and implementation. Finally, in an effort to facilitate high-throughput prediction of PVPs, we provided a user-friendly web-server for identifying the likelihood of whether or not these sequences are PVPs. It is anticipated that PVPred-SCM will become a useful tool or at least a complementary existing method for predicting and analyzing PVPs.
| S-EPMC7072630 | biostudies-literature
Project description:BACKGROUND: Existing methods for predicting protein solubility on overexpression in Escherichia coli advance performance by using ensemble classifiers such as two-stage support vector machine (SVM) based classifiers and a number of feature types such as physicochemical properties, amino acid and dipeptide composition, accompanied with feature selection. It is desirable to develop a simple and easily interpretable method for predicting protein solubility, compared to existing complex SVM-based methods. RESULTS: This study proposes a novel scoring card method (SCM) by using dipeptide composition only to estimate solubility scores of sequences for predicting protein solubility. SCM calculates the propensities of 400 individual dipeptides to be soluble using statistic discrimination between soluble and insoluble proteins of a training data set. Consequently, the propensity scores of all dipeptides are further optimized using an intelligent genetic algorithm. The solubility score of a sequence is determined by the weighted sum of all propensity scores and dipeptide composition. To evaluate SCM by performance comparisons, four data sets with different sizes and variation degrees of experimental conditions were used. The results show that the simple method SCM with interpretable propensities of dipeptides has promising performance, compared with existing SVM-based ensemble methods with a number of feature types. Furthermore, the propensities of dipeptides and solubility scores of sequences can provide insights to protein solubility. For example, the analysis of dipeptide scores shows high propensity of ?-helix structure and thermophilic proteins to be soluble. CONCLUSIONS: The propensities of individual dipeptides to be soluble are varied for proteins under altered experimental conditions. For accurately predicting protein solubility using SCM, it is better to customize the score card of dipeptide propensities by using a training data set under the same specified experimental conditions. The proposed method SCM with solubility scores and dipeptide propensities can be easily applied to the protein function prediction problems that dipeptide composition features play an important role. AVAILABILITY: The used datasets, source codes of SCM, and supplementary files are available at http://iclab.life.nctu.edu.tw/SCM/.
| S-EPMC3521471 | biostudies-literature
Project description:Biocides are non-agricultural chemical agents for the prevention of unhygienic pests. The worldwide demand for biocidal products has been rapidly increasing. Meanwhile, biocides have been causing negative health effects for decades, resulting in public health scares. Therefore, governments around the world have tried to strictly control biocides, and it is necessary to prioritize the health risks of biocides for efficient management. Chemical ranking and scoring (CRS) methods have been developed for the effective management of chemicals. However, existing methods do not use suitable variables to evaluate biocides, thus possibly underestimating or overestimating the actual health risks. We developed a new CRS method that reflects the exposure and toxicity characteristics of biocides. Eleven indicators were chosen as appropriate for prioritizing biocides, and scoring based on the globally harmonized system of classification and labeling of chemicals (GHS) improved the efficiency of the method. Correlations between individual indicators in this study were low (-0.151-0.325), indicating that each indicator was independent and well-chosen for prioritizing biocides. The effect of each indicator on the total score showed that carcinogenicity, mutagenicity, and reproductive toxicity (CMR) chemicals ranked high with r = 0.558. This result demonstrated that the most dangerous toxicants should play a more decisive role in the top ranking than the others. We expect that our method can be efficiently used to screen regulated biocides by prioritizing their health hazards, thus leading to better policy decision making about biocide use.
| S-EPMC7143513 | biostudies-literature
Project description:BackgroundFeature selection or scoring methods for the detection of biomarkers are essential in bioinformatics. Various feature selection methods have been developed for the detection of biomarkers, and several studies have employed information-theoretic approaches. However, most of these methods generally require a long processing time. In addition, information-theoretic methods discretize continuous features, which is a drawback that can lead to the loss of information.ResultsIn this paper, a novel supervised feature scoring method named ClearF is proposed. The proposed method is suitable for continuous-valued data, which is similar to the principle of feature selection using mutual information, with the added advantage of a reduced computation time. The proposed score calculation is motivated by the association between the reconstruction error and the information-theoretic measurement. Our method is based on class-wise low-dimensional embedding and the resulting reconstruction error. Given multi-class datasets such as a case-control study dataset, low-dimensional embedding is first applied to each class to obtain a compressed representation of the class, and also for the entire dataset. Reconstruction is then performed to calculate the error of each feature and the final score for each feature is defined in terms of the reconstruction errors. The correlation between the information theoretic measurement and the proposed method is demonstrated using a simulation. For performance validation, we compared the classification performance of the proposed method with those of various algorithms on benchmark datasets.ConclusionsThe proposed method showed higher accuracy and lower execution time than the other established methods. Moreover, an experiment was conducted on the TCGA breast cancer dataset, and it was confirmed that the genes with the highest scores were highly associated with subtypes of breast cancer.
| S-EPMC6624178 | biostudies-literature
Project description:Sensitivity and specificity are common measures of the accuracy of a diagnostic test. The usual estimators of these quantities are unbiased if data on the diagnostic test result and the true disease status are obtained from all subjects in an appropriately selected sample. In some studies, verification of the true disease status is performed only for a subset of subjects, possibly depending on the result of the diagnostic test and other characteristics of the subjects. Estimators of sensitivity and specificity based on this subset of subjects are typically biased; this is known as verification bias. Methods have been proposed to correct verification bias under the assumption that the missing data on disease status are missing at random (MAR), that is, the probability of missingness depends on the true (missing) disease status only through the test result and observed covariate information. When some of the covariates are continuous, or the number of covariates is relatively large, the existing methods require parametric models for the probability of disease or the probability of verification (given the test result and covariates), and hence are subject to model misspecification. We propose a new method for correcting verification bias based on the propensity score, defined as the predicted probability of verification given the test result and observed covariates. This is estimated separately for those with positive and negative test results. The new method classifies the verified sample into several subsamples that have homogeneous propensity scores and allows correction for verification bias. Simulation studies demonstrate that the new estimators are more robust to model misspecification than existing methods, but still perform well when the models for the probability of disease and probability of verification are correctly specified.
| S-EPMC3276270 | biostudies-literature