Common statistical concepts in the supervised Machine Learning arena.
Ontology highlight
ABSTRACT:
SUBMITTER: Rashidi HH
PROVIDER: S-EPMC9949554 | biostudies-literature | 2023
REPOSITORIES: biostudies-literature
Publications
Common statistical concepts in the supervised Machine Learning arena.
Rashidi Hooman H HH Albahra Samer S Robertson Scott S Tran Nam K NK Hu Bo B
Frontiers in oncology 20230214
One of the core elements of Machine Learning (ML) is statistics and its embedded foundational rules and without its appropriate integration, ML as we know would not exist. Various aspects of ML platforms are based on statistical rules and most notably the end results of the ML model performance cannot be objectively assessed without appropriate statistical measurements. The scope of statistics within the ML realm is rather broad and cannot be adequately covered in a single review article. Theref ...[more]
Similar Datasets
Project description:Examination of rodent vocalizations in experimental conditions can yield valuable insights into how disease manifests and progresses over time. It can also be used as an index of social interest, motivation, emotional development or motor function depending on the animal model under investigation. Most mouse communication is produced in ultrasonic frequencies beyond human hearing. These ultrasonic vocalizations (USV) are typically described and evaluated using expert defined classification of the spectrographic appearance or simplistic acoustic metrics resulting in nine call types. In this study, we aimed to replicate the standard expert-defined call types of communicative vocal behavior in mice by using acoustic analysis to characterize USVs and a principled supervised learning setup. We used four feature selection algorithms to select parsimonious subsets with maximum predictive accuracy, which are then presented into support vector machines (SVM) and random forests (RF). We assessed the resulting models using 10-fold cross-validation with 100 repetitions for statistical confidence and found that a parsimonious subset of 8 acoustic measures presented to RF led to 85% correct out-of-sample classification, replicating the experts' labels. Acoustic measures can be used by labs to describe USVs and compare data between groups, and provide insight into vocal-behavioral patterns of mice by automating the process on matching the experts' call types.
| S-EPMC6542843 | biostudies-literature
Project description:Prevention and early intervention are the most effective ways of avoiding or minimizing psychological, physical, and financial suffering from cancer. However, such proactive action requires the ability to predict the individual's susceptibility to cancer with a measure of probability. Of the triad of cancer-causing factors (inherited genomic susceptibility, environmental factors, and lifestyle factors), the inherited genomic component may be derivable from the recent public availability of a large body of whole-genome variation data. However, genome-wide association studies have so far showed limited success in predicting the inherited susceptibility to common cancers. We present here a multiple classification approach for predicting individuals' inherited genomic susceptibility to acquire the most likely phenotype among a panel of 20 major common cancer types plus 1 "healthy" type by application of a supervised machine-learning method under competing conditions among the cohorts of the 21 types. This approach suggests that, depending on the phenotypes of 5,919 individuals of "white" ethnic population in this study, (i) the portion of the cohort of a cancer type who acquired the observed type due to mostly inherited genomic susceptibility factors ranges from about 33 to 88% (or its corollary: the portion due to mostly environmental and lifestyle factors ranges from 12 to 67%), and (ii) on an individual level, the method also predicts individuals' inherited genomic susceptibility to acquire the other types ranked with associated probabilities. These probabilities may provide practical information for individuals, heath professionals, and health policymakers related to prevention and/or early intervention of cancer.
| S-EPMC5819441 | biostudies-literature
Project description:BackgroundEpidemiological surveys offer essential data on adolescent substance use. Nevertheless, the precision of these self-report-based surveys often faces mistrust from researchers and the public. We evaluate the efficacy of a direct method to assess data quality by asking adolescents if they were honest. The main goal of our study was to assess the accuracy of a self-report honesty item and designate an optimal threshold for it, allowing us to better account for its impact on point estimates.MethodsThe participants were from the 2020 Illinois Youth Survey, a self-report school-based survey. We divided the primary dataset into subsets based on responses to an honesty item. Then, for each dataset, we examined two distinct data analysis methodologies: supervised machine learning, using the random forest algorithm, and a conventional inferential statistical method, logistic regression. We evaluated item thresholds from both analyses, investigating probable relationships with reported fake drug use, social desirability biases, and missingness in the datasets.ResultsThe study results corroborate the appropriateness and reliability of the honesty item and its corresponding threshold. These contain the agreeing honesty thresholds determined in both data analyses, the identified association between reported fake drug use and lower honesty scores, increased missingness and lower honesty, and the determined link between the social desirability bias and honesty threshold.ConclusionsConfirming the honesty threshold via missing data analysis also strengthens these collective findings, emphasizing our methodology's and findings' robustness. Researchers are encouraged to use self-report honesty items in epidemiological research. This will permit the modeling of accurate point estimates by addressing questionable reporting.
| S-EPMC10512612 | biostudies-literature
Project description:BackgroundArtificial intelligence and automated technology were first reported more than 70 years ago and nowadays provide unprecedented diagnostic accuracy, screening capacity, risk stratification, and workflow optimization. Diabetic retinopathy is an important cause of preventable blindness worldwide, and artificial intelligence technology provides precocious diagnosis, monitoring, and guide treatment. High-quality exams are fundamental in supervised artificial intelligence algorithms, but the lack of ground truth standards in retinal exams datasets is a problem.Main bodyIn this article, ETDRS, NHS, ICDR, SDGS diabetic retinopathy grading, and manual annotation are described and compared in publicly available datasets. The various DR labeling systems generate a fundamental problem for AI datasets. Possible solutions are standardization of DR classification and direct retinal-finding identifications.ConclusionReliable labeling methods also need to be considered in datasets with more trustworthy labeling.
| S-EPMC8722080 | biostudies-literature
Project description:ObjectiveThis paper presents an automated system for classifying the results of imaging examinations (CT, MRI, positron emission tomography) into reportable and non-reportable cancer cases. This system is part of an industrial-strength processing pipeline built to extract content from radiology reports for use in the Victorian Cancer Registry.Materials and methodsIn addition to traditional supervised learning methods such as conditional random fields and support vector machines, active learning (AL) approaches were investigated to optimize training production and further improve classification performance. The project involved two pilot sites in Victoria, Australia (Lake Imaging (Ballarat) and Peter MacCallum Cancer Centre (Melbourne)) and, in collaboration with the NSW Central Registry, one pilot site at Westmead Hospital (Sydney).ResultsThe reportability classifier performance achieved 98.25% sensitivity and 96.14% specificity on the cancer registry's held-out test set. Up to 92% of training data needed for supervised machine learning can be saved by AL.DiscussionAL is a promising method for optimizing the supervised training production used in classification of radiology reports. When an AL strategy is applied during the data selection process, the cost of manual classification can be reduced significantly.ConclusionsThe most important practical application of the reportability classifier is that it can dramatically reduce human effort in identifying relevant reports from the large imaging pool for further investigation of cancer. The classifier is built on a large real-world dataset and can achieve high performance in filtering relevant reports to support cancer registries.
| S-EPMC4147614 | biostudies-literature
Project description:With the current clinical available technologies, not all cancers are staged accurately. Because of this a large percentage of patients are misclassified before treatment, leading to under or over treatment. Therefore, a classification system based on the molecular feature is required to deter-mine the tumour behavior and metastatic potential. Here, we have shown the diagnostic potential of MALDI MSI using supervised machine learning approach in distinguishing cancerous colorectal tissue from normal with an overall accuracy of 98%. Also, shown is the capability of the technique in predicting the presence of metastasis in endometrial cancer with an overall accuracy of 80%. The development of such a model can help in determining the optimum treatment for cancerous pa-tients, reduce morbidity and better patient outcome.
2022-02-17 | PXD025594 | Pride
Project description:Identifying mechanisms that control molecular function is a significant challenge in pharmaceutical science and molecular engineering. Here, we present a novel projection pursuit recurrent neural network to identify functional mechanisms in the context of iterative supervised machine learning for discovery-based design optimization. Molecular function recognition is achieved by pairing experiments that categorize systems with digital twin molecular dynamics simulations to generate working hypotheses. Feature extraction decomposes emergent properties of a system into a complete set of basis vectors. Feature selection requires signal-to-noise, statistical significance, and clustering quality to concurrently surpass acceptance levels. Formulated as a multivariate description of differences and similarities between systems, the data-driven working hypothesis is refined by analyzing new systems prioritized by a discovery-likelihood. Utility and generality are demonstrated on several benchmarks, including the elucidation of antibiotic resistance in TEM-52 beta-lactamase. The software is freely available, enabling turnkey analysis of massive data streams found in computational biology and material science.
| S-EPMC7895977 | biostudies-literature
Project description:Climbing plants require an external support to grow vertically and enhance light acquisition. Climbers that find a suitable support demonstrate greater performance and fitness than those that remain prostrate. Support search is characterized by oscillatory movements (i.e., circumnutation), in which plants rotate around a central axis during their growth. Numerous studies have elucidated the mechanistic details of circumnutation, but how this phenomenon is controlled during support searching remains unclear. To fill this gap, here we tested whether simulation-based machine learning methods can capture differences in movement patterns nested in actual kinematical data. We compared machine learning classifiers with the aim of generating models that learn to discriminate between circumnutation patterns related to the presence/absence of a support in the environment. Results indicate that there is a difference in the pattern of circumnutation, depending on the presence of a support, that can be learned and classified rather accurately. We also identify distinctive kinematic features at the level of the junction underneath the tendrils that seems to be a superior indicator for discerning the presence/absence of the support by the plant. Overall, machine learning approaches appear to be powerful tools for understanding the movement of plants.
| S-EPMC9965265 | biostudies-literature
Project description:Machine learning (ML) is making a dramatic impact on cardiovascular magnetic resonance (CMR) in many ways. This review seeks to highlight the major areas in CMR where ML, and deep learning in particular, can assist clinicians and engineers in improving imaging efficiency, quality, image analysis and interpretation, as well as patient evaluation. We discuss recent developments in the field of ML relevant to CMR in the areas of image acquisition & reconstruction, image analysis, diagnostic evaluation and derivation of prognostic information. To date, the main impact of ML in CMR has been to significantly reduce the time required for image segmentation and analysis. Accurate and reproducible fully automated quantification of left and right ventricular mass and volume is now available in commercial products. Active research areas include reduction of image acquisition and reconstruction time, improving spatial and temporal resolution, and analysis of perfusion and myocardial mapping. Although large cohort studies are providing valuable data sets for ML training, care must be taken in extending applications to specific patient groups. Since ML algorithms can fail in unpredictable ways, it is important to mitigate this by open source publication of computational processes and datasets. Furthermore, controlled trials are needed to evaluate methods across multiple centers and patient groups.
| S-EPMC6778980 | biostudies-literature
Project description:Spontaneous activity is a common feature of immature neuronal networks throughout the central nervous system and plays an important role in network development and consolidation. In postnatal rodents, spontaneous activity in the spinal cord exhibits complex, stochastic patterns that have historically proven challenging to characterize. We developed a software tool for quickly and automatically characterizing and classifying episodes of spontaneous activity generated from developing spinal networks. We recorded spontaneous activity from in vitro lumbar ventral roots of 16 neonatal [postnatal day (P)0-P3] mice. Recordings were DC coupled and detrended, and episodes were separated for analysis. Amplitude-, duration-, and frequency-related features were extracted from each episode and organized into five classes. Paired classes and features were used to train and test supervised machine learning algorithms. Multilayer perceptrons were used to classify episodes as rhythmic or multiburst. We increased network excitability with potassium chloride and tested the utility of the tool to detect changes in features and episode class. We also demonstrate usability by having a novel experimenter use the program to classify episodes collected at a later time point (P5). Supervised machine learning-based classification of episodes accounted for changes that traditional approaches cannot detect. Our tool, named SpontaneousClassification, advances the detail in which we can study not only developing spinal networks, but also spontaneous networks in other areas of the nervous system. NEW & NOTEWORTHY Spontaneous activity is important for nervous system network development and consolidation. Our software uses machine learning to automatically and quickly characterize and classify episodes of spontaneous activity in the spinal cord of newborn mice. It detected changes in network activity following KCl-enhanced excitation. Using our software to classify spontaneous activity throughout development, in pathological models, or with neuromodulation, may offer insight into the development and organization of spinal circuits.
| S-EPMC6620704 | biostudies-literature