Dataset Information

A non-parametric significance test to compare corpora.

ABSTRACT: Classical null hypothesis significance tests are not appropriate in corpus linguistics, because the randomness assumption underlying these testing procedures is not fulfilled. Nevertheless, there are numerous scenarios where it would be beneficial to have some kind of test in order to judge the relevance of a result (e.g. a difference between two corpora) by answering the question whether the attribute of interest is pronounced enough to warrant the conclusion that it is substantial and not due to chance. In this paper, I outline such a test.

SUBMITTER: Koplenig A

PROVIDER: S-EPMC6752893 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A non-parametric significance test to compare corpora.

Koplenig Alexander A

PloS one 20190919 9

Classical null hypothesis significance tests are not appropriate in corpus linguistics, because the randomness assumption underlying these testing procedures is not fulfilled. Nevertheless, there are numerous scenarios where it would be beneficial to have some kind of test in order to judge the relevance of a result (e.g. a difference between two corpora) by answering the question whether the attribute of interest is pronounced enough to warrant the conclusion that it is substantial and not due ...[more]

PMID: 31536558

Similar Datasets

Project description:BackgroundDysbiosis of the human gut microbiome is defined as a maladaptive or clinically relevant deviation of the community profile from the healthy or normal state. Dysbiosis has been implicated in an extensive set of metabolic, auto-immune, and infectious diseases, and yet there is substantial inter-individual variation in microbiome composition even within body sites of healthy humans. An individual's microbiome varies over time in a high-dimensional space to form their personal microbiome cloud. This cloud may or may not be similar to that of other people, both in terms of the average microbiome profile (conformity) and the diameter of the cloud (stability). However, there is currently no robust non-parametric test that determines whether a patient's microbiome cloud is an outlier with respect to a reference group of healthy individuals with widely varying microbiome profiles.MethodsHere, we propose a test for outliers' detection in the human gut microbiome that accounts for the wide range of microbiome phenotypes observed in a typical set of healthy individuals and for intra-individual temporal variation. Our robust nonparametric outlier detection test, the CLOUD test, performs two assessments of a patient's microbiome health: conformity, the extent to which the patient's microbiome cloud is ecologically similar to a subset of healthy subjects; and stability, which compares the cloud diameter of a patient to those of healthy subjects. The CLOUD test is based on locally linear embedded ecological distances, allowing it to account for widely varying microbiome compositions among reference individuals. It also leverages temporal variability within patients and reference individuals to increase the robustness of the test.ResultsWe describe the CLOUD test, and we apply it to one novel and two previously published cohorts of patients receiving fecal microbiota transplantation for recurrent Clostridium difficile colitis, as well as to two known healthy cohorts, demonstrating high concordance of the CLOUD conformity and stability indices with clinical outcomes.ConclusionsAlthough the CLOUD test is not, on its own, a test for clinical dysbiosis, it nonetheless provides a framework for outlier testing that could be incorporated into evaluation of suspected dysbiosis, which may play a role in diagnosis and prognosis of numerous pediatric and adult diseases.

Dataset Information

A non-parametric significance test to compare corpora.

Publications

A non-parametric significance test to compare corpora.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets