Dataset Information

Proposed framework for the evaluation of standalone corpora processing systems: an application to Arabic corpora.

ABSTRACT: Despite the accessibility of numerous online corpora, students and researchers engaged in the fields of Natural Language Processing (NLP), corpus linguistics, and language learning and teaching may encounter situations in which they need to develop their own corpora. Several commercial and free standalone corpora processing systems are available to process such corpora. In this study, we first propose a framework for the evaluation of standalone corpora processing systems and then use it to evaluate seven freely available systems. The proposed framework considers the usability, functionality, and performance of the evaluated systems while taking into consideration their suitability for Arabic corpora. While the results show that most of the evaluated systems exhibited comparable usability scores, the scores for functionality and performance were substantially different with respect to support for the Arabic language and N-grams profile generation. The results of our evaluation will help potential users of the evaluated systems to choose the system that best meets their needs. More importantly, the results will help the developers of the evaluated systems to enhance their systems and developers of new corpora processing systems by providing them with a reference framework.

SUBMITTER: Al-Thubaity A

PROVIDER: S-EPMC4294294 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Proposed framework for the evaluation of standalone corpora processing systems: an application to Arabic corpora.

Al-Thubaity Abdulmohsen A Al-Khalifa Hend H Alqifari Reem R Almazrua Manal M

TheScientificWorldJournal 20141231

Despite the accessibility of numerous online corpora, students and researchers engaged in the fields of Natural Language Processing (NLP), corpus linguistics, and language learning and teaching may encounter situations in which they need to develop their own corpora. Several commercial and free standalone corpora processing systems are available to process such corpora. In this study, we first propose a framework for the evaluation of standalone corpora processing systems and then use it to eval ...[more]

PMID: 25610910

Similar Datasets

Project description:ObjectivePropose a theoretical framework for retinal biomarkers of Alzheimer's disease (AD).BackgroundThe retina and brain share important biological features that are relevant to AD. Developing retinal biomarkers of AD is a strategic priority but as yet none have been validated for clinical use. Part of the reason may be that fundamental inferential assumptions have been overlooked. Failing to recognize these assumptions will disadvantage biomarker discovery and validation, but incorporating them into analyses could facilitate translation.New theoryThe biological assumption that a disease causes analogous effects in the brain and retina can be expressed within a Bayesian network. This allows inferences about abstract theory and individual events, and provides an opportunity to falsify the foundational hypothesis of retina-brain analogy. Graphical representation of the relationships between variables simplifies comparison between studies and facilitates judgements about whether key assumptions are valid given the current state of knowledge.Major challengesThe framework provides a visual approach to retinal biomarkers and may help to rationalize analysis of future studies. It suggests possible reasons for inconsistent results in existing literature on AD biomarkers.Linkage to other theoriesThe framework can be modified to describe alternative theories of retinal biomarker biology, such as retrograde degeneration resulting from brain disease, and can incorporate confounding factors such as co-existent glaucoma or macular degeneration. Parallels with analogue confirmation theory and surrogate marker validation suggest strengths and weaknesses of the framework that can be anticipated when developing analysis plans.HighlightsRetinal biomarkers hold great promise for Alzheimer's disease (AD), but none are currently used clinically.Assumptions about the cause of retinal and brain changes are often overlooked, and this may disadvantage biomarker discovery and validation.We present a new approach to retinal biomarkers that describes cause and effect graphically in a Bayesian network.We show how this allows a more complete assessment of how well a biomarker might reflect the brain, and how data from right and left eyes can be used to rule out poor biomarker candidates.

Dataset Information

Proposed framework for the evaluation of standalone corpora processing systems: an application to Arabic corpora.

Publications

Proposed framework for the evaluation of standalone corpora processing systems: an application to Arabic corpora.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets