Browse
Submit Data
Databases
API
Help

Dataset Information

14 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

A Tool for Automatic Scoring of Spelling Performance.

ABSTRACT: Purpose The evaluation of spelling performance in aphasia reveals deficits in written language and can facilitate the design of targeted writing treatments. Nevertheless, manual scoring of spelling performance is time-consuming, laborious, and error prone. We propose a novel method based on the use of distance metrics to automatically score spelling. This study compares six automatic distance metrics to identify the metric that best corresponds to the gold standard-manual scoring-using data from manually obtained spelling scores from individuals with primary progressive aphasia. Method Three thousand five hundred forty word and nonword spelling productions from 42 individuals with primary progressive aphasia were scored manually. The gold standard-the manual scores-were compared to scores from six automated distance metrics: sequence matcher ratio, Damerau-Levenshtein distance, normalized Damerau-Levenshtein distance, Jaccard distance, Masi distance, and Jaro-Winkler similarity distance. We evaluated each distance metric based on its correlation with the manual spelling score. Results All automatic distance scores had high correlation with the manual method for both words and nonwords. The normalized Damerau-Levenshtein distance provided the highest correlation with the manual scoring for both words (r_s = .99) and nonwords (r_s = .95). Conclusions The high correlation between the automated and manual methods suggests that automatic spelling scoring constitutes a quick and objective approach that can reliably substitute the existing manual and time-consuming spelling scoring process, an important asset for both researchers and clinicians.

SUBMITTER: Themistocleous C

PROVIDER: S-EPMC8608207 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

What Methods of Scoring Young Children's Spelling Best Predict Later Spelling Performance?

Project description:Background:Children's spellings are often scored as correct or incorrect, but other measures may be better predictors of later spelling performance. Method:We examined seven measures of spelling in Reception Year and Year 1 (5-6 years old) as predictors of performance on a standardized spelling test in Year 2 (age 7). Results:Correctness was the best predictor of later spelling by the middle of Year 1, and it significantly outperformed a binary measure of phonological plausibility at the end of Reception Year. Nonbinary measures based on Levenshtein distance were significant predictors of later spelling in the middle of Reception Year and in children who produced no correct spellings. Some widely used scales performed less well with children who did not yet produce any correct spellings. Conclusions:Nonbinary measures of spelling performance can predict later spelling performance, but for a more restricted period than anticipated based on many theories.

| S-EPMC6364987 | biostudies-literature

Spelling performance on the web and in the lab.

Project description:Several dictionary websites are available on the web to access semantic, synonymous, or spelling information about a given word. During nine years, we systematically recorded all the entered letter sequences from a French web dictionary. A total of 200 million orthographic forms were obtained allowing us to create a large-scale database of spelling errors that could inform psychological theories about spelling processes. To check the reliability of this big data methodology, we selected from this database a sample of 100 frequently misspelled words. A group of 100 French university students had to perform a spelling-to-dictation test on this list of words. The results showed a strong correlation between the two data sets on the frequencies of produced spellings (r = 0.82). Although the distributions of spelling errors were relatively consistent across the two databases, the proportion of correct responses revealed significant differences. Regression analyses allowed us to generate possible explanations for these differences in terms of task-dependent factors. We argue that comparing the results of these large-scale databases with those of standard and controlled experimental paradigms is certainly a good way to determine the conditions under which this big data methodology can be adequately used for informing psychological theories.

| S-EPMC6922404 | biostudies-literature

Validation of a Novel Digital Tool in Automatic Scoring of an Online ECG Examination at an International Cardiology Meeting.

Project description:BackgroundWe have previously developed a novel digital tool capable of automatically recognizing correct electrocardiography (ECG) diagnoses in an online exam and demonstrated a significant improvement in diagnostic accuracy when utilizing an inductive-deductive reasoning strategy over a pattern recognition strategy. In this study, we sought to validate these findings from participants at the International Winter Arrhythmia School meeting, one of the foremost electrophysiology events in Canada.MethodsPreregistration to the event was sent by e-mail. The exam was administered on day 1 of the conference. Results and analysis were presented the following morning to participants.ResultsTwenty-five attendees completed the exam, providing a total of 500 responses to be marked. The online tool accurately identified 195 of a total of 395 (49%) correct responses (49%). In total, 305 responses required secondary manual review, of which 200 were added to the correct responses pool. The overall accuracy of correct ECG diagnosis for all participants was 69% and 84% when using pattern recognition or inductive-deductive strategies, respectively.ConclusionUtilization of a novel digital tool to evaluate ECG competency can be set up as a workshop at international meetings or educational events. Results can be presented during the sessions to ensure immediate feedback.

| S-EPMC6931661 | biostudies-literature

Assessment of a wireless headband for automatic sleep scoring.

Project description:PurposeClassically, professional assessment of sleep is done in the sleep laboratory using whole-night polysomnography (PSG). However, given a misbalance between accredited sleep laboratories and the large amount of patients suffering from sleep disorders, only few receive appropriate diagnostic assessment. Recently, some low-cost home sleep scoring systems have been proposed, yet such systems are rarely tested scientifically. The aim of the present study was to evaluate the staging accuracy of the home sleep scoring system Zeo (Newton, MA, USA).MethodsA final sample of 21 nights from ten subjects (aged 23-45) was digitally recorded with PSG as well as with the Zeo system. We compared scorings of Zeo (on an epoch-be-epoch basis) with the Somnolyzer 24?×?7 (an automatic staging algorithm), expert scorers as well as the freeware SleepExplorer.ResultsIt was revealed that Zeo shows moderate overall agreement as compared to our study standard Somnolyzer 24?×?7 (??=?0.56). The most obvious performance difference between Zeo and both other scoring approaches was stage wake (sleep onset latency?+?wake after sleep onset). While Zeo detected only 40.8 % of the study standard wake epochs, 70.1 % were detected by the expert scorers and 83.4 % by the SleepExplorer, respectively.ConclusionsData suggest that the Zeo system produces acceptable sleep scoring for stage REM, light and deep sleep, with a specific weakness in correctly detecting waking periods.

| S-EPMC3655221 | biostudies-literature

Automatic Human Sleep Stage Scoring Using Deep Neural Networks.

Project description:The classification of sleep stages is the first and an important step in the quantitative analysis of polysomnographic recordings. Sleep stage scoring relies heavily on visual pattern recognition by a human expert and is time consuming and subjective. Thus, there is a need for automatic classification. In this work we developed machine learning algorithms for sleep classification: random forest (RF) classification based on features and artificial neural networks (ANNs) working both with features and raw data. We tested our methods in healthy subjects and in patients. Most algorithms yielded good results comparable to human interrater agreement. Our study revealed that deep neural networks (DNNs) working with raw data performed better than feature-based methods. We also demonstrated that taking the local temporal structure of sleep into account a priori is important. Our results demonstrate the utility of neural network architectures for the classification of sleep.

| S-EPMC6232272 | biostudies-literature

Automatic Liver Viability Scoring with Deep Learning and Hyperspectral Imaging.

Project description:Hyperspectral imaging (HSI) is a non-invasive imaging modality already applied to evaluate hepatic oxygenation and to discriminate different models of hepatic ischemia. Nevertheless, the ability of HSI to detect and predict the reperfusion damage intraoperatively was not yet assessed. Hypoxia caused by hepatic artery occlusion (HAO) in the liver brings about dreadful vascular complications known as ischemia-reperfusion injury (IRI). Here, we show the evaluation of liver viability in an HAO model with an artificial intelligence-based analysis of HSI. We have combined the potential of HSI to extract quantitative optical tissue properties with a deep learning-based model using convolutional neural networks. The artificial intelligence (AI) score of liver viability showed a significant correlation with capillary lactate from the liver surface (r = -0.78, p = 0.0320) and Suzuki's score (r = -0.96, p = 0.0012). CD31 immunostaining confirmed the microvascular damage accordingly with the AI score. Our results ultimately show the potential of an HSI-AI-based analysis to predict liver viability, thereby prompting for intraoperative tool development to explore its application in a clinical setting.

| S-EPMC8472457 | biostudies-literature

Cognitive factors contributing to spelling performance in children with prenatal alcohol exposure.

Project description:ObjectiveHeavy prenatal alcohol exposure is associated with impaired school functioning. Spelling performance has not been comprehensively evaluated. We examined whether children with heavy prenatal alcohol exposure demonstrate deficits in spelling and related abilities, including reading, and tested whether there are unique underlying mechanisms for observed deficits in this population.MethodNinety-six school-age children made up 2 groups: children with heavy prenatal alcohol exposure (AE, n = 49) and control children (CON, n = 47). Children completed select subtests from the Wechsler Individual Achievement Test-Second Edition and the NEPSY-II. Group differences and relations between spelling and theoretically related cognitive variables were evaluated using multivariate analysis of variance and Pearson correlations. Hierarchical regression analyses were used to assess contributions of group membership and cognitive variables to spelling performance. The specificity of these deficits and underlying mechanisms was tested by examining the relations between reading ability, group membership, and cognitive variables.ResultsGroups differed significantly on all variables. Group membership and phonological processing significantly contributed to spelling performance, whereas for reading, group membership and all cognitive variables contributed significantly. For both reading and spelling, group × working memory interactions revealed that working memory contributed independently only for alcohol-exposed children.ConclusionAlcohol-exposed children demonstrated a unique pattern of spelling deficits. The relation of working memory to spelling and reading was specific to the AE group, suggesting that if prenatal alcohol exposure is known or suspected, working memory ability should be considered in the development and implementation of explicit instruction.

| S-EPMC4522410 | biostudies-literature

Automatic Detection and Quantitative DCE-MRI Scoring of Prostate Cancer Aggressiveness.

Project description:Purpose:To develop a robust and clinically applicable automated method for analyzing Dynamic Contrast Enhanced (DCE-) MRI of the prostate as a guide for targeted biopsies and treatments. Materials and methods:An unsupervised pattern recognition (PR) method was used to analyze prostate DCE-MRI from 71 sequential radiotherapy patients. Identified regions of interest (ROIs) with increased perfusion were assigned either to the peripheral (PZ) or transition zone (TZ). Six quantitative features, associated with the washin and washout part of the weighted average DCE curve from the ROI, were calculated. The associations between the assigned DCE-scores and Gleason Score (GS) were investigated. A heatmap of tumor aggressiveness covering the entire prostate was generated and validated with histopathology from MRI-ultrasound fused (MRI-US) targeted biopsies. Results:The volumes of the PR-identified ROI's were significantly correlated with the highest GS from the biopsy session for each patient. Following normalization (and only after normalization) with gluteus maximus muscle's DCE signal, the quantitative features in PZ were significantly correlated with GS. These correlations straightened in subset of patients with available MRI-US biopsies when GS from the individual biopsies were used. Area under the receiver operating characteristics curve for discrimination between indolent vs aggressive cancer for the significant quantitative features reached 0.88-0.95. When DCE-scores were calculated in normal appearing tissues, the features were highly discriminative for cancer vs no cancer both in PZ and TZ. The generated heatmap of tumor aggressiveness coincided with the location and GS of the MRI-US biopsies. Conclusion:A quantitative approach for DCE-MRI analysis was developed. The resultant map of aggressiveness correlated well with tumor location and GS and is applicable for integration in radiotherapy/radiology imaging software for clinical translation.

| S-EPMC5686056 | biostudies-literature

PASTEC: an automatic transposable element classification tool.

Project description:SummaryThe classification of transposable elements (TEs) is key step towards deciphering their potential impact on the genome. However, this process is often based on manual sequence inspection by TE experts. With the wealth of genomic sequences now available, this task requires automation, making it accessible to most scientists. We propose a new tool, PASTEC, which classifies TEs by searching for structural features and similarities. This tool outperforms currently available software for TE classification. The main innovation of PASTEC is the search for HMM profiles, which is useful for inferring the classification of unknown TE on the basis of conserved functional domains of the proteins. In addition, PASTEC is the only tool providing an exhaustive spectrum of possible classifications to the order level of the Wicker hierarchical TE classification system. It can also automatically classify other repeated elements, such as SSR (Simple Sequence Repeats), rDNA or potential repeated host genes. Finally, the output of this new tool is designed to facilitate manual curation by providing to biologists with all the evidence accumulated for each TE consensus.AvailabilityPASTEC is available as a REPET module or standalone software (http://urgi.versailles.inra.fr/download/repet/REPET_linux-x64-2.2.tar.gz). It requires a Unix-like system. There are two standalone versions: one of which is parallelized (requiring Sun grid Engine or Torque), and the other of which is not.

| S-EPMC4008368 | biostudies-literature

A Spelling Paradigm With an Added Red Dot Improved the P300 Speller System Performance.

Project description:The traditional P300 speller system uses the flashing row or column spelling paradigm. However, the classification accuracy and information transfer rate of the P300 speller are not adequate for real-world application. To improve the performance of the P300 speller, we devised a new spelling paradigm in which the flashing row or column of a virtual character matrix is covered by a translucent green circle with a red dot in either the upper or lower half (GC-RD spelling paradigm). We compared the event-related potential (ERP) waveforms with a control paradigm (GC spelling paradigm), in which the flashing row or column of a virtual character matrix was covered by a translucent green circle only. Our experimental results showed that the amplitude of P3a at the parietal area and P3b at the frontal-central-parietal areas evoked by the GC-RD paradigm were significantly greater than those induced by the GC paradigm. Higher classification accuracy and information transmission rates were also obtained in the GC-RD system. Our results indicated that the added red dots increased attention and visuospatial information, resulting in an amplitude increase in both P3a and P3b, thereby improving the performance of the P300 speller system.

| S-EPMC7744603 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data