Benchmark data for sulcal pits extraction algorithms.
Ontology highlight
ABSTRACT:
SUBMITTER: Auzias G
PROVIDER: S-EPMC4773365 | biostudies-literature | 2015 Dec
REPOSITORIES: biostudies-literature
Publications
Benchmark data for sulcal pits extraction algorithms.
Auzias G G Brun L L Deruelle C C Coulon O O
Data in brief 20151021
This article contains data related to the research article Auzias et al. (2015) [1]. This data can be used as a benchmark for quantitative evaluation of sulcal pits extraction algorithm. In particular, it allows a quantitative comparison with our method, and the assessment of the consistency of the sulcal pits extraction across two well-matched populations. ...[more]
Similar Datasets
Project description:Sulcal pit analysis has been providing novel insights into brain function and development. The purpose of this study was to evaluate the reliability of sulcal pit extraction with respect to the effects of scan session, scanner, and surface extraction tool. Five subjects were scanned 4 times at 3 MRI centers and other 5 subjects were scanned 3 times at 2 MRI centers, including 1 test-retest session. Sulcal pits were extracted on the white matter surfaces reconstructed with both Montreal Neurological Institute and Freesurfer pipelines. We estimated similarity of the presence of sulcal pits having a maximum value of 1 and their spatial difference within the same subject. The tests showed high similarity of the sulcal pit presence and low spatial difference. The similarity was more than 0.90 and the spatial difference was less than 1.7 mm in most cases according to different scan sessions or scanners, and more than 0.85 and about 2.0 mm across surface extraction tools. The reliability of sulcal pit extraction was more affected by the image processing-related factors than the scan session or scanner factors. Moreover, the similarity of sulcal pit distribution appeared to be largely influenced by the presence or absence of the sulcal pits on the shallow and small folds. We suggest that our sulcal pit extraction from MRI is highly reliable and could be useful for clinical applications as an imaging biomarker.
| S-EPMC3538732 | biostudies-literature
Project description:Sulcal pits are thought to represent the first cortical folds of primary sulci during neurodevelopment. The uniform spatial distribution of sulcal pits across individuals is hypothesized to be predetermined by a human-specific protomap which is related to functional localization under genetic controls in early fetal life. Thus, it is important to characterize temporal and spatial patterns of sulcal pits in the fetal brain that would provide additional information of functional development of the human brain and crucial insights into abnormal cortical maturation. In this paper, we investigated temporal patterns of emergence and spatial distribution of sulcal pits using 48 typically developing fetal brains in the second half of gestation. We found that the position and spatial variance of sulcal pits in the fetal brain are similar to those in the adult brain, and they are also temporally uniform against dynamic brain growth during fetal life. Furthermore, timing of pit emergence shows a regionally diverse pattern that may be associated with the subdivisions of the protomap. Our findings suggest that sulcal pits in the fetal brain are useful anatomical landmarks containing detailed information of functional localization in early cortical development and maintaining their spatial distribution throughout the human lifetime.
| S-EPMC7264701 | biostudies-literature
Project description:The influence of genes on cortical structures has been assessed through various phenotypes. The sulcal pits, which are the putative first cortical folds, have for long been assumed to be under tight genetic control, but this was never quantified. We estimated the pit depth heritability in various brain regions using the high quality and large sample size of the Human Connectome Project pedigree cohort. Analysis of additive genetic variance indicated that their heritability ranges between 0.2 and 0.5 and displays a regional genetic control with an overall symmetric pattern between hemispheres. However, a noticeable asymmetry of heritability estimates is observed in the superior temporal sulcus and could thus be related to language lateralization. The heritability range estimated in this study reinforces the idea that cortical shape is determined primarily by nongenetic factors, which is consistent with the important increase of cortical folding from birth to adult life and thus predominantly constrained by environmental factors. Nevertheless, the genetic cues, implicated with various local levels of heritability in the formation of sulcal pits, play a fundamental role in the normal gyral pattern development. Quantifying their influence and identifying the underlying genetic variants would provide insight into neurodevelopmental disorders.
| S-EPMC7190941 | biostudies-literature
Project description:AimAttention-deficit/hyperactivity disorder (ADHD) is a common neurodevelopmental disorder associated with widespread brain morphological abnormalities. Here, we utilized a sulcal pits-based method to provide new insight into the atypical cortical folding morphology in ADHD.MethodsSulcal pits, the locally deepest points in each fold, were first extracted from magnetic resonance imaging data of 183 boys with ADHD (10.62 ± 1.96 years) and 167 age- and gender-matched typically developing controls (10.70 ± 1.73 years). Then, the geometrical properties of sulcal pits were statistically compared between ADHD and controls.ResultsOur results demonstrated that the number of sulcal pits was reduced and confined to the superficial secondary sulci in the ADHD group relative to controls (P < .05). We also found that ADHD boys were associated with significantly increased pit depth in the left superior frontal junction, circular insular sulcus, right inferior frontal junction, and bilateral cingulate sulcus, as well as significantly decreased pit depth in the bilateral orbital sulcus (P < .05, corrected).ConclusionThe experimental findings reveal atypical sulcal anatomy in boys with ADHD and support the feasibility of sulcal pits as anatomic landmarks for disease diagnosis.
| S-EPMC7871795 | biostudies-literature
Project description:MotivationAutomatic tracking of cells in multidimensional time-lapse fluorescence microscopy is an important task in many biomedical applications. A novel framework for objective evaluation of cell tracking algorithms has been established under the auspices of the IEEE International Symposium on Biomedical Imaging 2013 Cell Tracking Challenge. In this article, we present the logistics, datasets, methods and results of the challenge and lay down the principles for future uses of this benchmark.ResultsThe main contributions of the challenge include the creation of a comprehensive video dataset repository and the definition of objective measures for comparison and ranking of the algorithms. With this benchmark, six algorithms covering a variety of segmentation and tracking paradigms have been compared and ranked based on their performance on both synthetic and real datasets. Given the diversity of the datasets, we do not declare a single winner of the challenge. Instead, we present and discuss the results for each individual dataset separately.Availability and implementationThe challenge Web site (http://www.codesolorzano.com/celltrackingchallenge) provides access to the training and competition datasets, along with the ground truth of the training videos. It also provides access to Windows and Linux executable files of the evaluation software and most of the algorithms that competed in the challenge.
| S-EPMC4029039 | biostudies-literature
Project description:Protein-protein interactions (PPIs) perform various functions and regulate processes throughout cells. Knowledge of the full network of PPIs is vital to biomedical research, but most of the PPIs are still unknown. As it is infeasible to discover all of them experimentally due to technical and resource limitations, computational prediction of PPIs is essential and accurately assessing the performance of algorithms is required before further application or translation. However, many published methods compose their evaluation datasets incorrectly, using a higher proportion of positive class data than occuring naturally, leading to exaggerated performance. We re-implemented various published algorithms and evaluated them on datasets with realistic data compositions and found that their performance is overstated in original publications; with several methods outperformed by our control models built on 'illogical' and random number features. We conclude that these methods are influenced by an over-characterization of some proteins in the literature and due to scale-free nature of PPI network and that they fail when tested on all possible protein pairs. Additionally, we found that sequence-only-based algorithms performed worse than those that employ functional and expression features. We present a benchmark evaluation of many published algorithms for PPI prediction. The source code of our implementations and the benchmark datasets created here are made available in open source.
| S-EPMC8746451 | biostudies-literature
Project description:Human brain function depends on directed interactions between multiple areas that evolve in the subsecond range. Time-varying multivariate autoregressive (tvMVAR) modeling has been proposed as a way to help quantify directed functional connectivity strengths with high temporal resolution. While several tvMVAR approaches are currently available, there is a lack of unbiased systematic comparative analyses of their performance and of their sensitivity to parameter choices. Here, we critically compare four recursive tvMVAR algorithms and assess their performance while systematically varying adaptation coefficients, model order, and signal sampling rate. We also compared two ways of exploiting repeated observations: single-trial modeling followed by averaging, and multi-trial modeling where one tvMVAR model is fitted across all trials. Results from numerical simulations and from benchmark EEG recordings showed that: i) across a broad range of model orders all algorithms correctly reproduced patterns of interactions; ii) signal downsampling degraded connectivity estimation accuracy for most algorithms, although in some cases downsampling was shown to reduce variability in the estimates by lowering the number of parameters in the model; iii) single-trial modeling followed by averaging showed optimal performance with larger adaptation coefficients than previously suggested, and showed slower adaptation speeds than multi-trial modeling. Overall, our findings identify strengths and weaknesses of existing tvMVAR approaches and provide practical recommendations for their application to modeling dynamic directed interactions from electrophysiological signals.
| S-EPMC5995381 | biostudies-literature
Project description:Diffusion MRI is being used increasingly in studies of the brain and other parts of the body for its ability to provide quantitative measures that are sensitive to changes in tissue microstructure. However, inter-scanner and inter-protocol differences are known to induce significant measurement variability, which in turn jeopardises the ability to obtain 'truly quantitative measures' and challenges the reliable combination of different datasets. Combining datasets from different scanners and/or acquired at different time points could dramatically increase the statistical power of clinical studies, and facilitate multi-centre research. Even though careful harmonisation of acquisition parameters can reduce variability, inter-protocol differences become almost inevitable with improvements in hardware and sequence design over time, even within a site. In this work, we present a benchmark diffusion MRI database of the same subjects acquired on three distinct scanners with different maximum gradient strength (40, 80, and 300?mT/m), and with 'standard' and 'state-of-the-art' protocols, where the latter have higher spatial and angular resolution. The dataset serves as a useful testbed for method development in cross-scanner/cross-protocol diffusion MRI harmonisation and quality enhancement. Using the database, we compare the performance of five different methods for estimating mappings between the scanners and protocols. The results show that cross-scanner harmonisation of single-shell diffusion data sets can reduce the variability between scanners, and highlight the promises and shortcomings of today's data harmonisation techniques.
| S-EPMC6556555 | biostudies-literature
Project description:Because of the advantages of RNA sequencing (RNA-Seq) over microarrays, it is gaining widespread popularity for highly parallel gene expression analysis. For example, RNA-Seq is expected to be able to provide accurate identification and quantification of full-length splice forms. A number of informatics packages have been developed for this purpose, but short reads make it a difficult problem in principle. Sequencing error and polymorphisms add further complications. It has become necessary to perform studies to determine which algorithms perform best and which if any algorithms perform adequately. However, there is a dearth of independent and unbiased benchmarking studies. Here we take an approach using both simulated and experimental benchmark data to evaluate their accuracy.We conclude that most methods are inaccurate even using idealized data, and that no method is highly accurate once multiple splice forms, polymorphisms, intron signal, sequencing errors, alignment errors, annotation errors and other complicating factors are present. These results point to the pressing need for further algorithm development.Simulated datasets and other supporting information can be found at http://bioinf.itmat.upenn.edu/BEERS/bp2.Supplementary data are available at Bioinformatics online.
| S-EPMC4673975 | biostudies-literature
Project description:Developers of image processing routines rely on benchmark data sets to give qualitative comparisons of new image analysis algorithms and pipelines. Such data sets need to include artifacts in order to occlude and distort the required information to be extracted from an image. Robustness, the quality of an algorithm related to the amount of distortion is often important. However, using available benchmark data sets an evaluation of illumination robustness is difficult or even not possible due to missing ground truth data about object margins and classes and missing information about the distortion. We present a new framework for robustness evaluation. The key aspect is an image benchmark containing 9 object classes and the required ground truth for segmentation and classification. Varying levels of shading and background noise are integrated to distort the data set. To quantify the illumination robustness, we provide measures for image quality, segmentation and classification success and robustness. We set a high value on giving users easy access to the new benchmark, therefore, all routines are provided within a software package, but can as well easily be replaced to emphasize other aspects.
| S-EPMC4508044 | biostudies-literature