A semi-automated workflow for biodiversity data retrieval, cleaning, and quality control.
Ontology highlight
ABSTRACT:
SUBMITTER: Mathew C
PROVIDER: S-EPMC4267104 | biostudies-other | 2014
REPOSITORIES: biostudies-other
Similar Datasets
Project description:The quality of data used for QSAR model derivation is extremely important as it strongly affects the final robustness and predictive power of the model. Ambiguous or wrong structures need to be carefully checked, because they lead to errors in calculation of descriptors, hence leading to meaningless results. The increasing amounts of data, however, have often made it hard to check of very large databases manually. In the light of this, we designed and implemented a semi-automated workflow integrating structural data retrieval from several web-based databases, automated comparison of these data, chemical structure cleaning, selection and standardization of data into a consistent, ready-to-use format that can be employed for modeling. The workflow integrates best practices for data curation that have been suggested in the recent literature. The workflow has been implemented with the freely available KNIME software and is freely available to the cheminformatics community for improvement and application to a broad range of chemical datasets.
| S-EPMC6503381 | biostudies-literature
Project description:PurposeAdaptive radiation therapy (ART) on the integrated Elekta Unity magnetic resonance (MR)-linac requires routine quality assurance to verify delivery accuracy and system data transfer. In this work, our objective was to develop and validate a novel automated end-to-end test suite that verifies data transfer between multiple software platforms and quantifies the performance of multiple machine subcomponents critical to the ART process.MethodsWe designed and implemented a software tool to quantify the MR and megavoltage (MV) isocenter coincidence, treatment couch positioning consistency, isocenter shift accuracy for the adapted plan as well as the MLC and jaw position accuracy following the beam aperture adaptation. Our tool employs a reference treatment plan with a simulated isocenter shift generated on an MR image of a readily available phantom with MR and MV visible fiducials. Execution of the test occurs within the standard adapt-to-position (ATP) clinical workflow with MV images collected of the delivered treatment fields. Using descriptive statistics, we quantified uncertainty in couch positioning, isocentre shift as well as the jaw and MLC positions of the adapted fields. We also executed sensitivity measurements to evaluate the detection algorithm's performance.ResultsWe report the results of 301 daily testing instances. We demonstrated consistent tracking of the MR-to-MV alignment with respect to the established value and to detect small changes on the order of 0.2 mm following machine service events. We found couch position consistency relative to the test baseline value was within 95% CI [-0.31, 0.26 mm]. For phantom shifts that form the basis for the plan adaptation, we found agreement between MV-image-detected phantom shift and online image registration, within ± 1.5 mm in all directions with a 95% CI difference of [-1.29, 0.79 mm]. For beam aperture adaptation accuracy, we found differences between the planned and detected jaw positions had a mean value of 0.27 mm and 95% CI of [-0.29, 0.82 mm] and -0.17 mm and 95% CI of [-0.37, 0.05 mm] for the MLC positions. Automated fiducial detected accuracy was within 0.08 ± 0.20 mm of manual localization. Introduced jaw and MLC position errors (1-10 mm) were detected within 0.55 mm (within 1 mm for 15/256 instances for the jaws). Phantom shifts (1.3 or 5 mm in each cardinal direction) from a reference position were detected within 0.26 mm.ConclusionsWe have demonstrated the accuracy and sensitivity of a daily end-to-end test suite capable of detecting errors in multiple machine subcomponents including system data transfer. Our test suite evaluates the entire treatment workflow and has captured system communication issues prior to patient treatment. With automated processing and the use of a standard vendor-provided phantom, it is possible to expand to other Unity sites.
| S-EPMC10161066 | biostudies-literature
Project description:SummaryThe advent of spatial transcriptomics has revolutionized our understanding of the spatial heterogeneity in tissues, providing unprecedented insights into the cellular and molecular mechanisms underlying biological processes. Although quality control (QC) critical for downstream data analyses, there is currently a lack of specialized tools for one-stop spatial transcriptome QC. Here, we introduce SpatialQC, a one-stop QC pipeline, which generates comprehensive QC reports and produces clean data in an interactive fashion. SpatialQC is widely applicable to spatial transcriptomic techniques.Availability and implementationsource code and user manuals are available via https://github.com/mgy520/spatialQC, and deposited on Zenodo (https://doi.org/10.5281/zenodo.12634669).
| S-EPMC11333854 | biostudies-literature
Project description:Advances in several key technologies, including MHC peptidomics, has helped fuel our understanding of basic immune regulatory mechanisms and identify T cell receptor targets for the development of immunotherapeutics. Isolating and accurately quantifying MHC-bound peptides from cells and tissues enables characterization of dynamic changes in the ligandome due to cellular perturbations. This multi-step analytical process remains challenging, and throughput and reproducibility are paramount for rapidly characterizing multiple conditions in parallel. Here, we describe a robust and quantitative method whereby peptides derived from MHC-I complexes from a variety of cell lines, including challenging adherent lines, can be enriched in a semi-automated fashion on reusable, dry-storage, customized antibody cartridges. TOMAHAQ, a targeted mass spectrometry technique that combines sample multiplexing and high sensitivity, was employed to characterize neoepitopes displayed on MHC-I by tumor cells and to quantitatively assess the influence of neoantigen expression and induced degradation on neoepitope presentation.
2021-07-20 | GSE163326 | GEO
Project description:With the rapid development of science, technology, and engineering, large amounts of data have been generated in many fields in the past 20 years. In the process of medical research, data are constantly generated, and large amounts of real-world data form a "data disaster." Effective data analysis and mining are based on data availability and high data quality. The premise of high data quality is the need to clean the data. Data cleaning is the process of detecting and correcting "dirty data," which is the basis of data analysis and management. Moreover, data cleaning is a common technology for improving data quality. However, the current literature on real-world research provides little guidance on how to efficiently and ethically set up and perform data cleaning. To address this issue, we proposed a data cleaning framework for real-world research, focusing on the 3 most common types of dirty data (duplicate, missing, and outlier data), and a normal workflow for data cleaning to serve as a reference for the application of such technologies in future studies. We also provided relevant suggestions for common problems in data cleaning.
| S-EPMC10557005 | biostudies-literature
Project description:Data sharing and reuse are crucial to enhance scientific progress and maximize return of investments in science. Although attitudes are increasingly favorable, data reuse remains difficult due to lack of infrastructures, standards, and policies. The FAIR (findable, accessible, interoperable, reusable) principles aim to provide recommendations to increase data reuse. Because of the broad interpretation of the FAIR principles, maturity indicators are necessary to determine the FAIRness of a dataset. In this work, we propose a reproducible computational workflow to assess data FAIRness in the life sciences. Our implementation follows principles and guidelines recommended by the maturity indicator authoring group and integrates concepts from the literature. In addition, we propose a FAIR balloon plot to summarize and compare dataset FAIRness. We evaluated the feasibility of our method on three real use cases where researchers looked for six datasets to answer their scientific questions. We retrieved information from repositories (ArrayExpress, Gene Expression Omnibus, eNanoMapper, caNanoLab, NanoCommons and ChEMBL), a registry of repositories, and a searchable resource (Google Dataset Search) via application program interfaces (API) wherever possible. With our analysis, we found that the six datasets met the majority of the criteria defined by the maturity indicators, and we showed areas where improvements can easily be reached. We suggest that use of standard schema for metadata and the presence of specific attributes in registries of repositories could increase FAIRness of datasets.
| S-EPMC7594074 | biostudies-literature
Project description:Quantifying, controlling, and monitoring image quality is an essential prerequisite for ensuring the validity and reproducibility of many types of neuroimaging data analyses. Implementation of quality control (QC) procedures is the key to ensuring that neuroimaging data are of high-quality and their validity in the subsequent analyses. We introduce the QC system of the Laboratory of Neuro Imaging (LONI): a web-based system featuring a workflow for the assessment of various modality and contrast brain imaging data. The design allows users to anonymously upload imaging data to the LONI-QC system. It then computes an exhaustive set of QC metrics which aids users to perform a standardized QC by generating a range of scalar and vector statistics. These procedures are performed in parallel using a large compute cluster. Finally, the system offers an automated QC procedure for structural MRI, which can flag each QC metric as being 'good' or 'bad.' Validation using various sets of data acquired from a single scanner and from multiple sites demonstrated the reproducibility of our QC metrics, and the sensitivity and specificity of the proposed Auto QC to 'bad' quality images in comparison to visual inspection. To the best of our knowledge, LONI-QC is the first online QC system that uniquely supports the variety of functionality where we compute numerous QC metrics and perform visual/automated image QC of multi-contrast and multi-modal brain imaging data. The LONI-QC system has been used to assess the quality of large neuroimaging datasets acquired as part of various multi-site studies such as the Transforming Research and Clinical Knowledge in Traumatic Brain Injury (TRACK-TBI) Study and the Alzheimer's Disease Neuroimaging Initiative (ADNI). LONI-QC's functionality is freely available to users worldwide and its adoption by imaging researchers is likely to contribute substantially to upholding high standards of brain image data quality and to implementing these standards across the neuroimaging community.
| S-EPMC6722229 | biostudies-literature
Project description:PremiseHeterogeneity of biodiversity data from the collections, research, and management communities presents challenges for data findability, accessibility, interoperability, and reusability. Workflows designed with data collection, standards, dissemination, and reuse in mind will generate better information across geopolitical, administrative, and institutional boundaries. Here, we present our data workflow as a case study of how we collected, shared, and used data from multiple sources.MethodsIn 2012, we initiated the collection of biodiversity data relating to Michigan prairie fens, including data on plant communities and the federally endangered Poweshiek skipperling (Oarisma poweshiek).ResultsOver 23,000 occurrence records were compiled in a database following Darwin Core standards. The records were linked with media and biological, chemical, and geometric measurements. We published the data as Global Biodiversity Information Facility data sets and in Symbiota SEINet portals.DiscussionWe highlight data collection techniques that optimized transcription time, including the use of predetermined and controlled vocabulary, Darwin Core terms, and data dictionaries. The validity and longevity of our data were supported by voucher specimens, metadata with measurement records, and published manuscripts detailing methods and data sets. Key to our data dissemination was cooperation among partners and the utilization of dynamic tools. To increase data interoperability, we need flexible and customizable data collection templates, coding, and enhanced communication among communities using biodiversity data.
| S-EPMC6923704 | biostudies-literature
Project description:SummarySingle-cell DNA template strand sequencing (Strand-seq) enables chromosome length haplotype phasing, construction of phased assemblies, mapping sister-chromatid exchange events and structural variant discovery. The initial quality control of potentially thousands of single-cell libraries is still done manually by domain experts. ASHLEYS automates this tedious task, delivers near-expert performance and labels even large data sets in seconds.Availability and implementationgithub.com/friendsofstrandseq/ashleys-qc, MIT license.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC8504637 | biostudies-literature
Project description:BackgroundCurrent text mining tools supporting abstract screening in systematic reviews are not widely used, in part because they lack sensitivity and precision. We set out to develop an accessible, semi-automated "workflow" to conduct abstract screening for systematic reviews and other knowledge synthesis methods.MethodsWe adopt widely recommended text-mining and machine-learning methods to (1) process title-abstracts into numerical training data; and (2) train a classification model to predict eligible abstracts. The predicted abstracts are screened by human reviewers for ("true") eligibility, and the newly eligible abstracts are used to identify similar abstracts, using near-neighbor methods, which are also screened. These abstracts, as well as their eligibility results, are used to update the classification model, and the above steps are iterated until no new eligible abstracts are identified. The workflow was implemented in R and evaluated using a systematic review of insulin formulations for type-1 diabetes (14,314 abstracts) and a scoping review of knowledge-synthesis methods (17,200 abstracts). Workflow performance was evaluated against the recommended practice of screening abstracts by 2 reviewers, independently. Standard measures were examined: sensitivity (inclusion of all truly eligible abstracts), specificity (exclusion of all truly ineligible abstracts), precision (inclusion of all truly eligible abstracts among all abstracts screened as eligible), F1-score (harmonic average of sensitivity and precision), and accuracy (correctly predicted eligible or ineligible abstracts). Workload reduction was measured as the hours the workflow saved, given only a subset of abstracts needed human screening.ResultsWith respect to the systematic and scoping reviews respectively, the workflow attained 88%/89% sensitivity, 99%/99% specificity, 71%/72% precision, an F1-score of 79%/79%, 98%/97% accuracy, 63%/55% workload reduction, with 12%/11% fewer abstracts for full-text retrieval and screening, and 0%/1.5% missed studies in the completed reviews.ConclusionThe workflow was a sensitive, precise, and efficient alternative to the recommended practice of screening abstracts with 2 reviewers. All eligible studies were identified in the first case, while 6 studies (1.5%) were missed in the second that would likely not impact the review's conclusions. We have described the workflow in language accessible to reviewers with limited exposure to natural language processing and machine learning, and have made the code available to reviewers.
| S-EPMC8152711 | biostudies-literature