Dataset Information

Development and reliability assessment of a new quality appraisal tool for cross-sectional studies using biomarker data (BIOCROSS).

ABSTRACT:

Background

Biomarker-based analyses are commonly reported in observational epidemiological studies; however currently there are no specific study quality assessment tools to assist evaluation of conducted research. Accounting for study design and biomarker measurement would be important for deriving valid conclusions when conducting systematic data evaluation.

Methods

We developed a study quality assessment tool designed specifically to assess biomarker-based cross-sectional studies (BIOCROSS) and evaluated its inter-rater reliability. The tool includes 10-items covering 5 domains: 'Study rational', 'Design/Methods', 'Data analysis', 'Data interpretation' and 'Biomarker measurement', aiming to assess different quality features of biomarker cross-sectional studies. To evaluate the inter-rater reliability, 30 studies were distributed among 5 raters and intraclass correlation coefficients (ICC-s) were derived from respective ratings.

Results

The estimated overall ICC between the 5 raters was 0.57 (95% Confidence Interval (CI): 0.38-0.74) indicating a good inter-rater reliability. The ICC-s ranged from 0.11 (95% CI: 0.01-0.27) for the domain 'Study rational' to 0.56 (95% CI: 0.40-0.72) for the domain 'Data interpretation'.

Conclusion

BIOCROSS is a new study quality assessment tool suitable for evaluation of reporting quality from cross-sectional epidemiological studies employing biomarker data. The tool proved to be reliable for use by biomedical scientists with diverse backgrounds and could facilitate comprehensive review of biomarker studies in human research.

SUBMITTER: Wirsching J

PROVIDER: S-EPMC6219097 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundWith the rapid increase in genome sequencing projects for non-model organisms, numerous genome assemblies are currently in progress or available as drafts, but not made available as satisfactory, usable genomes. Data quality assessment of genome assemblies is gaining importance not only for people who perform the assembly/re-assembly processes, but also for those who attempt to use assemblies as maps in downstream analyses. Recent studies of the quality control, quality evaluation/ assessment of genome assemblies have focused on either quality control of reads before assemblies or evaluation of the assemblies with respect to their contiguity and correctness. However, correctness assessment depends on a reference and is not applicable for de novo assembly projects. Hence, development of methods providing both post-assembly and pre-assembly quality assessment reports for examining the quality/correctness of de novo assemblies and the input reads is worth studying.ResultsWe present SQUAT, an efficient tool for both pre-assembly and post-assembly quality assessment of de novo genome assemblies. The pre-assembly module of SQUAT computes quality statistics of reads and presents the analysis in a well-designed interface to visualize the distribution of high- and poor-quality reads in a portable HTML report. The post-assembly module of SQUAT provides read mapping analytics in an HTML format. We categorized reads into several groups including uniquely mapped reads, multiply mapped, unmapped reads; for uniquely mapped reads, we further categorized them into perfectly matched, with substitutions, containing clips, and the others. We carefully defined the poorly mapped (PM) reads into several groups to prevent the underestimation of unmapped reads; indeed, a high PM% would be a sign of a poor assembly that requires researchers' attention for further examination or improvements before using the assembly. Finally, we evaluate SQUAT with six datasets, including the genome assemblies for eel, worm, mushroom, and three bacteria. The results show that SQUAT reports provide useful information with details for assessing the quality of assemblies and reads.AvailabilityThe SQUAT software with links to both its docker image and the on-line manual is freely available at https://github.com/luke831215/SQUAT .

Project description:BackgroundPopulation-based surveys collect crucial data on anthropometric measures to track trends in stunting [height-for-age z score (HAZ) < -2SD] and wasting [weight-for-height z score (WHZ) < -2SD] prevalence among young children globally. However, the quality of the anthropometric data varies between surveys, which may affect population-based estimates of malnutrition.ObjectivesWe aimed to develop composite indices of anthropometric data quality for use in multisurvey analysis of child health and nutritional status.MethodsWe used anthropometric data for children 0-59 mo of age from all publicly available Demographic and Health Surveys (DHS) from 2000 onwards. We derived 6 indicators of anthropometric data quality at the survey level, including 1) date of birth completeness, 2) anthropometric measure completeness, 3) digit preference for height and age, 4) difference in mean HAZ by month of birth, 5) proportion of biologically implausible values, and 6) dispersion of HAZ and WHZ distribution. Principal component factor analysis was used to generate a composite index of anthropometric data quality for HAZ and WHZ separately. Surveys were ranked from the highest (best) to the lowest (worst) index values in anthropometric quality across countries and over time.ResultsOf the 145 DHS included, the majority (83 of 145; 57%) were conducted in Sub-Saharan Africa. Surveys were ranked from highest to lowest anthropometric data quality relative to other surveys using the composite index for HAZ. Although slightly higher values in recent DHS suggest potential improvements in anthropometric data quality over time, there continues to be substantial heterogeneity in the quality of anthropometric data across surveys. Results were similar for the WHZ data quality index.ConclusionsA composite index of anthropometric data quality using a parsimonious set of individual indicators can effectively discriminate among surveys with excellent and poor data quality. Such indices can be used to account for variations in anthropometric data quality in multisurvey epidemiologic analyses of child health.

Project description:ObjectiveHearing impairments (HIs) that progress or have later onset may have specific effects on language and cognitive development, but are difficult to suspect during routine primary care visits. Family concern regarding hearing is thought to represent an important risk factor requiring audiological examination. Yet it is not clear how successful parents are in recognising the consequences or specific suspect elements of HI in young children. The aim of this study is to verify whether parents of at-risk children recognise the presence of HI through a parental questionnaire that draws attention to auditory skills development and compares them with language and communication skills.DesignObservational study.SettingFrom 2013 to 2019, parents were administered the Questionnaire on Hearing and Communication Abilities before audiological evaluation of their children at a secondary care institute.Participants309 Italian children (1-36 months old) at risk of HI.Primary and secondary outcome measuresQuestionnaire sensitivity in predicting the presence and type of HI.ResultsParents report a decrease in auditory skills for children with sensorineural HI (Χ2(2)=14.4, p=0.003), with an increased concern expressed in 59% compared with 24% in normally hearing children. Both auditory (r=-0.18, p=0.002) and comprehension (r=-0.13, p=0.057) skills weakly but negatively correlated with a diagnosis of HI. On discriminant analysis, the positive predictive value of the questionnaire was 0.78, but with low sensitivity (0.39).ConclusionsParents of children with a verified risk of HI have some capacity to recognise non-typical auditory behaviour. Thus, it is important to assess parental concerns during primary care health visits, and a targeted questionnaire on auditory abilities can complement existing screening procedures. However, given the low sensitivity of the questionnaire, we conclude that for a reliable detection of HIs that progress or have later onset an objective screening tool is always required.