Dataset Information

A statistical approach to quantitative data validation focused on the assessment of students' perceptions about biotechnology.

ABSTRACT: Student awareness levels are frequently used to evaluate the effectiveness of educational policies to promote scientific literacy. Over the last years several studies have been developed to assess students' perceptions towards science and technology, which usually rely on quantitative methods to achieve broad characterizations, and obtain quantifiable and comparable data. Although the usefulness of this information depends on its validity and reliability, validation is frequently neglected by researchers with limited background in statistics. In this context, we propose a guideline to implement a statistical approach to questionnaire validation, combining exploratory factor analysis and reliability analysis. The work focuses on the psychometric analysis of data provided by a questionnaire assessing 1196 elementary and high school students' perceptions about biotechnology. Procedural guidelines to enhance the efficiency of quantitative inquiry surveys are given, by discussing essential methodological aspects and relevant criteria to integrate theory into practice.

SUBMITTER: Fonseca MJ

PROVIDER: S-EPMC3795879 | biostudies-other | 2013

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

A statistical approach to quantitative data validation focused on the assessment of students' perceptions about biotechnology.

Fonseca Maria João MJ Costa Patrício P Lencastre Leonor L Tavares Fernando F

SpringerPlus 20131001

Student awareness levels are frequently used to evaluate the effectiveness of educational policies to promote scientific literacy. Over the last years several studies have been developed to assess students' perceptions towards science and technology, which usually rely on quantitative methods to achieve broad characterizations, and obtain quantifiable and comparable data. Although the usefulness of this information depends on its validity and reliability, validation is frequently neglected by re ...[more]

PMID: 24133646

Similar Datasets

Project description:Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument.The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined.Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years.The AEQ is a valid and reliable instrument. Initial validation supports its use to measure students' perceptions of the assessment environment in an undergraduate medical program.

Project description:BackgroundTranslational research typically requires data abstracted from medical records as well as data collected specifically for research. Unfortunately, many data within electronic health records are represented as text that is not amenable to aggregation for analyses. We present a scalable open source SQL Server Integration Services package, called Regextractor, for including regular expression parsers into a classic extract, transform, and load workflow. We have used Regextractor to abstract discrete data from textual reports from a number of 'machine generated' sources. To validate this package, we created a pulmonary function test data mart and analyzed the quality of the data mart versus manual chart review.MethodsEleven variables from pulmonary function tests performed closest to the initial clinical evaluation date were studied for 100 randomly selected subjects with scleroderma. One research assistant manually reviewed, abstracted, and entered relevant data into a database. Correlation with data obtained from the automated pulmonary function test data mart within the Northwestern Medical Enterprise Data Warehouse was determined.ResultsThere was a near perfect (99.5%) agreement between results generated from the Regextractor package and those obtained via manual chart abstraction. The pulmonary function test data mart has been used subsequently to monitor disease progression of patients in the Northwestern Scleroderma Registry. In addition to the pulmonary function test example presented in this manuscript, the Regextractor package has been used to create cardiac catheterization and echocardiography data marts. The Regextractor package was released as open source software in October 2009 and has been downloaded 552 times as of 6/1/2012.ConclusionsCollaboration between clinical researchers and biomedical informatics experts enabled the development and validation of a tool (Regextractor) to parse, abstract and assemble structured data from text data contained in the electronic health record. Regextractor has been successfully used to create additional data marts in other medical domains and is available to the public.

Project description:BackgroundWe introduce a QTL-mapping algorithm based on Statistical Machine Learning (SML) that is conceptually quite different to existing methods as there is a strong focus on generalisation ability. Our approach combines ridge regression, recursive feature elimination, and estimation of generalisation performance and marker effects using bootstrap resampling. Model performance and marker effects are determined using independent testing samples (individuals), thus providing better estimates. We compare the performance of SML against Composite Interval Mapping (CIM), Bayesian Interval Mapping (BIM) and single Marker Regression (MR) on synthetic datasets and a multi-trait and multi-environment dataset of the progeny for a cross between two barley cultivars.ResultsIn an analysis of the synthetic datasets, SML accurately predicted the number of QTL underlying a trait while BIM tended to underestimate the number of QTL. The QTL identified by SML for the barley dataset broadly coincided with known QTL locations. SML reported approximately half of the QTL reported by either CIM or MR, not unexpected given that neither CIM nor MR incorporates independent testing. The latter makes these two methods susceptible to producing overly optimistic estimates of QTL effects, as we demonstrate for MR. The QTL resolution (peak definition) afforded by SML was consistently superior to MR, CIM and BIM, with QTL detection power similar to BIM. The precision of SML was underscored by repeatedly identifying, at < or = 1-cM precision, three QTL for four partially related traits (heading date, plant height, lodging and yield). The set of QTL obtained using a 'raw' and a 'curated' version of the same genotypic dataset were more similar to each other for SML than for CIM or MR.ConclusionThe SML algorithm produces better estimates of QTL effects because it eliminates the optimistic bias in the predictive performance of other QTL methods. It produces narrower peaks than other methods (except BIM) and hence identifies QTL with greater precision. It is more robust to genotyping and linkage mapping errors, and identifies markers linked to QTL in the absence of a genetic map.

Dataset Information

A statistical approach to quantitative data validation focused on the assessment of students' perceptions about biotechnology.

Publications

A statistical approach to quantitative data validation focused on the assessment of students' perceptions about biotechnology.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets