Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Development of an Evolutionary Tree Concept Inventory.

ABSTRACT: Despite the importance of tree-thinking and evolutionary trees to biology, no appropriately developed concept inventory exists to measure student understanding of these important concepts. To address this need, we developed a multiple-choice concept inventory consisting of 24 pairs of items, and we provide evidence to support its use among undergraduate students. A set of learning outcomes was developed to guide the creation of the concept inventory. The learning outcomes, student interviews, and student responses were used to develop and revise inventory items. Supporting evidence was gathered from traditional item analysis, exploratory factor analysis, confirmatory factor analysis, traditional reliability analyses, and comparisons to alternative assessments. Appropriate implementation and utility of the concept inventory are discussed.

SUBMITTER: Kummer TA

PROVIDER: S-EPMC6713480 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Development of an Evolutionary Tree Concept Inventory.

Kummer Tyler A TA Whipple Clinton J CJ Bybee Seth M SM Adams Byron J BJ Jensen Jamie L JL

Journal of microbiology & biology education 20190830 2

Despite the importance of tree-thinking and evolutionary trees to biology, no appropriately developed concept inventory exists to measure student understanding of these important concepts. To address this need, we developed a multiple-choice concept inventory consisting of 24 pairs of items, and we provide evidence to support its use among undergraduate students. A set of learning outcomes was developed to guide the creation of the concept inventory. The learning outcomes, student interviews, an ...[more]

PMID: 31501685

Similar Datasets

Development of a meiosis concept inventory.

Project description:We have designed, developed, and validated a 17-question Meiosis Concept Inventory (Meiosis CI) to diagnose student misconceptions on meiosis, which is a fundamental concept in genetics. We targeted large introductory biology and genetics courses and used published methodology for question development, which included the validation of questions by student interviews (n = 28), in-class testing of the questions by students (n = 193), and expert (n = 8) consensus on the correct answers. Our item analysis showed that the questions' difficulty and discrimination indices were in agreement with published recommended standards and discriminated effectively between high- and low-scoring students. We foresee other institutions using the Meiosis CI as both a diagnostic tool and an instrument to assess teaching effectiveness and student progress, and invite instructors to visit http://q4b.biology.ubc.ca for more information.

| S-EPMC3846516 | biostudies-literature

Development of a Lac Operon Concept Inventory (LOCI).

Project description:Concept inventories (CIs) are valuable tools for educators that assess student achievement and identify misconceptions held by students. Results of student responses can be used to adjust or develop new instructional methods for a given topic. The regulation of gene expression in both prokaryotes and eukaryotes is an important concept in genetics and one that is particularly challenging for undergraduate students. As part of a larger study examining instructional methods related to gene regulation, the authors developed a 12-item CI assessing student knowledge of the lac operon. Using an established protocol, the authors wrote open-ended questions and conducted in-class testing with undergraduate microbiology and genetics students to discover common errors made by students about the lac operon and to determine aspects of item validity. Using these results, we constructed a 12-item multiple-choice lac operon CI called the Lac Operon Concept Inventory (LOCI), The LOCI was reviewed by two experts in the field for content validity. The LOCI underwent item analysis and was assessed for reliability with a sample of undergraduate genetics students (n = 115). The data obtained were found to be valid and reliable (coefficient alpha = 0.994) with adequate discriminatory power and item difficulty.

| S-EPMC4909346 | biostudies-literature

Development and Validation of the Homeostasis Concept Inventory.

Project description:We present the Homeostasis Concept Inventory (HCI), a 20-item multiple-choice instrument that assesses how well undergraduates understand this critical physiological concept. We used an iterative process to develop a set of questions based on elements in the Homeostasis Concept Framework. This process involved faculty experts and undergraduate students from associate's colleges, primarily undergraduate institutions, regional and research-intensive universities, and professional schools. Statistical results provided strong evidence for the validity and reliability of the HCI. We found that graduate students performed better than undergraduates, biology majors performed better than nonmajors, and students performed better after receiving instruction about homeostasis. We used differential item analysis to assess whether students from different genders, races/ethnicities, and English language status performed differently on individual items of the HCI. We found no evidence of differential item functioning, suggesting that the items do not incorporate cultural or gender biases that would impact students' performance on the test. Instructors can use the HCI to guide their teaching and student learning of homeostasis, a core concept of physiology.

| S-EPMC5459253 | biostudies-literature

Development of the Biological Experimental Design Concept Inventory (BEDCI).

Project description:Interest in student conception of experimentation inspired the development of a fully validated 14-question inventory on experimental design in biology (BEDCI) by following established best practices in concept inventory (CI) design. This CI can be used to diagnose specific examples of non-expert-like thinking in students and to evaluate the success of teaching strategies that target conceptual changes. We used BEDCI to diagnose non-expert-like student thinking in experimental design at the pre- and posttest stage in five courses (total n = 580 students) at a large research university in western Canada. Calculated difficulty and discrimination metrics indicated that BEDCI questions are able to effectively capture learning changes at the undergraduate level. A high correlation (r = 0.84) between responses by students in similar courses and at the same stage of their academic career, also suggests that the test is reliable. Students showed significant positive learning changes by the posttest stage, but some non-expert-like responses were widespread and persistent. BEDCI is a reliable and valid diagnostic tool that can be used in a variety of life sciences disciplines.

| S-EPMC4152214 | biostudies-literature

Development, Validation, and Application of the Microbiology Concept Inventory.

Project description:If we are to teach effectively, tools are needed to measure student learning. A widely used method for quickly measuring student understanding of core concepts in a discipline is the concept inventory (CI). Using the American Society for Microbiology Curriculum Guidelines (ASMCG) for microbiology, faculty from 11 academic institutions created and validated a new microbiology concept inventory (MCI). The MCI was developed in three phases. In phase one, learning outcomes and fundamental statements from the ASMCG were used to create T/F questions coupled with open responses. In phase two, the 743 responses to MCI 1.0 were examined to find the most common misconceptions, which were used to create distractors for multiple-choice questions. MCI 2.0 was then administered to 1,043 students. The responses of these students were used to create MCI 3.0, a 23-question CI that measures students' understanding of all 27 fundamental statements. MCI 3.0 was found to be reliable, with a Cronbach's alpha score of 0.705 and Ferguson's delta of 0.97. Test item analysis demonstrated good validity and discriminatory power as judged by item difficulty, item discrimination, and point-biserial correlation coefficient. Comparison of pre- and posttest scores showed that microbiology students at 10 institutions showed an increase in understanding of concepts after instruction, except for questions probing metabolism (average normalized learning gain was 0.15). The MCI will enable quantitative analysis of student learning gains in understanding microbiology, help to identify misconceptions, and point toward areas where efforts should be made to develop teaching approaches to overcome them.

| S-EPMC5976036 | biostudies-literature

Concept Inventory Development Reveals Common Student Misconceptions about Microbiology.

Project description:Misconceptions, or alternative conceptions, are incorrect understandings that students have incorporated into their prior knowledge. The goal of this study was the identification of misconceptions in microbiology held by undergraduate students upon entry into an introductory, general microbiology course. This work was the first step in developing a microbiology concept inventory based on the American Society for Microbiology's Recommended Curriculum Guidelines for Undergraduate Microbiology. Responses to true/false (T/F) questions accompanied by written explanations by undergraduate students at a diverse set of institutions were used to reveal misconceptions for fundamental microbiology concepts. These data were analyzed to identify the most difficult core concepts, misalignment between explanations and answer choices, and the most common misconceptions for each core concept. From across the core concepts, nineteen misconception themes found in at least 5% of the coded answers for a given question were identified. The top five misconceptions, with coded responses ranging from 19% to 43% of the explanations, are described, along with suggested classroom interventions. Identification of student misconceptions in microbiology provides a foundation upon which to understand students' prior knowledge and to design appropriate tools for improving instruction in microbiology.

| S-EPMC5976041 | biostudies-literature

The EvoDevoCI: a concept inventory for gauging students' understanding of evolutionary developmental biology.

Project description:The American Association for the Advancement of Science 2011 report Vision and Change in Undergraduate Biology Education encourages the teaching of developmental biology as an important part of teaching evolution. Recently, however, we found that biology majors often lack the developmental knowledge needed to understand evolutionary developmental biology, or "evo-devo." To assist in efforts to improve evo-devo instruction among undergraduate biology majors, we designed a concept inventory (CI) for evolutionary developmental biology, the EvoDevoCI. The CI measures student understanding of six core evo-devo concepts using four scenarios and 11 multiple-choice items, all inspired by authentic scientific examples. Distracters were designed to represent the common conceptual difficulties students have with each evo-devo concept. The tool was validated by experts and administered at four institutions to 1191 students during preliminary (n = 652) and final (n = 539) field trials. We used student responses to evaluate the readability, difficulty, discriminability, validity, and reliability of the EvoDevoCI, which included items ranging in difficulty from 0.22-0.55 and in discriminability from 0.19-0.38. Such measures suggest the EvoDevoCI is an effective tool for assessing student understanding of evo-devo concepts and the prevalence of associated common conceptual difficulties among both novice and advanced undergraduate biology majors.

| S-EPMC3846517 | biostudies-other

Development of the Statistical Reasoning in Biology Concept Inventory (SRBCI).

Project description:We followed established best practices in concept inventory design and developed a 12-item inventory to assess student ability in statistical reasoning in biology (Statistical Reasoning in Biology Concept Inventory [SRBCI]). It is important to assess student thinking in this conceptual area, because it is a fundamental requirement of being statistically literate and associated skills are needed in almost all walks of life. Despite this, previous work shows that non-expert-like thinking in statistical reasoning is common, even after instruction. As science educators, our goal should be to move students along a novice-to-expert spectrum, which could be achieved with growing experience in statistical reasoning. We used item response theory analyses (the one-parameter Rasch model and associated analyses) to assess responses gathered from biology students in two populations at a large research university in Canada in order to test SRBCI's robustness and sensitivity in capturing useful data relating to the students' conceptual ability in statistical reasoning. Our analyses indicated that SRBCI is a unidimensional construct, with items that vary widely in difficulty and provide useful information about such student ability. SRBCI should be useful as a diagnostic tool in a variety of biology settings and as a means of measuring the success of teaching interventions designed to improve statistical reasoning skills.

| S-EPMC4803094 | biostudies-literature

Development of the Central Dogma Concept Inventory (CDCI) Assessment Tool.

Project description:Scientific teaching requires scientifically constructed, field-tested instruments to accurately evaluate student thinking and gauge teacher effectiveness. We have developed a 23-question, multiple select-format assessment of student understanding of the essential concepts of the central dogma of molecular biology that is appropriate for all levels of undergraduate biology. Questions for the Central Dogma Concept Inventory (CDCI) tool were developed and iteratively revised based on student language and review by experts. The ability of the CDCI to discriminate between levels of understanding of the central dogma is supported by field testing (N= 54), and large-scale beta testing (N= 1733). Performance on the assessment increased with experience in biology; scores covered a broad range and showed no ceiling effect, even with senior biology majors, and pre/posttesting of a single class focused on the central dogma showed significant improvement. The multiple-select format reduces the chances of correct answers by random guessing, allows students at different levels to exhibit the extent of their knowledge, and provides deeper insight into the complexity of student thinking on each theme. To date, the CDCI is the first tool dedicated to measuring student thinking about the central dogma of molecular biology, and version 5 is ready to use.

| S-EPMC4909347 | biostudies-literature

Development and Validation of the Microbiology for Health Sciences Concept Inventory.

Project description:Identifying misconceptions in student learning is a valuable practice for evaluating student learning gains and directing educational interventions. By accurately identifying students' knowledge and misconceptions about microbiology concepts, instructors can design effective classroom practices centered on student understanding. Following the development of ASM's Curriculum Guidelines in 2012, we developed a concept inventory, the Microbiology for Health Sciences Concept Inventory (MHSCI), that measures learning gains and identifies student misconceptions in health sciences microbiology classrooms. The 23-question MHSCI was delivered to a wide variety of students at multiple institution types. Psychometric analysis identified that the MHSCI instrument is both discriminatory and reliable in measuring student learning gains. The MHSCI results correlated with course outcomes, showing the value of using the instrument alongside course level assessments to measure student learning. The MHSCI is a reliable and efficient way to measure student learning in microbiology and can be used both as a faculty development tool and an effective student assessment tool.

| S-EPMC5976039 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data