Dataset Information

Student Buy-In Toward Formative Assessments: The Influence of Student Factors and Importance for Course Success.

ABSTRACT: Formative assessment (FA) techniques, such as pre-class assignments, in-class activities, and post-class homework, have been shown to improve student learning. While many students find these techniques beneficial, some students may not understand how they support learning or may resist their implementation. Improving our understanding of FA buy-in has important implications, since buy-in can potentially affect whether students fully engage with and learn from FAs. We investigated FAs in 12 undergraduate biology courses to understand which student characteristics influenced buy-in toward FAs and whether FA buy-in predicted course success. We administered a mid-semester survey that probed student perceptions toward several different FA types, including activities occurring before, during, and after class. The survey included closed-ended questions aligned with a theoretical framework outlining key FA objectives. We used factor analysis to calculate an overall buy-in score for each student and general linear models to determine whether certain characteristics were associated with buy-in and whether buy-in predicted exam scores and course grades. We found that unfixed student qualities, such as perceptions, behaviors, and beliefs, consistently predicted FA buy-in, while fixed characteristics, including demographics, previous experiences, and incoming performance metrics, had more limited effects. Importantly, we found that higher buy-in toward most FA types predicted higher exam scores and course grades, even when controlling for demographic characteristics and previous academic performance. We further discuss steps that instructors can take to maximize student buy-in toward FAs.

SUBMITTER: Brazeal KR

PROVIDER: S-EPMC5410764 | biostudies-literature | 2017 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Student Buy-In Toward Formative Assessments: The Influence of Student Factors and Importance for Course Success.

Brazeal Kathleen R KR Couch Brian A BA

Journal of microbiology & biology education 20170421 1

Formative assessment (FA) techniques, such as pre-class assignments, in-class activities, and post-class homework, have been shown to improve student learning. While many students find these techniques beneficial, some students may not understand how they support learning or may resist their implementation. Improving our understanding of FA buy-in has important implications, since buy-in can potentially affect whether students fully engage with and learn from FAs. We investigated FAs in 12 under ...[more]

PMID: 28512523

Similar Datasets

Project description:BackgroundStudy motivation and knowledge retention benefit from regular student self-assessments. Inclusion of certainty-based learning (CBL) in computer-assisted formative tests may further enhance this by enabling students to identify whether they are uninformed or misinformed regarding the topics tested, which may trigger future study actions including instructor consultation.MethodsUsing a cross-over study design involving two out of thirteen computer-assisted formative assessments (CAFAs) of a first-year cell biology course, we compared student-instructor interactions, student learning experiences and final exam scores between two (bio)medical science student cohorts who worked with different CBL-containing CAFAs.ResultsA total of 389 students participated in the study. After completion 159 (41%) filled in a questionnaire on their experience with CBL during supervised CAFAs. In the control group the median duration of student-instructor interactions was 90 s (range 60-140 s), and this increased with 20 s to 110 s (range 60-150 s) in the group working with a CBL-based CAFA. The number of interactions was similar in both groups (0.22 per student per hour, regardless of CBL inclusion). Forty percent of the students expected that CBL would positively influence their study behavior, and 23% also anticipated a positive effect on examination scores. Student examination scores, however, were not affected by CBL. Almost half of the students (43%) were in favor of CBL inclusion in future computer-assisted learning modules, whereas 33% did not see merit in including CBL in CAFAs.ConclusionsIncorporation of CBL in a single formative assessment led to a slight increase in student-instructor interaction times, but had effect neither on the number of student-instructor interactions nor on exam scores. CBL inclusion positively influenced student's appreciation of the coursework, presumably by helping students to evaluate their mastery level and identify misconceptions. A more extensive enrollment of CBL beyond an individual formative assessment, throughout a course or a curriculum, may possibly reveal positive effects on study efficacy.

Project description:The acceptance of students to a medical school places a considerable emphasis on performance in standardized tests and undergraduate grade point average (uGPA). Traditionally, applicants may be judged as a homogeneous population according to simple quantitative thresholds that implicitly assume a linear relationship between scores and academic success. This 'one-size-fits-all' approach ignores the notion that individuals may show distinct patterns of achievement and follow diverse paths to success. In this study, we examined a dataset composed of 53 variables extracted from the admissions application records of 1,088 students matriculating to NYU School of Medicine between the years 2006-2014. We defined training and test groups and applied K-means clustering to search for distinct groups of applicants. Building an optimized logistic regression model, we then tested the predictive value of this clustering for estimating the success of applicants in medical school, aggregating eight performance measures during the subsequent medical school training as a success factor. We found evidence for four distinct clusters of students-we termed 'signatures'-which differ most substantially according to the absolute level of the applicant's uGPA and its trajectory over the course of undergraduate education. The 'risers' signature showed a relatively higher uGPA and also steeper trajectory; the other signatures showed each remaining combination of these two main factors: 'improvers' relatively lower uGPA, steeper trajectory; 'solids' higher uGPA, flatter trajectory; 'statics' both lower uGPA and flatter trajectory. Examining the success index across signatures, we found that the risers and the statics have significantly higher and lower likelihood of quantifiable success in medical school, respectively. We also found that each signature has a unique set of features that correlate with its success in medical school. The big data approach presented here can more sensitively uncover success potential since it takes into account the inherent heterogeneity within the student population.

Project description:With a motivation to immerse students in engineering design, graphics communication, and computer aided design (CAD) skills early-on in the biomedical engineering curriculum, we launched a new 2-unit laboratory course on "Graphics Design in BME" in the Spring 2020 quarter for UC Davis sophomores. Due to the COVID-19 pandemic, the course met with the significant challenge of conversion to an online mode of teaching, instead of planned face-to-face instruction. Providing formative feedback was thought to be an important step to help students succeed in their final CAD project of the course. In the process of designing feedback, we found that the concept of feedback is still fragile in an online learning environment because online learning settings provide distinct pedagogical demands as compared to face-to-face settings. The situation is especially delicate in the context of contemporary higher education imparting engineering skills, where students attend large classes, with diminished opportunities to interact with the teaching staff. The challenge we faced was to provide meaningful dialogic feedback in an online environment, especially while teaching engineering graphics design to a large class. Here we addressed this challenge by focusing on the process of structuring meaningful feedback. We designed a project assignment to be submitted as multiple deliverables to be submitted in two-stages. Then, we characterized its feedback with multiple notions, such as dialogic iterative cycles, personalized, goal-directed, immediate, in written format, and having a peer assessment component. The process of providing formative feedback online through the structure mentioned in this paper resulted in students' improved scores on the final project elements. It also helped us identify the common issues students are faltering in a graphics design class, and provide customized guidance, ideal examples of expected work, and more resources to motivate each student group to achieve mastery of course content.Supplementary informationThe online version contains supplementary material available at 10.1007/s43683-021-00046-z.

Dataset Information

Student Buy-In Toward Formative Assessments: The Influence of Student Factors and Importance for Course Success.

Publications

Student Buy-In Toward Formative Assessments: The Influence of Student Factors and Importance for Course Success.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets