Dataset Information

Communicating Complex STEM Program Evaluation to Diverse Stakeholders.

ABSTRACT: Visual representations, such as pathway models, are increasingly being used to both communicate higher education science, technology, engineering, and mathematics (STEM) education program evaluation plans as well as accurately represent complex programs and the systems within which the educational programs reside. However, these representations can be overwhelming to audiences that are not familiar with the program's structure or engaged in the evaluation process. The goal of this methods essay is to help both evaluators and discipline-based education researchers improve communication about program evaluation with a variety of stakeholders. We propose a three-stage method for developing progressively less complex visualizations to build affordances that help make the program evaluation process and statements of program impact more meaningful to a wider range of audiences. The creation of less complex visualizations can facilitate understanding by allowing a stakeholder to more easily "see" the structure of the program and thereby may evoke a greater willingness to take action and make meaningful programmatic changes based on strategic evaluation planning. To aid readers, we describe how we modified the Systems Evaluation Protocol (SEP) to develop simplified visualizations when evaluating a long-standing college science faculty development program, the Summer Institutes on Scientific Teaching.

SUBMITTER: Reeves PM

PROVIDER: S-EPMC8697662 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Communicating Complex STEM Program Evaluation to Diverse Stakeholders.

Reeves Philip M PM Bobrownicki Aiyana A Bauer Melanie M Graham Mark J MJ

CBE life sciences education 20200601 2

Visual representations, such as pathway models, are increasingly being used to both communicate higher education science, technology, engineering, and mathematics (STEM) education program evaluation plans as well as accurately represent complex programs and the systems within which the educational programs reside. However, these representations can be overwhelming to audiences that are not familiar with the program's structure or engaged in the evaluation process. The goal of this methods essay ...[more]

PMID: 32453678

Similar Datasets

Project description:BackgroundBacked by over 20 years of research development, the Wheelchair Skills Program (WSP) has proven to be a safe and effective program to improving wheelchair skills for adult wheelchair users. However, evidence is lacking for the pediatric population, which may help to explain the limited use of the WSP in pediatric settings. While additional evidence specific to the pediatric population is needed, concurrent implementation of the WSP into pediatric clinical practice is equally prudent to allow those users to benefit from the years of accumulated WSP evidence. To facilitate implementation of evidence-based programs into practice, adaptation is also often required to improve the fit between the program and the local context. Therefore, the objective of this study was to understand what adaptations, if any, are required for the WSP to be implementable in a pediatric setting.MethodsA deductive qualitative descriptive study design was used, guided by the Knowledge to Action Framework and Consolidated Framework for Implementation Research (CFIR). Occupational Therapists (OTs) from a pediatric rehabilitation center and two specialized schools in Montreal, Canada were invited to participate in a 90-min focus group. The Framework Method was followed for the data analysis.ResultsOne focus group in each site (n = 3) was conducted with a total of 19 participants. From the OTs' perspectives, our analysis revealed benefits of WSP use and various issues (e.g. some skills seem unrealistic) affecting its uptake in relation to the constructs of the CFIR Intervention Characteristics domain. The results provided guidance for the recommendations of adaptations (e.g. addition of a caregiver assistance score) to enhance implementation of the WSP in pediatric rehabilitation settings and helped to identify the need for the production of new knowledge and knowledge translation (KT) tools.ConclusionsImplementation of the WSP with the adaptations and KT tools proposed could allow pediatric manual wheelchair users to improve their wheelchair skills.

Dataset Information

Communicating Complex STEM Program Evaluation to Diverse Stakeholders.

Publications

Communicating Complex STEM Program Evaluation to Diverse Stakeholders.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets