Dataset Information

Expert-Novice Comparison Reveals Pedagogical Implications for Students' Analysis of Primary Literature.

ABSTRACT: Student engagement in the analysis of primary scientific literature increases critical thinking, scientific literacy, data evaluation, and science process skills. However, little is known about the process by which expertise in reading scientific articles develops. For this reason, we decided to compare how faculty experts and student novices engage with a research article. We performed think-aloud interviews of biology faculty and undergraduates as they read through a scientific article. We analyzed these interviews using qualitative methods. We grounded data interpretation in cognitive load theory and the ICAP (interactive, constructive, active, and passive) framework. Our results revealed that faculty have more complex schemas than students and that they reduce cognitive load through two main mechanisms: summarizing and note-taking. Faculty also engage with articles at a higher cognitive level, described as constructive by the ICAP framework, when compared with students. More complex schemas, effectively lowering cognitive load, and deeper engagement with the text may help explain why faculty encounter fewer comprehension difficulties than students in our study. Finally, faculty analyze and evaluate data more often than students when reading the text. Findings include a discussion of successful pedagogical approaches for instructors wishing to enhance undergraduates' comprehension and analysis of research articles.

SUBMITTER: Nelms AA

PROVIDER: S-EPMC6829068 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Individuals usually develop a sense of place through lived experiences or travel. Here we introduce new and innovative tools to measure sense of place for remote, far-away locations, such as Greenland. We apply this methodology within place-based education to study whether we can distinguish a sense of place between those who have visited Greenland or are otherwise strongly connected to the place from those who never visited. Place-based education research indicates that an increased sense of place has a positive effect on learning outcomes. Thus, we hypothesize that vicarious experiences with a place result in a measurably stronger sense of place when compared to the sense of place of those who have not experienced the place directly. We studied two distinct groups; the first are people with a strong Greenland connection (experts, n = 93). The second are students who have never been there (novices, n = 142). Using i) emotional value attribution of words, ii) thematic analysis of phrases and iii) categorization of words, we show significant differences between novice's and expert's use of words and phrases to describe Greenland as a proxy of sense of place. Emotional value of words revealed statistically significant differences between experts and novices such as word power (dominance), feeling pleasantness (valence), and degree of arousal evoked by the word. While both groups have an overall positive impression of Greenland, 31% of novices express a neutral view with little to no awareness of Greenland (experts 4% neutral). We found differences between experts and novices along dimensions such as natural features; cultural attributes; people of Greenland; concerns, importance, or interest in and feeling connected to Greenland. Experts exhibit more complex place attributes, frequently using emotional words, while novices present a superficial picture of Greenland. Engaging with virtual environments may shift novice learners to a more expert-like sense of place, for a far-away places like Greenland, thus, we suggest virtual field trips can supplement geoscience teaching of concepts in far-away places like Greenland and beyond.

Project description:Background:It is widely reported that facilitation can aid implementation of evidence-based practices. Although scholars agree that facilitators need a diverse range of skills, only a few retrospective studies have identified some of these. During the test of a facilitation strategy within the context of a VA initiative to implement evidence-based care delivery models, we documented the skills an expert external facilitator transferred to two initially novice internal regional facilitators. Ours is the first study to explore facilitation skills as they are being applied and transferred. Methods:Facilitators applied the strategy at eight primary care clinics that lacked implementation capacity in two VA networks. We conducted monthly debriefing interviews over a 30-month period and documented these in detailed notes. External facilitator interviews focused specifically on training and mentoring internal facilitators and the skills that she transferred. We also conducted, recorded, and transcribed two qualitative interviews with each facilitator and queried them about training content and process. We conducted a content analysis of the data, using deductive and inductive methods, to identify skills the external facilitator helped internal facilitators learn. We also explored the complexity of facilitation skills and grouped them into overarching skillsets. Results:The external facilitator helped internal facilitators learn 22 complex skills; with few exceptions, these skills were not unique but overlapped with one another. We clustered 21 of these into 5 groups of overarching skillsets: (1) building relationships and creating a supportive environment, (2) changing the system of care and the structure and processes that support it, (3) transferring knowledge and skills and creating infrastructure support for ongoing learning, (4) planning and leading change efforts, and (5) assessing people, processes, and outcomes and creating infrastructure for program monitoring. Conclusions:This study documented a broad range of implementation facilitation skills that are complex and overlapping. Findings suggest that studies and initiatives planning or applying facilitation as an implementation strategy should ensure that facilitators have or have the opportunity to learn the skills they need. Because facilitation skills are complex, the use of didactic methods alone may not be sufficient for transferring skills; future work should explore other methods and techniques.

Project description:The goal of this study was to examine the ability of emergency physicians who are not experts in emergency ultrasound (US) to perform lung ultrasonography and to identify B-lines. The hypothesis was that novice sonographers are able to perform lung US and identify B-lines after a brief intervention. In addition, the authors examined the diagnostic accuracy of B-lines in undifferentiated dyspneic patients for the diagnosis of acute heart failure syndrome (AHFS), using an eight-lung-zone technique as well as an abbreviated two-lung-zone technique.This was a prospective, cross-sectional study of patients who presented to the emergency department (ED) with acute dyspnea from May 2009 to June 2010. Emergency medicine (EM) resident physicians, who received a 30-minute training course in thoracic US examinations, performed lung ultrasonography on patients presenting to the ED with undifferentiated dyspnea. They attempted to identify the presence or absence of sonographic B-lines in eight lung fields based on their bedside US examinations. An emergency US expert blinded to the diagnosis and patient presentation, as well as to the residents' interpretations of presence of B-lines, served as the criterion standard. A secondary outcome determined the accuracy of B-lines, using both an eight-lung-zone and a two-lung-zone technique, for predicting pulmonary edema from AHFS in patients presenting with undifferentiated dyspnea. Two expert reviewers who were blinded to the US results determined the clinical diagnosis of AHFS.A cohort of 66 EM resident physicians performed lung US on 380 patients with a range of 1 to 28 examinations, a mean of 5.8 examinations, and a median of three examinations performed per resident. Compared to expert interpretation, lung US to detect B-lines by inexperienced sonographers achieved the following test characteristics: sensitivity 85%, specificity 84%, positive likelihood ratio (+LR) 5.2, negative likelihood ratio (-LR) 0.2, positive predictive value (PPV) 64%, and negative predictive value (NPV) 94%. Regarding the secondary outcome, the final diagnosis was AHFS in 35% of patients (134 of 380). For novice sonographers, one positive lung zone (i.e., anything positive) had a sensitivity of 87%, a specificity of 49%, a +LR of 1.7, a -LR of 0.3, a PPV of 50%, and an NPV of 88% for predicting AHFS. When all eight lung zones were determined positive (i.e., totally positive) by novice sonographers, the sensitivity was 19%, specificity was 97%, +LR was 5.7, -LR was 0.8, PPV was 76%, and NPV was 68% for predicting AHFS. The areas under the curve for novice and expert sonographers were 0.77 (95% CI = 0.72 to 0.82) and 0.76 (95% CI = 0.71 to 0.82), respectively.Novice sonographers can identify sonographic B-lines with similar accuracy compared to an expert sonographer. Lung US has fair predictive value for pulmonary edema from acute heart failure in the hands of both novice and expert sonographers.

Project description:School mathematics comprises a diversity of concepts whose cognitive complexity is still poorly understood, a chief example being fractions. These are typically taught in middle school, but many students fail to master them, and misconceptions frequently persist into adulthood. In this study, we investigate fraction comparison, a task that taps into both conceptual and procedural knowledge of fractions, by looking at performance of highly mathematically skilled young adults. Fifty-seven Chilean engineering undergraduate students answered a computerized fraction comparison task, while their answers and response times were recorded. Task items were selected according to a number of mathematically and/or cognitively relevant characteristics: (a) whether the fractions to be compared shared a common component, (b) the numerical distance between fractions, and (c) the applicability of two strategies to answer successfully: a congruency strategy (a fraction is larger if it has larger natural number components than another) and gap thinking (a fraction is larger if it is missing fewer pieces than another to complete the whole). In line with previous research, our data indicated that the congruency strategy is inadequate to describe participants' performance, as congruent items turned out to be more difficult than incongruent ones when fractions had no common component. Although we hypothesized that this lower performance for congruent items would be explained by the use of gap thinking, this turned out not to be the case: evidence was insufficient to show that the applicability of the gap thinking strategy modulated either participants' accuracy rates or response times (although individual-level data suggest that there is an effect for response times). When fractions shared a common component, instead, our data display a more complex pattern that expected: an advantage for congruent items is present in the first experimental block but fades as the experiment progresses. Numerical distance had an effect in fraction comparison that was statistically significant for items without common components only. Altogether, our results from experts' reasoning reveal nuances in the fraction comparison task with respect to previous studies and contribute to future models of reasoning in this task.

Project description:BackgroundThere is substantial evidence that facilitation can address the challenges of implementing evidence-based innovations. However, facilitators need a wide variety of complex skills; lack of these can have a negative effect on implementation outcomes. Literature suggests that novice and less experienced facilitators need ongoing support from experts to develop these skills. Yet, no studies have investigated the transfer process. During a test of a facilitation strategy applied at 8 VA primary care clinics, we explored the techniques and processes an expert external facilitator utilized to transfer her skills to two initially novice internal facilitators who became experts.MethodsIn this qualitative descriptive study, we conducted monthly debriefings with three facilitators over a 30-month period and documented these in detailed notes. Debriefings with the expert facilitator focused on how she trained and mentored facilitation trainees. We also conducted, recorded, and transcribed two semi-structured qualitative interviews with each facilitator and queried them about training content and process. We used a mix of inductive and deductive approaches to analyze data; our analysis was informed by a review of mentoring, coaching, and cognitive apprenticeship literature. We also used a case comparison approach to explore how the expert tailored her efforts.ResultsThe expert utilized 21 techniques to transfer implementation facilitation skills. Techniques included both active (providing information, modeling, and coaching) and participatory ones. She also used techniques to support learning, i.e., cognitive supports (making thinking visible, using heuristics, sharing experiences), psychosocial supports, strategies to promote self-learning, and structural supports. Additionally, she transferred responsibility for facilitation through a dynamic process of interaction with trainees and site stakeholders. Finally, the expert varied the level of focus on particular skills to tailor her efforts to trainee and local context.ConclusionsThis study viewed the journey from novice to expert facilitator through the lens of the expert who transferred facilitation skills to support implementation of an evidence-based program. It identified techniques and processes that may foster transfer of these skills and build organizational capacity for future implementation efforts. As the first study to document the implementation facilitation skills transfer process, findings have research and practical implications.

Dataset Information

Expert-Novice Comparison Reveals Pedagogical Implications for Students' Analysis of Primary Literature.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets