Factors That Determine the Perceived Effectiveness of Peer Feedback in Collaborative Learning: a Mixed Methods Design.
Ontology highlight
ABSTRACT: Introduction
Peer assessment has been promoted as a valuable approach to formative assessment to support learning and peer professionalism. This mixed methods study employed a conceptual framework to explore the factors that enhance the perceived effectiveness of formative peer assessment in the context of team-based learning as a form of collaborative learning.Materials and methods
The volume and quality of written peer comments of two medical school classes at three time points were analyzed. Focus groups were then conducted to clarify issues that appeared in the quantitative data and to explore other emerging dimensions.Results
There was a notable deficiency in both the volume and quality of the comments provided, with no improvement over time. Several factors were identified, including some that are logistical and operational and can be corrected easily, such as the timing of the assignments. Others that stood out as major substantive issues and/or limitations related to the students' conceptions of the purpose of the peer assessment and to their interpersonal variables.Discussion
There were social disincentives for students to provide constructive feedback to peers with whom a continuing working relationship is necessary. There was also an inconsistency between the quality of the peer feedback being typically shallow and lacking in substance, and students considering it beneficial.Conclusion
The findings identify factors that need to be addressed in order to ensure the quality and effectiveness of formative peer assessment among medical students.
SUBMITTER: Daou D
PROVIDER: S-EPMC8368129 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BACKGROUND:The use of audit and feedback (A&F) interventions in health care has been demonstrated to generally be effective on medical teams. However, literature suggests that the response of nurses to this type of intervention may differ from that of other types of health professionals, in relation to their roles, power, and to the configuration of nursing care activities. To our knowledge, no review has been conducted on A&F interventions with nurses. The objective of this systematic review is to examine the evidence of measured and perceived effects of A&F interventions on nurses' performance. METHODS:A mixed methods systematic review design with thematic and narrative synthesis is used. Studies reporting quantitative and qualitative data on the effects of A&F interventions specific to nursing care are considered for inclusion. Studies will be appraised for quality using the Mixed Methods Appraisal Tool. Quantitative and qualitative data will be summarized in narrative and tabular form and will be synthetized using a segregated methodologies approach. DISCUSSION:Results will describe the characteristics of A&F with nurses, as well as the measured and perceived effects specific to nursing care. The associations between the characteristics and the effects as well as the concordance between measured and perceived effects will be presented. We anticipate that combining the evidence from qualitative and quantitative studies will allow us to provide relevant insight that can inform the design of better suited A&F interventions for nurses. Audit and feedback interventions demonstrate potential for improving the performance of nursing care. As their effectiveness varies greatly depending on the context and the professionals involved, a better understanding of the associations between its characteristics and the measured and perceived effects is valuable for improving the effectiveness of A&F. SYSTEMATIC REVIEW REGISTRATION:PROSPERO CRD42018104973.
| S-EPMC6357419 | biostudies-literature
Project description:BackgroundMultidisciplinary collaboration is essential to the successful development of serious games, albeit difficult to achieve. In a previous study, the co.LAB serious game design framework was created to support collaboration within serious game multidisciplinary design teams. Its use has not yet been validated in a real usage context.ObjectiveThe objective of this study was to perform a first assessment of the impact of the co.LAB framework on collaboration within multidisciplinary teams during serious game design and development.MethodsA mixed methods study was conducted, based on 2 serious game design projects in which the co.LAB framework was used. The first phase was qualitative and carried out using a general inductive approach. To this end, all members of the first serious game project team who used the co.LAB framework were invited to take part in a focus group session (n=6). In a second phase, results inferred from qualitative data were used to define a quantitative instrument (questionnaire) that was designed according to the Checklist for Reporting Results of Internet E-Surveys. Members of both project teams (n=11) were then asked to answer the questionnaire. Quantitative results were reported as median (Q1, Q3), and appropriate nonparametric tests were used to assess between-group differences. Finally, results gathered through the qualitative and quantitative phases were integrated.ResultsIn both phases, the participation rate was 100% (6/6 and 11/11). Verbatim transcripts were classified into 4 high level themes: (1) influence on collaborative dimensions; (2) impact on project course, monitoring, and efficiency; (3) qualitative perceptions of the framework; and (4) influence of team composition on the use of the framework. The web-based questionnaire was then developed according to the 7 dimensions of collaboration by Burkhardt et al. In both projects, the co.LAB framework had a positive impact on most dimensions of collaboration during the multidisciplinary design and development of serious games. When all collaborative dimensions were aggregated, the overall impact of the framework was rated on a scale from -42 to 42 (very negative to very positive). The overall median score was 23 (Q1, Q3: 20, 27), with no significant difference between groups (P=.58). Most respondents also believed that all serious game design teams should include a member possessing significant expertise in serious game design to guide the development process.ConclusionsThe co.LAB framework had a positive impact on collaboration within serious game design and development teams. However, expert guidance seems necessary to maximize development efficiency. Whether such guidance can be provided by means of a collaborative web platform remains to be determined.
| S-EPMC8663511 | biostudies-literature
Project description:BackgroundPeer review in Team-based learning (TBL) exists for three key reasons: to promote reflection on individual behaviours; provide opportunities to develop professional skills; and prevent 'free riders' who fail to contribute effectively to team discussions. A well-developed process that engages students is needed. However, evidence suggests it remains a difficult task to effectively incorporate into TBL. The purpose of this study was to assess medical students' ability to provide written feedback to their peers in TBL, and to explore students' perception of the process, using the conceptual framework of Biggs '3P model'.MethodsYear 2 students (n = 255) participated in peer review twice during 2019. We evaluated the quality of feedback using a theoretically derived rubric, and undertook a qualitative analysis of focus group data to seek explanations for feedback behaviors.ResultsStudents demonstrated reasonable ability to provide positive feedback, but were less prepared to identify areas for improvement. Their ability did not improve over time, and was influenced by the perceived task difficulty; social discomfort; and sense of responsibility in providing written feedback.ConclusionsTo increase student engagement, we require a transparent process that incorporates verbal feedback and team discussion, with monitoring of outcomes by faculty and adequate training.
| S-EPMC8359024 | biostudies-literature
Project description:Background Learning patient outcomes is recognized as crucial for ongoing refinement of clinical decision-making, but is often difficult in fragmented care with frequent handoffs. Data on resident habits of seeking outcome feedback after handoffs are lacking. Methods We performed a mixed-methods study including (1) an analysis of chart re-access rates after handoffs performed using access logs of the electronic health record (EHR); and (2) a web-based survey sent to internal medicine (IM) and emergency medicine (EM) residents about their habits of and barriers to learning the outcomes of patients after they have handed them off to other teams. Results Residents on ward rotations were often able to re-access charts of patients after handoffs, but those on EM or night admitting rotations did so <5% of the time. Among residents surveyed, only a minority stated that they frequently find out the outcomes of patients they have handed off, although learning outcomes was important to both their education and job satisfaction. Most were not satisfied with current systems of learning outcomes of patients after handoffs, citing too little time and lack of reliable patient tracking systems as the main barriers. Conclusions Despite perceived importance of learning outcomes after handoffs, residents cite difficulty with obtaining such information. Systematically providing feedback on patient outcomes would meet a recognized need among physicians in training.
| S-EPMC6556111 | biostudies-literature
Project description:BackgroundVirtual simulations are used throughout healthcare training programs to enable development of clinical skills, however the potential for virtual simulation to enhance cognitive and affective skills is less well understood. This study explored pre-clinical optometry students' perceptions of the impact of virtual simulation on the development of core competency skills including patient-centred care, communication, scientific literacy, and evidence-based practice.MethodsA mixed methods study was conducted using pre-existing anonymized data from an electronic survey distributed to pre-clinical optometry students enrolled in the double degree Bachelor of Vision Science/Master of Optometry at Deakin University, Australia. The data were interpreted using descriptive statistics and qualitative analysis using constant comparison for thematic analysis.ResultsA total of 51 responses were analyzed. Students reported that virtual simulation motivated them to become an optometrist (93%) and to learn beyond the course material (77%). Students reported that after participating in the virtual simulation, their core competency skills improved: patient-centered care (100%) evidence-based practice (93%) and clinical reasoning (93%). The themes identified through qualitative analysis were: enablers to cognitive experience in virtual simulation in optometry education, realism of the virtual simulation design, dimensions of fidelity in virtual simulations design replicated the complexity of the optometric environment, virtual simulation as an enabler for learning and assessment in optometry education, a place to develop cognitive and affective skills and application of learning in the virtual simulation developed an appreciation of future roles and professional identity.ConclusionOptometry students perceived virtual simulation in optometric education as a valuable training and assessment strategy enabled by qualities that generate contextual, cognitive, functional, task and psychological fidelity. The data provide insight to inform how optometry educators can incorporate simulation into the curriculum.
| S-EPMC9709374 | biostudies-literature
Project description:The Stillbirth Collaborative Research Network (SCRN) has conducted a multisite, population-based, case-control study, with prospective enrollment of stillbirths and livebirths at the time of delivery. This paper describes the general design, methods and recruitment experience. The SCRN attempted to enroll all stillbirths and a representative sample of livebirths occurring to residents of pre-defined geographical catchment areas delivering at 59 hospitals associated with five clinical sites. Livebirths <32 weeks gestation and women of African descent were oversampled. The recruitment hospitals were chosen to ensure access to at least 90% of all stillbirths and livebirths to residents of the catchment areas. Participants underwent a standardised protocol including maternal interview, medical record abstraction, placental pathology, biospecimen testing and, in stillbirths, post-mortem examination. Recruitment began in March 2006 and was completed in September 2008 with 663 women with a stillbirth and 1932 women with a livebirth enrolled, representing 69% and 63%, respectively, of the women identified. Additional surveillance for stillbirths continued until June 2009 and a follow-up of the case-control study participants was completed in December 2009. Among consenting women, there were high consent rates for the various study components. For the women with stillbirths, 95% agreed to a maternal interview, chart abstraction and a placental pathological examination; 91% of the women with a livebirth agreed to all of these components. Additionally, 84% of the women with stillbirths agreed to a fetal post-mortem examination. This comprehensive study is poised to systematically study a wide range of potential causes of, and risk factors for, stillbirths and to better understand the scope and incidence of the problem.
| S-EPMC3665402 | biostudies-literature
Project description:We performed a mixed-methods study to evaluate antimicrobial stewardship program (ASP) uptake and to assess variability of program implementation in Missouri hospitals. Despite increasing uptake of ASPs in Missouri, there is wide variability in both the scope and sophistication of these programs.
| S-EPMC7967295 | biostudies-literature
Project description:BackgroundInterprofessional practice (IPP) has been shown to contribute to quality service provision and improved health outcomes. This knowledge has led to the integration of interprofessional education into course curricula for many health-care disciplines. Offering interprofessional education in rural areas to students undertaking work integrated learning placements is challenging particularly because of the diversity of students and placement dates combined with the student focus on the assessable placement curriculum. This research investigated and evaluated the utility of an escape room as an educational modality that facilitates learning whilst providing a supportive and motivating learning environment. Our project focused on the acquisition of interprofessional practice knowledge and experience by a health professional student cohort.MethodsThis study used the novel intervention of an escape room combined with an interactive teaching session to test student engagement and learning about interprofessional practice and teamwork. The research used a mixed methods single group pre-post design.ResultsFifty students (78% female) from seventeen universities and seven professions participated in teams of three to six members. Most participants (66%) had not previously completed an escape room. The results showed that the intervention provided effective and engaging learning and was intrinsically appealing to students despite its non-assessable nature. Individual student reflection on their participation showed developing insight into the critical importance of clear communication and intentional team member collaboration in the provision of effective interprofessional practice.ConclusionsThe escape room intervention added value to the placement curriculum and proved flexible for a heterogeneous student cohort.
| S-EPMC8056636 | biostudies-literature
Project description:OBJECTIVE:To assess the feasibility and acceptability of a mobile health platform supporting Collaborative Care. METHOD:Collaborative Care patients (n=17) used a smartphone app to transmit PHQ-9 and GAD-7 scores and sensor data to a dashboard used by one care manager. Patients completed usability and satisfaction surveys and qualitative interviews at 4weeks and the care manager completed a qualitative interview. Mobile metadata on app usage was obtained. RESULTS:All patients used the app for 4weeks, but only 35% (n=6) sustained use at 8weeks. Prior to discontinuing use, 88% (n=15) completed all PHQ-9 and GAD-7 measures, with lower response rates for daily measures. Four themes emerged from interviews: understanding the purpose; care manager's role in supporting use; benefits of daily monitoring; and privacy / security concerns. Two themes were user-specific: patients' desire for personalization; and care manager burden. CONCLUSIONS:The feasibility and acceptability of the mobile platform is supported by the high early response rate, however attrition was steep. Our qualitative findings revealed nuanced participant experiences and uncovered some concerns about mobile health. To encourage retention, attention may need to be directed toward promoting patient understanding and provider engagement, and offering personalized patient experiences.
| S-EPMC6512981 | biostudies-literature
Project description:Education advocates argue that effective schools should foster multidimensional educational goals that not only include cognitive but also non-cognitive outcomes. One important non-cognitive outcome are social and emotional skills. Previous research showed that for enhancing students' social and emotional learning (SEL) one of the most important factor is the teacher. Hence, the present study investigated teachers' familiarity, beliefs, training, and perceived school culture with regard to social and emotional learning and its facets self-awareness, self-management, and social-awareness by applying a convergent parallel mixed-method design. We conducted in-depth interviews and an online survey with secondary teachers from different countries. The reason for collecting both qualitative and quantitative data was to obtain different but complementary data on the same topic in order to bring greater insight into this research question than would have been obtained by either type of data separately. Teachers reported an uncertainty and a lack of professional skills and knowledge in delivering SEL instructions that was particularly low for self-awareness and self-management. Therefore, in both study parts, teachers expressed strong interest in receiving professional SEL training. However, schools rarely provide resources (instruction materials, specific courses or activities) or create conditions (training teachers, devoting teaching hours, increasing number of counselors at schools, receiving school administration support), that would promote teachers' instruction of SEL. The results do not only add to researchers' knowledge about teachers' SEL familiarity, beliefs, training, and school culture, but are also relevant for policymakers, administrators, and school staff by identifying critical aspects that prevent successful SEL in schools.
| S-EPMC8204053 | biostudies-literature