Dataset Information

Extending the use of the conceptions of learning and teaching (COLT) instrument to the postgraduate setting.

ABSTRACT:

Background

Several studies have shown that conceptions of teachers on teaching and learning can influence the teaching practices and behavior in higher education. This association is also found in undergraduate medical education but not yet established in postgraduate medical setting. An instrument, Conceptions of Learning and Teaching (COLT) was developed to measure conception of teachers in undergraduate medical education. COLT is a 3-factor 18-item questionnaire. The objective of this study is to evaluate if COLT is valid for postgraduate medical education.

Methods

We invited postgraduate clinical faculty from 3 hospitals in the Netherlands to fill out the COLT. Confirmatory and exploratory factor analysis were performed to evaluate the fit of the postgraduate clinical faculty data to the COLT. Analysis of variance was done to evaluate if there was difference among the 3 hospitals in terms of the response by the clinical faculty.

Results

Confirmatory factor analysis showed that the postgraduate faculty data had a 2 factor structure after removal of five items. These factors were Teacher Centeredness (TC) and combined Appreciation of Active Learning and Orientation to Professional Practice (A-P) and were considered as comparable to the factors in the original COLT, expressing the post-graduate learning and teaching setting. As several items were removed, the fit was suboptimal, yet did suggest validity for use of the COLT for postgraduate medical education.

Conclusion

The modified COLT can be used to measure conceptions of teaching and learning in postgraduate medical education. We recommend further study to improve the factor structure of the modified COLT.

SUBMITTER: Pacifico JL

PROVIDER: S-EPMC7792289 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Extending the use of the conceptions of learning and teaching (COLT) instrument to the postgraduate setting.

Pacifico Jaime L JL van Mook Walther W Donkers Jeroen J Jacobs Johanna C G JCG van der Vleuten Cees C Heeneman Sylvia S

BMC medical education 20210107 1

<h4>Background</h4>Several studies have shown that conceptions of teachers on teaching and learning can influence the teaching practices and behavior in higher education. This association is also found in undergraduate medical education but not yet established in postgraduate medical setting. An instrument, Conceptions of Learning and Teaching (COLT) was developed to measure conception of teachers in undergraduate medical education. COLT is a 3-factor 18-item questionnaire. The objective of this ...[more]

PMID: 33413352

Similar Datasets

Project description:IntroductionConceptions of learning and teaching refer to what faculty think about teaching effectiveness. Approaches to teaching refer to the methods they use to teach. Both conceptions and approaches range from student-centered/learning-focused (active learner engagement) to teaching-centered/content-focused (passive learner engagement). This study explored how faculty teaching experience influenced faculty conceptions and their approaches to teaching. The authors hypothesized that more experienced educators appreciate and apply active learning approaches.MethodsThe authors used a cross-sectional survey to collect anonymous data from the Basic Science faculty at Virginia Tech Carilion School of Medicine (VTCSOM). The survey included the Conceptions of Learning and Teaching scale (COLT; Jacobs et al. 2012) and demographic information. They assessed instrument reliability with Cronbach's alpha and examined relationships between variables with correlation and chi-square and group differences with ANOVA.ResultsThirty-eight percent (50/130) of faculty responded to the survey. COLT scores for student-centered (4.06 ± 0.41) were significantly higher (p < 0.001) than teacher-centered (3.12 ± 0.6). Teacher-centered scores were lower (p < 0.05) for younger (30-39, 2.65 ± 0.48) than older faculty (50-59, 3.57 ± 0.71) and were negatively correlated with using multiple teaching methods (p = 0.022). However, 83% (39/50) reported using both traditional lectures and active approaches.DiscussionFaculty conceptions about teaching showed appreciation for active learning, but a tendency to use traditional teaching methods interspersed with student-centered ones. Teaching experience was not related to faculty conceptions but was related to their teaching approaches. The amount of time dedicated to teaching was related to the appreciation of active learning, and young teachers were more student-oriented.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-021-01264-4.

Project description:BackgroundPoor communication skills can potentially compromise patient care. However, as communication skills training (CST) programs are not seen as a priority to many clinical departments, there is a discernible absence of a standardised, recommended framework for these programs to be built upon. This systematic scoping review (SSR) aims to gather prevailing data on existing CSTs to identify key factors in teaching and assessing communication skills in the postgraduate medical setting.MethodsIndependent searches across seven bibliographic databases (PubMed, PsycINFO, EMBASE, ERIC, CINAHL, Scopus and Google Scholar) were carried out. Krishna's Systematic Evidence-Based Approach (SEBA) was used to guide concurrent thematic and content analysis of the data. The themes and categories identified were compared and combined where possible in keeping with this approach and then compared with the tabulated summaries of the included articles.ResultsTwenty-five thousand eight hundred ninety-four abstracts were identified, and 151 articles were included and analysed. The Split Approach revealed similar categories and themes: curriculum design, teaching methods, curriculum content, assessment methods, integration into curriculum, and facilitators and barriers to CST. Amidst a wide variety of curricula designs, efforts to develop the requisite knowledge, skills and attitudes set out by the ACGME current teaching and assessment methods in CST maybe categorised into didactic and interactive methods and assessed along Kirkpatrick's Four Levels of Learning Evaluation.ConclusionsA major flaw in existing CSTs is a lack of curriculum structure, focus and standardisation. Based upon the findings and current design principles identified in this SSR in SEBA, we forward a stepwise approach to designing CST programs. These involve 1) defining goals and learning objectives, 2) identifying target population and ideal characteristics, 3) determining curriculum structure, 4) ensuring adequate resources and mitigating barriers, 5) determining curriculum content, and 6) assessing learners and adopting quality improvement processes.

Project description:BackgroundThe principle of workplace based assessment (WBA) is to assess trainees at work with feedback integrated into the program simultaneously. A student driven WBA model was introduced and perception evaluation of this teaching method was done subsequently by taking feedback from the faculty as well as the postgraduate trainees (PGs) of a residency program.MethodsDescriptive multimethod study was conducted. A WBA program was designed for PGs in Chemical Pathology on Moodle and forms utilized were case-based discussion (CBD), direct observation of practical skills (DOPS) and evaluation of clinical events (ECE). Consented assessors and PGs were trained on WBA through a workshop. Pretest and posttest to assess PGs knowledge before and after WBA were conducted. Every time a WBA form was filled, perception of PGs and assessors towards WBA, time taken to conduct single WBA and feedback were recorded. Faculty and PGs qualitative feedback on perception of WBA was taken via interviews. WBA tools data and qualitative feedback were used to evaluate the acceptability and feasibility of the new tools.ResultsSix eligible PGs and seventeen assessors participated in this study. A total of 79 CBDs (assessors n = 7 and PGs n = 6), 12 ECEs (assessors n = 6 and PGs n = 5), and 20 DOPS (assessors n = 6 and PGs n = 6) were documented. PGs average pretest score was 55.6%, which was improved to 96.4% in posttest; p value< 0.05. Scores of annual assessment before and after implementation of WBA also showed significant improvement, p value 0.039, Overall mean time taken to evaluate PG's was 12.6 ± 9.9 min and feedback time 9.2 ± 7.4 min. Mean WBA process satisfaction of assessors and PGs on Likert scale of 1 to 10 was 8 ± 1 and 8.3 ± 0.8 respectively.ConclusionBoth assessors and fellows were satisfied with introduction and implementation of WBA. It gave the fellows opportunity to interact with assessors more often and learn from their rich experience. Gain in knowledge of PGs was identified from the statistically significant improvement in PGs' assessment scores after WBA implementation.

Project description:BackgroundTeamwork between clinical teachers is a challenge in postgraduate medical training. Although there are several instruments available for measuring teamwork in health care, none of them are appropriate for teaching teams. The aim of this study is to develop an instrument (TeamQ) for measuring teamwork, to investigate its psychometric properties and to explore how clinical teachers assess their teamwork.MethodTo select the items to be included in the TeamQ questionnaire, we conducted a content validation in 2011, using a Delphi procedure in which 40 experts were invited. Next, for pilot testing the preliminary tool, 1446 clinical teachers from 116 teaching teams were requested to complete the TeamQ questionnaire. For data analyses we used statistical strategies: principal component analysis, internal consistency reliability coefficient, and the number of evaluations needed to obtain reliable estimates. Lastly, the median TeamQ scores were calculated for teams to explore the levels of teamwork.ResultsIn total, 31 experts participated in the Delphi study. In total, 114 teams participated in the TeamQ pilot. The median team response was 7 evaluations per team. The principal component analysis revealed 11 factors; 8 were included. The reliability coefficients of the TeamQ scales ranged from 0.75 to 0.93. The generalizability analysis revealed that 5 to 7 evaluations were needed to obtain internal reliability coefficients of 0.70. In terms of teamwork, the clinical teachers scored residents' empowerment as the highest TeamQ scale and feedback culture as the area that would most benefit from improvement.ConclusionsThis study provides initial evidence of the validity of an instrument for measuring teamwork in teaching teams. The high response rates and the low number of evaluations needed for reliably measuring teamwork indicate that TeamQ is feasible for use by teaching teams. Future research could explore the effectiveness of feedback on teamwork in follow up measurements.

Project description:BackgroundWorkplace-based assessments (WBAs) are part of a competency-based curriculum where training progression is dependent on the achievement of defined competencies in a real-world clinical environment. There is a significant literature gap on the impact of WBAs implemented in resource constrained countries and their contextual challenges. This study aimed to examine the use, impact, and educational context of WBAs in South African medical specialist training programs drawing on perspectives from both trainees and trainers to identify educational challenges and propose effective solutions.MethodsA mixed methods national electronic survey was conducted with specialist medical trainees and supervising trainers from all eight specialist training institutions in South Africa involving 16 specialities. The survey responses were voluntary and anonymous. The survey was closed after seven months when data saturation was achieved. Descriptive statistical analysis was performed using SPSS Version 27 (SPSS Inc, 2012, Chicago, IL) for the quantitative analysis. The thematic coding framework for the qualitative analysis was facilitated by NVivo Version 12 software.ResultsThere were 108 ethnically diverse supervising trainers and 248 specialist trainees' survey respondents. Across the 16 medical specialities, 45% of the respondents were using WBAs. Despite contextual resource and staff challenges, this study found that WBAs had a positive impact to Kirkpatrick level 2 in providing actionable feedback to improve competency. WBA users had a significantly higher rating for trainee supervision (p < 0.01), general quality of feedback on trainee competence (< 0.01) and the specialist training program (p = 0.03) compared to WBA non-users. They also had a higher rating for the assessment of the trainee as a professional (p < 0.01); scholar (p < 0.01); communicator (p < 0.01); collaborator (p = 0.001) and leader/manager (p < 0.001) based on the AfriMEDS competency framework. Racism, sexism and favouritism were challenges that negatively affected the training programs.ConclusionOverall, this study reports that the use of WBAs had a substantially favourable impact on teaching, learning, feedback and supports a competency-based approach to specialist training programs. Addressing the contextual concerns that negatively impact training; training the trainees and trainers about their relationship, roles and responsibilities; and focusing on a trainee-centred, inclusive and empowering teaching approach will help further enhance its effectiveness.

Project description:ContextBite-sized learning is an instructional method that utilizes brief, focused learning units. This approach may be beneficial in medical education given demands on learner time and cognitive load. This study aims to assess the impact of this approach on knowledge acquisition and learner attitudes in postgraduate medical education.MethodsAn instructional method, termed Bite-Sized Teaching (BST), was implemented within the curriculum at a US Internal Medicine postgraduate training program. In BST, content is distilled into manageable units focused on relevant schemas and delivered via brief peer teaching. A two-fold assessment of BST was performed that included cross sectional survey to assess learner attitudes and experiences and a controlled study to assess knowledge acquisition with BST and case-based teaching control.ResultsOne hundred and six of 171 residents (62% response rate) completed the survey. Most residents (79.8%) reported BST was among the best conference types in the curriculum. Important components of BST cited by residents include the distilled content, multiple short talk format and peer teaching. Residents report incorporating what they learned via BST into their teaching (76.1%) and clinical practice (74.1%). Resident who had participated as speaker were significantly more likely to report incorporating learning from BST into their teaching (87.2% vs 63.0%, p <?0.01, Cramer's V effect size = 0.37) and clinical practice (89.7% vs 65.3%, p = 0.02, Cramer's V effect size 0.28). Fifty-one residents participated in the knowledge assessment. Residents taught via BST scored significantly higher on immediate post-test compared to case-based teaching (score [SE] 62.5% [1.9] vs 55.2% [2.4], p = 0.03, Hedges g effect size 0.66). While both groups improved over pretest, there was no significant difference in scores between BST and case-based teaching at two (score [SE] 57.1 [2.1] vs 54.8 [2.5], p = 0.54) and six weeks (score [SD] 55.9 [2.1] vs 53.0 [2.9], p = 0.43).ConclusionsTeaching via brief, focused learning units delivered by peers is well received by learners and appears to have a significantly greater impact on immediate knowledge recall than case-based teaching. Further study on long term knowledge retention and behaviors is needed. Bite-Sized Teaching may be a promising instructional approach in medical education.

Project description:Objective: In order to evaluate the quality of postgraduate medical education in Germany, we examined how the learning of theoretical and practical competencies is conceptualized and how the learning process takes place in real terms. The training conditions, as perceived by medical residents, are compared with the learning objectives, as stated by the Federal Chamber of Physicians in its regulation on postgraduate education. The analysis is based on the data of the "KarMed" study (abbreviation of "career progression and career breaks among physicians during postgraduate education"), a multicentre cohort study of medical school graduates from seven universities who arre followed until they receive their licenses as specialist physicians. The study was conducted by the Institute of Primary Medical Care of the University Medical Center Hamburg-Eppendorf starting in 2008. Methodology: The KarMed study is based on annual, standardized surveys of the population described above. 48% responded in the initial survey (n=1012) and 85% or more in each of the following surveys. Descriptive statistics and logistical regressions were used for analysis. Gender-specific analyses were performed where possible in order to highlight the differences in the professional objectives and workloads between female and male physicians. Results: The study shows that both the practical and the theoretical components of postgraduate medical education in Germany are insufficient. There is a lack of a curriculum with precise learning objectives and descriptions of the corresponding educational settings. In fact, the act of learning is identical to daily clinical work. There is no structuring of the work process with regard to learning; for example, documentation procedures and feedback discussions are prescribed but largely omitted. Evidence-based medicine is not a systematic part of the training, nor is the evaluation of residents' progress. The summative final oral examination pretends that the necessary specialist competencies can be evaluated within 30 minutes. Many factors indicate that female doctors, especially those with children, have fewer learning opportunities than male doctors. Conclusion: The quality of postgraduate medical education in Germany has become inadequate, especially in an international comparison. The deficits are well known. The responsible institutions are called upon to implement sustainable reforms in the sense of postgraduate education that is structured according to educational principles and whose quality is assured.

Dataset Information

Extending the use of the conceptions of learning and teaching (COLT) instrument to the postgraduate setting.

Background

Methods

Results

Conclusion

Publications

Extending the use of the conceptions of learning and teaching (COLT) instrument to the postgraduate setting.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets