Dataset Information

Do State Continuing Medical Education Requirements for Physicians Improve Clinical Knowledge?

ABSTRACT:

Objective

To evaluate the effect of state continuing medical education (CME) requirements on physician clinical knowledge.

Data sources

Secondary data for 19,563 general internists who took the Internal Medicine Maintenance of Certification (MOC) examination between 2006 and 2013.

Study design

We took advantage of a natural experiment resulting from variations in CME requirements across states over time and applied a difference-in-differences methodology to measure associations between changes in CME requirements and physician clinical knowledge. We measured changes in clinical knowledge by comparing initial and MOC examination performance 10 years apart. We constructed difference-in-differences estimates by regressing examination performance changes against physician demographics, county and year fixed effects, trend-state indicators, and state CME change indicators.

Data collection

Physician data were compiled by the American Board of Internal Medicine. State CME policies were compiled from American Medical Association reports.

Principal findings

More rigorous CME credit-hour requirements (mostly implementing a new requirement) were associated with an increase in examination performance equivalent to a shift in examination score from the 50th to 54th percentile.

Conclusions

Among physicians required to engage in a summative assessment of their clinical knowledge, CME requirements were associated with an improvement in physician clinical knowledge.

SUBMITTER: Vandergrift JL

PROVIDER: S-EPMC5980292 | biostudies-literature | 2018 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Do State Continuing Medical Education Requirements for Physicians Improve Clinical Knowledge?

Vandergrift Jonathan L JL Vandergrift Jonathan L JL Gray Bradley M BM Weng Weifeng W

Health services research 20170416 3

<h4>Objective</h4>To evaluate the effect of state continuing medical education (CME) requirements on physician clinical knowledge.<h4>Data sources</h4>Secondary data for 19,563 general internists who took the Internal Medicine Maintenance of Certification (MOC) examination between 2006 and 2013.<h4>Study design</h4>We took advantage of a natural experiment resulting from variations in CME requirements across states over time and applied a difference-in-differences methodology to measure associat ...[more]

PMID: 28419451

Similar Datasets

Project description:BackgroundCommunity health workers (CHWs) provide critical services to underserved populations in low and middle-income countries, but maintaining CHW's clinical knowledge through formal continuing medical education (CME) activities is challenging and rarely occurs. We tested whether a Short Message Service (SMS)-based mobile CME (mCME) intervention could improve medical knowledge among a cadre of Vietnamese CHWs (Community Based Physician's Assistants-CBPAs) who are the leading providers of primary medical care for rural underserved populations.MethodsThe mCME Project was a three arm randomized controlled trial. Group 1 served as controls while Groups 2 and 3 experienced two models of the mCME intervention. Group 2 (passive model) participants received a daily SMS bullet point, and were required to reply to the text to acknowledge receipt; Group 3 (interactive model) participants received an SMS in multiple choice question format addressing the same thematic area as Group 2, entering an answer (A, B, C or D) in their response. The server provided feedback immediately informing the participant whether the answer was correct. Effectiveness was based on standardized examination scores measured at baseline and endline (six months later). Secondary outcomes included job satisfaction and self-efficacy.Results638 CBPAs were enrolled, randomized, and tested at baseline, with 592 returning at endline (93.7%). Baseline scores were similar across all three groups. Over the next six months, participation of Groups 2 and 3 remained high; they responded to >75% of messages. Group 3 participants answered 43% of the daily SMS questions correctly, but their performance did not improve over time. At endline, the CBPAs reported high satisfaction with the mCME intervention, and deemed the SMS messages highly relevant. However, endline exam scores did not increase over baseline, and did not differ between the three groups. Job satisfaction and self-efficacy scores also did not improve. Average times spent on self-study per week did not increase, and the kinds of knowledge resources used by the CBPAs did not differ between the three groups; textbooks, while widely available, were seldom used.ConclusionsThe SMS-based mCME intervention, while feasible and acceptable, did not result in increased medical knowledge. We hypothesize that this was because the intervention failed to stimulate lateral learning. For an intervention of this kind to be effective, it will be essential to find more effective ways to couple SMS as a stimulus to promote increased self-study behaviors.Trial registrationClinicalTrials.gov NCT02381743.

Project description:ObjectiveTo determine continuing medical education (CME) course participants' use of social media (SM) and their attitudes about the value of SM for enhancing CME education and to examine associations between participants' characteristics and attitudes toward SM.Participants and methodsWe conducted a cross-sectional survey and validation study of 539 participants at a Mayo Clinic Internal Medicine CME course in November 2011. The Social Media Use and Perception Instrument (SMUPI) consisted of 10 items (5-point Likert scales) and categorical response options. The main outcome measures were psychometric characteristics of the SMUPI scale, course participants' use of SM, and their attitudes regarding the importance of SM for enhancing CME.ResultsOf 539 CME course participants, 327 (61%) responded to the SMUPI survey. Most respondents (291 [89%]) reported using SM, with the most common types being YouTube (189 of the 327 participants [58%]) and Facebook (163 of 327 [50%]). Factor analysis revealed a 2-dimensional assessment of course participants' attitudes. Internal consistency reliability (Cronbach α) was excellent for factor 1 (0.94), factor 2 (0.89), and overall (0.94). The CME course participants' favorable attitudes toward SM were associated with younger age (20-29 years, mean score 3.13; 30-39 years, 3.40; 40-49 years, 3.39; 50-59 years, 3.18; 60-69 years, 2.93; and ≥70 years, 2.92; P=.02), using SM frequently (never, mean score 2.49; less than once monthly, 2.75; once monthly, 3.21; weekly, 3.31; and daily, 3.81; P<.0001), and professional degree (PhD, mean score 3.00; MD, 3.05; DO, 3.35; PA, 3.42; and NP, 3.50; P=.01).ConclusionWe describe the first validated measure of CME course participants' use of and attitudes toward SM. Our results suggest that CME course directors should guide SM strategies toward more youthful, technology-savvy CME participants and that SM will become increasingly worthwhile in CME as younger learners continue to enter the profession.

Project description:BackgroundSpaced education is a novel method that improves medical education through online repetition of core principles often paired with multiple-choice questions. This model is a proven teaching tool for medical students, but its effect on resident learning is less established. We hypothesized that repetition of key clinical concepts in a "Clinical Pearls" format would improve knowledge retention in medical residents.MethodsThis study investigated spaced education with particular emphasis on using a novel, email-based reinforcement program, and a randomized, self-matched design, in which residents were quizzed on medical knowledge that was either reinforced or not with electronically-administered spaced education. Both reinforced and non-reinforced knowledge was later tested with four quizzes.ResultsOverall, respondents incorrectly answered 395 of 1008 questions (0.39; 95% CI, 0.36-0.42). Incorrect response rates varied by quiz (range 0.34-0.49; p = 0.02), but not significantly by post-graduate year (PGY1 0.44, PGY2 0.33, PGY3 0.38; p = 0.08). Although there was no evidence of benefit among residents (RR = 1.01; 95% CI, 0.83-1.22; p = 0.95), we observed a significantly lower risk of incorrect responses to reinforced material among interns (RR = 0.83, 95% CI, 0.70-0.99, p = 0.04).ConclusionsOverall, repetition of Clinical Pearls did not statistically improve test scores amongst junior and senior residents. However, among interns, repetition of the Clinical Pearls was associated with significantly higher test scores, perhaps reflecting their greater attendance at didactic sessions and engagement with Clinical Pearls. Although the study was limited by a low response rate, we employed test and control questions within the same quiz, limiting the potential for selection bias. Further work is needed to determine the optimal spacing and content load of Clinical Pearls to maximize retention amongst medical residents. This particular protocol of spaced education, however, was unique and readily reproducible suggesting its potential efficacy for intern education within a large residency program.

Dataset Information

Do State Continuing Medical Education Requirements for Physicians Improve Clinical Knowledge?

Objective

Data sources

Study design

Data collection

Principal findings

Conclusions

Publications

Do State Continuing Medical Education Requirements for Physicians Improve Clinical Knowledge?

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure