Predictors of performance on the pediatric board certification examination.
Ontology highlight
ABSTRACT: Background
Examining the predictors of summative assessment performance is important for improving educational programs and structuring appropriate learning environments for trainees. However, predictors of certification examination performance in pediatric postgraduate education have not been comprehensively investigated in Japan.Methods
The Pediatric Board Examination database in Japan, which includes 1578 postgraduate trainees from 2015 to 2016, was analyzed. The examinations included multiple-choice questions (MCQs), case summary reports, and an interview, and the predictors for each of these components were investigated by multiple regression analysis.Results
The number of examination attempts and the training duration were significant negative predictors of the scores for the MCQ, case summary, and interview. Employment at a community hospital or private university hospital were negative predictors of the MCQ and case summary score, respectively. Female sex and the number of academic presentations positively predicted the case summary and interview scores. The number of research publications was a positive predictor of the MCQ score, and employment at a community hospital was a positive predictor of the case summary score.Conclusion
This study found that delayed and repeated examination taking were negative predictors, while the scholarly activity of trainees was a positive predictor, of pediatric board certification examination performance.
SUBMITTER: Nomura O
PROVIDER: S-EPMC7898761 | biostudies-literature | 2021 Feb
REPOSITORIES: biostudies-literature
Publications
Predictors of performance on the pediatric board certification examination.
Nomura Osamu O Onishi Hirotaka H Park Yoon Soo YS Michihata Nobuaki N Kobayashi Tohru T Kaneko Kazunari K Yoshikawa Tetsushi T Ishiguro Akira A
BMC medical education 20210222 1
<h4>Background</h4>Examining the predictors of summative assessment performance is important for improving educational programs and structuring appropriate learning environments for trainees. However, predictors of certification examination performance in pediatric postgraduate education have not been comprehensively investigated in Japan.<h4>Methods</h4>The Pediatric Board Examination database in Japan, which includes 1578 postgraduate trainees from 2015 to 2016, was analyzed. The examinations ...[more]
Similar Datasets
Project description:BACKGROUND:Traditionally, quizzes have been applied as a tool for summative assessment, though literature suggests their use as a formative assessment can improve motivation and content retention. With this premise, we implemented a series of intermittent, online quizzes known as the Board Examination Simulation Exercise (BESE). We sought to demonstrate an association between BESE participation and scores and performance on the American Board of Pediatrics (ABP) Certifying Examination (CE). METHODS:Residents were assigned online quizzes on a single topic at 2 week intervals that consisted of 20 multiple choice questions written by the study authors. This analysis includes graduates of 3 Pediatric and Internal Medicine-Pediatrics residency programs. RESULTS:Data were available for 329 residents. The overall BESE score weakly correlated with ABP CE score (n?=?287; r?=?0.39, p?<?0.0001). ABP CE pass rates increased from 2009 to 2016 at all programs combined (p?=?0.0001). A composite BESE score???11 had sensitivity of 54% and specificity of 80% for predicting ABP CE failure on the first attempt. There was no difference in ABP CE failure rates or scores by number of completed quizzes. CONCLUSION:Intermittent online quizzes implemented at three pediatric residency programs were associated with overall increasing ABP CE pass rates. BESE increased program emphasis on board preparation. Residents with lower BESE scores more often failed ABP CE. Though additional data are needed, BESE is a promising tool for pediatric resident learning and board preparation. It may also aid in earlier identification of residents at higher risk of failing the ABP CE and facilitate targeted interventions.
| S-EPMC6278081 | biostudies-other
Project description:BACKGROUND AND OBJECTIVES:Medical specialty and subspecialty fellowship programs administer subject-specific in-training examinations to provide feedback about level of medical knowledge to fellows preparing for subsequent board certification. This study evaluated the association between the American Society of Nephrology In-Training Examination and the American Board of Internal Medicine Nephrology Certification Examination in terms of scores and passing status. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS:The study included 1684 nephrology fellows who completed the American Society of Nephrology In-Training Examination in their second year of fellowship training between 2009 and 2014. Regression analysis examined the association between In-Training Examination and first-time Nephrology Certification Examination scores as well as passing status relative to other standardized assessments. RESULTS:This cohort included primarily men (62%) and international medical school graduates (62%), and fellows had an average age of 32 years old at the time of first completing the Nephrology Certification Examination. An overwhelming majority (89%) passed the Nephrology Certification on their first attempt. In-Training Examination scores showed the strongest association with first-time Nephrology Certification Examination scores, accounting for approximately 50% of the total explained variance in the model. Each SD increase in In-Training Examination scores was associated with a difference of 30 U (95% confidence interval, 27 to 33) in certification performance. In-Training Examination scores also were significantly associated with passing status on the Nephrology Certification Examination on the first attempt (odds ratio, 3.46 per SD difference in the In-Training Examination; 95% confidence interval, 2.68 to 4.54). An In-Training Examination threshold of 375, approximately 1 SD below the mean, yielded a positive predictive value of 0.92 and a negative predictive value of 0.50. CONCLUSIONS:American Society of Nephrology In-Training Examination performance is significantly associated with American Board of Internal Medicine Nephrology Certification Examination score and passing status.
| S-EPMC5969473 | biostudies-literature
Project description:BackgroundThe board certification system serves as a quality assurance system for physicians, and its design and operation are important health policy issues. In Japan, board certification was established and operated independently by academic societies and has not been directly linked to reimbursement systems. The phenomenon of younger physicians seeking specialist careers has raised concerns about acceleration of the tendency of fewer physicians working in rural areas and the maldistribution of physicians. Little is known about the associations between physicians' geographical migration patterns and board certification status changes or between the continuation of urban/rural practice and the maintenance of board certification. This study aimed to identify these associations and to discuss their policy implications.MethodsWe analyzed 2012 and 2014 data from the Survey of Physicians, Dentists, and Pharmacists, a national census survey. To analyze geographical migration patterns, transitions in practice location (rural, intermediate, and urban) were analyzed by board certification status change (new, lost, consistently certified, and consistently uncertified). Logistic regression analysis was conducted to assess whether the odds of migrating to more urban/rural municipalities were associated with board certification status changes, adjusting for covariates, and whether practicing in a rural area was associated with maintaining board certification.ResultsAmong 18,726 newly board-certified physicians, 94.9% (13,435/14,150) of those working in urban areas before certification remained in urban areas, whereas 64.6% (393/608) of those working in rural areas stayed in rural areas. Those who were newly certified had higher odds of moving to more urban areas, adjusting for covariates. Those who stayed in rural areas showed lower odds of maintaining board certification, adjusting for covariates.ConclusionsNewly board-certified physicians are more likely to migrate to other types of areas, particularly more urban areas, than other physicians. Allocating more training quotas to rural areas could be one option for leveling the distribution of specialists. It also appeared that those practicing in rural areas have difficulty maintaining their certification, so the need to establish a support system for already-certified physicians in rural areas should be emphasized.
| S-EPMC6081900 | biostudies-literature
Project description:Certification by an American Board of Medical Specialties (ABMS) member board is emerging as a measure of physician quality.To identify demographic and educational factors associated with ABMS member board certification of US medical school graduates.Retrospective study of a national cohort of 1997-2000 US medical school graduates, grouped by specialty choice at graduation and followed up through March 2, 2009. In separate multivariable logistic regression models for each specialty category, factors associated with ABMS member board certification were identified.ABMS member board certification.Of 42,440 graduates in the study sample, 37,054 (87.3%) were board certified. Graduates in all specialty categories with first-attempt passing scores in the highest tertile (vs first-attempt failing scores) on US Medical Licensing Examination Step 2 Clinical Knowledge were more likely to be board certified; adjusted odds ratios (AORs) varied by specialty category, with the lowest odds for emergency medicine (87.4% vs 73.6%; AOR, 1.82; 95% CI, 1.03-3.20) and highest odds for radiology (98.1% vs 74.9%; AOR, 13.19; 95% CI, 5.55-31.32). In each specialty category except family medicine, graduates self-identified as underrepresented racial/ethnic minorities (vs white) were less likely to be board certified, ranging from 83.5% vs 95.6% in the pediatrics category (AOR, 0.44; 95% CI, 0.33-0.58) to 71.5% vs 83.7% in the other nongeneralist specialties category (AOR, 0.79; 95% CI, 0.64-0.96). With each $50,000 unit increase in debt (vs no debt), graduates choosing obstetrics/gynecology were less likely to be board certified (AOR, 0.89; 95% CI, 0.83-0.96), and graduates choosing family medicine were more likely to be board certified (AOR, 1.13; 95% CI, 1.01-1.26).Demographic and educational factors were associated with board certification among US medical school graduates in every specialty category examined; findings varied among specialty categories.
| S-EPMC3217584 | biostudies-literature
Project description:ImportanceSuccess on the internal medicine (IM) examination is a central requirement of the American Board of Internal Medicine's (ABIM's) Maintenance of Certification program (MOC). Therefore, it is important to understand the degree to which this examination reflects conditions seen in practice, one dimension of content validity, which focuses on the match between content in the discipline and the topics on the examination questions.ObjectiveTo assess whether the frequency of questions on IM-MOC examinations were concordant with the frequency of conditions seen in practice.Design, setting, and participantsThe 2010-2013 IM-MOC examinations were used to calculate the percentage of questions for 186 medical condition categories from the examination blueprint, which balances examination content by considering importance and frequency of conditions seen in practice. Nationally representative estimates of conditions seen in practice by general internists were estimated from the primary diagnosis for 13 832 office visits (2010-2013 National Ambulatory Medical Care Surveys) and 108 472 hospital stays (2010 National Hospital Discharge Survey).ExposuresPrevalence of conditions included on the IM-MOC examination questions.Main outcomes and measuresThe outcome measure was the concordance between the percentages of IM-MOC examination questions and the percentages of conditions seen in practice during either office visits or hospital stays for each of 186 condition categories (eg, diabetes mellitus, ischemic heart disease, liver disease). The concordance thresholds were 0.5 SD of the weighted mean percentages of the applicable 186 conditions seen in practice (0.74% for office visits; 0.51% for hospital stays). If the absolute differences between the percentages of examination questions and the percentages of office visit conditions or hospital stay conditions seen were less than the applicable concordance threshold, then the condition category was judged to be concordant.ResultsDuring the 2010-2013 IM-MOC examination periods, 3600 questions (180 questions per examination form) were administered and 3461 questions (96.1%) were mapped into the 186 study conditions (mean, 18.6 questions per condition). Comparison of the percentages of 186 categories of medical conditions seen in 13 832 office visits and 108 472 hospital stays with the percentages of 3461 questions on IM-MOC examinations revealed that 2389 examination questions (69.0%; 95% CI, 67.5%-70.6% involving 158 conditions) were categorized as concordant. For concordance between questions and office visits only, 2010 questions (58.08%; 95% CI, 56.43%-59.72% of all examination questions) involving 145 conditions were categorized as concordant. For concordance between questions and hospital stays only, 1456 questions (42.07%; 95% CI, 40.42%-43.71% of all examination questions) involving 122 conditions were categorized as concordant.Conclusions and relevanceAmong questions on IM-MOC examinations from 2010-2013, 69% were concordant with conditions seen in general internal medicine practices, although some areas of discordance were identified.
| S-EPMC5815000 | biostudies-literature
Project description:OBJECTIVE:There continues to be a debate about the value and purpose of maintenance of certification (MOC) programs in the US. The goal of this study is to assess the impact, value, and purpose of MOC programs in rheumatology. METHODS:A survey was sent to 3,107 rheumatologists in the US. The survey addressed how rheumatologists perceive the value and impact of MOC programs on rheumatology practice and patient care. RESULTS:A total of 515 rheumatologists completed this survey. The majority (74.8%) believed there was no significant value in MOC, beyond what is already achieved from continuing medical education. Most rheumatologists did not believe MOC was valuable in improving patient care (63.5%), and the majority felt that the primary reason for creating MOC was either the financial well-being of board-certifying organizations (43.4%) or to satisfy administrative requirements in health systems (30%). Although 65.6% perceived that staying current with new medical knowledge was a positive impact of MOC programs, the MOC was perceived to result in time away from providing patient care (74.6%) and time away from family (74%). When asked about potential effects of requiring MOC, 77.7% reported physician burnout, 67.4% early physician retirement, and 63.9% anticipated an effect on reducing the overall number of practicing rheumatologists. CONCLUSION:The majority of rheumatologists do not believe there is significant value for MOC programs. There is evidence for lack of trust in board-certifying organizations, and rheumatologists believe MOC programs contribute to physician burnout, early retirement, and loss in the rheumatology workforce.
| S-EPMC6692078 | biostudies-literature
Project description:PurposeThis work investigates associations between physician qualifications and the risk of postintravitreal injection endophthalmitis.MethodsThis retrospective analysis of data from medical claims studied Medicare beneficiaries undergoing 1 or more intravitreal injections between January 1, 2013, and December 31, 2017. Logistic regression analysis was performed to assess whether board certification status or retina subspecialty training was associated with lower risk of postinjection endophthalmitis, controlling for patient's age, race, and sex, type of agent injected, diagnosis, and year of injection. The main outcome measure was odds ratio (OR) of receiving a diagnosis of endophthalmitis in the 14 days after intravitreal injection. Clinical outcome and quality of care were not evaluated in this study.ResultsA total of 2 907 324 intravitreal injections were performed on 219 640 patients by 4315 ophthalmologists, 3196 (74%) of whom were retina specialists and 4021 (92%) of whom were certified by the American Board of Ophthalmology (ABO). Overall, there were 1088 (0.037%) cases of postinjection endophthalmitis, of which 1024 (0.037%) were injected by ABO-certified ophthalmologists and 64 (0.050%) by non-board-certified ophthalmologists. Injections by ABO-certified ophthalmologist had 28% reduced odds of endophthalmitis (OR = 0.72; 95% CI, 0.523-0.996, P = .05). Higher odds of endophthalmitis were observed for corticosteroid injections (OR = 3.91; 95% CI, 2.75-5.56, P < .001) and aflibercept injections (OR = 1.47; 95% CI, 1.19-1.80, P < .001). Patients' sex and race, the diagnosis associated with the injection, and providers' retina subspeciality training were not associated with the rate of endophthalmitis (P < .20 for all comparisons).ConclusionsWe found evidence that endophthalmitis may be reduced when ABO-certified physicians perform an intravitreal injection.
| S-EPMC9976016 | biostudies-literature
Project description:The purpose of this study is to determine if patient selection varies based on years of surgical practice.The impact of hospital and surgeon volume as a marker of experience has demonstrated an inverse association with surgical outcomes. However, temporal measures of experience often demonstrate no effect. Additionally, a self-reporting survey demonstrated decreasing case complexity over time, suggesting that changes in patient selection may account for some of these observed discrepancies.General surgery cases at a single tertiary care center reported to the American College of Surgeons National Surgical Quality Improvement Program over a 10-year period were identified. Additionally general surgery cases from the ACS NSQIP 2008 PUF data were used to create risk models for any complications, 30-day mortality, or a composite complication or mortality outcome. These models then estimated risk for our local data. Years of experience after American Board of Surgery certification were calculated for each surgeon for each case. Multivariate linear regression, controlling for surgeon clustering, was used to determine the association between years of surgical experience and preoperative risk of complications and mortality.Eighteen thousand six hundred and eighty eight cases were identified from our institution. Surgeons selected patients of increasing operative risk until 15 years of practice before selecting lower risk patients throughout the rest of their career. After adjusting for risk, no association was observed between years from board certification and mortality. However, there was a trend toward decreasing complication rates with increasing experience.Surgical experience significantly impacts patient selection. Surgeons with over 25 years of experience had lower complication rates. Experience had no impact on mortality.
| S-EPMC4747674 | biostudies-other
Project description:In the five decades since its inception, brain death has become an accepted medical and legal concept throughout most of the world. There was initial reluctance to apply brain death criteria to children as they are believed more likely to regain neurologic function following injury. In spite of early trepidation, criteria for pediatric brain death certification were first proposed in 1987 by a multidisciplinary committee comprised of experts in the medical and legal communities. Protocols have since been developed to standardize brain death determination, but there remains substantial variability in practice throughout the world. In addition, brain death remains a topic of considerable ethical, philosophical, and legal controversy, and is often misrepresented in the media. In the present article, we discuss the history of brain death and the guidelines for its determination. We provide an overview of past and present challenges to its concept and diagnosis from biophilosophical, ethical and legal perspectives, and highlight differences between adult and pediatric brain death determination. We conclude by anticipating future directions for brain death as related to the emergence of new technologies. It is our position that providers should endorse the criteria for brain death diagnosis in children as proposed by the Society of Critical Care Medicine (SCCM), American Academy of Pediatrics (AAP), and Child Neurology Society (CNS), in order to prevent controversy and subjectivity surrounding what constitutes life versus death.
| S-EPMC8578760 | biostudies-literature
Project description:Aims and objectivesTo evaluate differences in hospitals' proportion of specialty certified nurses and to determine whether and to what extent individual nurse characteristics and organisational hospital characteristics are associated with a nurse's likelihood of having specialty certification.BackgroundPrior research has shown that patients in hospitals with high proportions of specialty certified nurses have better outcomes including lower mortality and fewer adverse events, yet less is known about what motivates nurses to obtain specialty certification.Methods and designCross-sectional study of paediatric nurses in 119 acute care hospitals. Multivariate logistic regression models were used to determine the association between individual nurse characteristics, organisational hospital characteristics and an individual nurses' likelihood of holding a specialty certification. STROBE was followed.ResultsThe proportion of certified nurses varies substantially among hospitals, with Magnet® hospitals being significantly more likely, on average, to have higher proportions of certified nurses. Nurses in children's hospitals were no more likely than paediatric nurses in general hospitals to be certified. A nurse's years of experience and bachelors-preparation were significantly associated with higher odds of having certification. The strongest predictors of certification were favourable nurse work environments and Magnet® -designation of the hospital.ConclusionsWhile individual attributes of the nurse were associated with a nurse's likelihood of having a specialty certification, the strongest predictors of certification were modifiable attributes of the hospital-a favourable nurse work environment and Magnet® -designation.Relevance to clinical practiceHospital administrators seeking to increase the proportion of specialty certified nurses in their organisation should look to improvements in the organisation's nurse work environment as a possible mechanism.
| S-EPMC7880550 | biostudies-literature