Dataset Information

Assessing the effects of the 2003 resident duty hours reform on internal medicine board scores.

ABSTRACT: To determine whether the 2003 Accreditation Council for Graduate Medical Education (ACGME) duty hours reform affected medical knowledge as reflected by written board scores for internal medicine (IM) residents.The authors conducted a retrospective cohort analysis of postgraduate year 1 (PGY-1) Internal Medicine residents who started training before and after the 2003 duty hour reform using a merged data set of American Board of Internal Medicine (ABIM) Board examination and the National Board of Medical Examiners (NMBE) United States Medical Licensing Examination (USMLE) Step 2 Clinical Knowledge test scores. Specifically, using four regression models, the authors compared IM residents beginning PGY-1 training in 2000 and completing training unexposed to the 2003 duty hours reform (PGY-1 2000 cohort, n = 5,475) to PGY-1 cohorts starting in 2001 through 2005 (n = 28,008), all with some exposure to the reform.The mean ABIM board score for the unexposed PGY-1 2000 cohort (n = 5,475) was 491, SD = 85. Adjusting for demographics, program, and USMLE Step 2 exam score, the mean differences (95% CI) in ABIM board scores between the PGY-1 2001, 2002, 2003, 2004 and 2005 cohorts minus the PGY-1 2000 cohort were -5.43 (-7.63, -3.23), -3.44 (-5.65, -1.24), 2.58 (0.36, 4.79), 11.10 (8.88, 13.33) and 11.28 (8.98, 13.58) points respectively. None of these differences exceeded one-fifth of an SD in ABIM board scores.The duty hours reforms of 2003 did not meaningfully affect medical knowledge as measured by scores on the ABIM board examinations.

SUBMITTER: Silber JH

PROVIDER: S-EPMC4139168 | biostudies-literature | 2014 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessing the effects of the 2003 resident duty hours reform on internal medicine board scores.

Silber Jeffrey H JH Romano Patrick S PS Itani Kamal M F KM Rosen Amy K AK Small Dylan D Lipner Rebecca S RS Bosk Charles L CL Wang Yanli Y Halenar Michael J MJ Korovaichuk Sophia S Even-Shoshan Orit O Volpp Kevin G KG

Academic medicine : journal of the Association of American Medical Colleges 20140401 4

<h4>Purpose</h4>To determine whether the 2003 Accreditation Council for Graduate Medical Education (ACGME) duty hours reform affected medical knowledge as reflected by written board scores for internal medicine (IM) residents.<h4>Method</h4>The authors conducted a retrospective cohort analysis of postgraduate year 1 (PGY-1) Internal Medicine residents who started training before and after the 2003 duty hour reform using a merged data set of American Board of Internal Medicine (ABIM) Board examin ...[more]

PMID: 24556772

Similar Datasets

Project description:IntroductionIn 2011, the Accreditation Council for Graduate Medical Education (ACGME) implemented new Common Program Requirements to regulate duty hours of resident physicians, with three goals: improved patient safety, quality of resident education and quality of life for trainees. We sought to assess Internal Medicine program director (IMPD) perceptions of the 2011 Common Program Requirements in July 2012, one year following implementation of the new standards.MethodsA cross-sectional study of all IMPDs at ACGME-accredited programs in the United States (N?=?381) was performed using a 32-question, self-administered survey. Contact information was identified for 323 IMPDs. Three individualized emails were sent to each director over a 6-week period, requesting participation in the survey. Outcomes measured included approval of duty hours regulations, as well as perceptions of changes in graduate medical education and patient care resulting from the revised ACGME standards.ResultsA total of 237 surveys were returned (73% response rate). More than half of the IMPDs (52%) reported "overall" approval of the 2011 duty hour regulations, with greater than 70% approval of all individual regulations except senior resident daily duty periods (49% approval) and 16-hour intern shifts (17% approval). Although a majority feel resident quality of life has improved (55%), most IMPDs believe that resident education (60%) is worse. A minority report that quality (8%) or safety (11%) of patient care has improved.ConclusionOne year after implementation of new ACGME duty hour requirements, IMPDs report overall approval of the standards, but strong disapproval of 16-hour shift limits for interns. Few program directors perceive that the duty hour restrictions have resulted in better care for patients or education of residents. Although resident quality of life seems improved, most IMPDs report that their own workload has increased. Based on these results, the intended benefits of duty hour regulations may not yet have been realized.

Project description:ContextThe ACGME-released revisions to the 2003 duty hour standards.ObjectiveTo review the impact of the 2003 duty hour reform as it pertains to resident and patient outcomes.Data sourcesMedline (1989-May 2010), Embase (1989-June 2010), bibliographies, pertinent reviews, and meeting abstracts.Study selectionWe included studies examining the relationship between the pre- and post-2003 time periods and patient outcomes (mortality, complications, errors), resident education (standardized test scores, clinical experience), and well-being (as measured by the Maslach Burnout Inventory). We excluded non-US studies.Data extractionOne rater used structured data collection forms to abstract data on study design, quality, and outcomes. We synthesized the literature qualitatively and included a meta-analysis of patient mortality.ResultsOf 5,345 studies identified, 60 met eligibility criteria. Twenty-eight studies included an objective outcome related to patients; 10 assessed standardized resident examination scores; 26 assessed resident operative experience. Eight assessed resident burnout. Meta-analysis of the mortality studies revealed a significant improvement in mortality in the post-2003 time period with a pooled odds ratio (OR) of 0.9 (95% CI: 0.84, 0.95). These results were significant for medical (OR 0.91; 95% CI: 0.85, 0.98) and surgical patients (OR 0.86; 95% CI: 0.75, 0.97). However, significant heterogeneity was present (I(2) 83%). Patient complications were more nuanced. Some increased in frequency; others decreased. Outcomes for resident operative experience and standardized knowledge tests varied substantially across studies. Resident well-being improved in most studies.LimitationsMost studies were observational. Not all studies of mortality provided enough information to be included in the meta-analysis. We used unadjusted odds ratios in the meta-analysis; statistical heterogeneity was substantial. Publication bias is possible.ConclusionsSince 2003, patient mortality appears to have improved, although this could be due to secular trends. Resident well-being appears improved. Change in resident educational experience is less clear.

Project description:BackgroundIn July 2011, the Accreditation Council for Graduate Medical Education (ACGME) will implemented stricter duty-hour limits and related changes to the training environment. This may affect preventable adverse event (PAE) rates.ObjectivesTo estimate direct costs under various implementation approaches, and examine net costs to teaching hospitals and cost-effectiveness to society across a range of hypothetical changes in PAEs.DesignA decision-analytical model represented direct costs and PAE rates, mortality, and costs.Data sourcesPublished literature and publicly available data.Target populationPatients admitted to hospitals with ACGME-accredited programs.Time horizonOne year.PerspectivesAll teaching hospitals, major teaching hospitals, society.InterventionACGME's 2011 Common Program Requirements.Outcome measuresDirect annual costs (all accredited hospitals), net cost (major teaching hospitals), cost per death averted (society). RESULTS OF BASE-ANALYSIS: Nationwide, duty-hour changes would cost $177 million annually if interns maintain current productivity, vs. up to $982 million if they transfer work to a mixture of substitutes; training-environment changes will cost $204 million. If PAEs decline by 7.2-25.8%, net costs to major teaching hospitals will be zero. If PAEs fall by 3%, the cost to society per death averted would be -$523,000 (95%-confidence interval: -$1.82 million to $685,000) to $2.44 million ($271,000 to $6.91 million). If PAEs rise, the policy will be cost-increasing for teaching hospitals and society.Results of sensitivity analysisThe total direct annual cost nationwide would be up to $1.34 billion using nurse practitioners/physician assistants, $1.64 billion using attending physicians, $820 million hiring additional residents, vs. 1.42 billion using mixed substitutes.LimitationsThe effect on PAEs is unknown. Data were limited for some model parameters.ConclusionImplementation decisions greatly affect the cost. Unless PAEs decline substantially, teaching hospitals will lose money. If PAEs decline modestly, the requirements might be cost-saving or cost-effective to society.

Project description:BACKGROUND:Concern persists that inflexible duty-hour rules in medical residency programs may adversely affect the training of physicians. METHODS:We randomly assigned 63 internal medicine residency programs in the United States to be governed by standard duty-hour policies of the 2011 Accreditation Council for Graduate Medical Education (ACGME) or by more flexible policies that did not specify limits on shift length or mandatory time off between shifts. Measures of educational experience included observations of the activities of interns (first-year residents), surveys of trainees (both interns and residents) and faculty, and intern examination scores. RESULTS:There were no significant between-group differences in the mean percentages of time that interns spent in direct patient care and education nor in trainees' perceptions of an appropriate balance between clinical demands and education (primary outcome for trainee satisfaction with education; response rate, 91%) or in the assessments by program directors and faculty of whether trainees' workload exceeded their capacity (primary outcome for faculty satisfaction with education; response rate, 90%). Another survey of interns (response rate, 49%) revealed that those in flexible programs were more likely to report dissatisfaction with multiple aspects of training, including educational quality (odds ratio, 1.67; 95% confidence interval [CI], 1.02 to 2.73) and overall well-being (odds ratio, 2.47; 95% CI, 1.67 to 3.65). In contrast, directors of flexible programs were less likely to report dissatisfaction with multiple educational processes, including time for bedside teaching (response rate, 98%; odds ratio, 0.13; 95% CI, 0.03 to 0.49). Average scores (percent correct answers) on in-training examinations were 68.9% in flexible programs and 69.4% in standard programs; the difference did not meet the noninferiority margin of 2 percentage points (difference, -0.43; 95% CI, -2.38 to 1.52; P=0.06 for noninferiority). od Institute and the ACGME; iCOMPARE ClinicalTrials.gov number, NCT02274818 .). CONCLUSIONS:There was no significant difference in the proportion of time that medical interns spent on direct patient care and education between programs with standard duty-hour policies and programs with more flexible policies. Interns in flexible programs were less satisfied with their educational experience than were their peers in standard programs, but program directors were more satisfied. (Funded by the National Heart, Lung, and Blo

Dataset Information

Assessing the effects of the 2003 resident duty hours reform on internal medicine board scores.

Publications

Assessing the effects of the 2003 resident duty hours reform on internal medicine board scores.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets