Dataset Information

Avoid reinventing the wheel: implementation of the Ottawa Clinic Assessment Tool (OCAT) in Internal Medicine.

ABSTRACT: BACKGROUND:Workplace based assessment (WBA) is crucial to competency-based education. The majority of healthcare is delivered in the ambulatory setting making the ability to run an entire clinic a crucial core competency for Internal Medicine (IM) trainees. Current WBA tools used in IM do not allow a thorough assessment of this skill. Further, most tools are not aligned with the way clinical assessors conceptualize performances. To address this, many tools aligned with entrustment decisions have recently been published. The Ottawa Clinic Assessment Tool (OCAT) is an entrustment-aligned tool that allows for such an assessment but was developed in the surgical setting and it is not known if it can perform well in an entirely different context. The aim of this study was to implement the OCAT in an IM program and collect psychometric data in this different setting. Using one tool across multiple contexts may reduce the need for tool development and ensure that tools used have proper psychometric data to support them. METHODS:Psychometrics characteristics were determined. Descriptive statistics and effect sizes were calculated. Scores were compared between levels of training (juniors (PGY1), seniors (PGY2s and PGY3s) & fellows (PGY4s and PGY5s)) using a one-way ANOVA. Safety for independent practice was analyzed with a dichotomous score. Variance components were generated and used to estimate the reliability of the OCAT. RESULTS:Three hundred ninety OCATs were completed over 52 weeks by 86 physicians assessing 44 residents. The range of ratings varied from 2 (I had to talk them through) to 5 (I did not need to be there) for most items. Mean scores differed significantly by training level (p?

SUBMITTER: Halman S

PROVIDER: S-EPMC6148769 | biostudies-literature | 2018 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Avoid reinventing the wheel: implementation of the Ottawa Clinic Assessment Tool (OCAT) in Internal Medicine.

Halman Samantha S Rekman Janelle J Wood Timothy T Baird Andrew A Gofton Wade W Dudek Nancy N

BMC medical education 20180920 1

<h4>Background</h4>Workplace based assessment (WBA) is crucial to competency-based education. The majority of healthcare is delivered in the ambulatory setting making the ability to run an entire clinic a crucial core competency for Internal Medicine (IM) trainees. Current WBA tools used in IM do not allow a thorough assessment of this skill. Further, most tools are not aligned with the way clinical assessors conceptualize performances. To address this, many tools aligned with entrustment decisi ...[more]

PMID: 30236097

Similar Datasets

Project description:BackgroundDespite strong evidence of benefit, breast cancer risk assessment and chemoprevention are underutilized by primary care physicians. This study evaluates the impact of an educational program on knowledge and utilization of the NCI Breast Cancer Risk Assessment Tool (BCRAT) by internal medicine residents.MethodsInternal medicine residents at the primary care clinic at William Beaumont Hospital participated in an educational program on breast cancer risk assessment and chemoprevention. A questionnaire was used to assess knowledge and practice before and after participation. Electronic health records of women between the ages of 35 and 65 who were seen by participating residents for annual health exams between Dec 15, 2015 and Dec 14, 2016 were reviewed. Utilization of BCRAT by the residents was compared pre- and post-educational program.ResultsA total of 43 residents participated in the study. 31 (72.1%) residents reported no prior knowledge about BCRAT. The remaining 12 (27.9%) reported limited knowledge of BCRAT, but the majority of these (n = 10, 83.3%) had not used it in the last six months. For each question on the pre-educational knowledge assessment, fewer than 10% of the residents responded correctly. After implementation of the educational program, there was a significant increase in the proportion of residents who answered correctly (Range: 67 to 100%, p < 0.001). Electronic health records of 301 clinic patients were reviewed, 118 (39.2%) in the pre-educational program group and 183 (60.8%) in the post-educational program group. There was a higher use of BCRAT in the post-educational program group compared to the pre-intervention group (3.8% vs. 0%, p < 0.05). However, a majority (n = 294, 98.7%) of eligible patients from both groups did not undergo breast cancer risk assessment.ConclusionsOur study demonstrates that an educational intervention improved residents' knowledge of BCRAT. Despite this improvement, a significant proportion of patients did not undergo breast cancer risk assessment. Expanding the scope and duration of this intervention and combining it with innovative use of technology to improve utilization should be the subject of future investigation.

Project description:BackgroundAlthough urine microscopy is an important step in the initial evaluation of a patient with kidney disease, internal medicine residents have minimal exposure to this technique during their training. The goal of this study was to understand knowledge of and attitudes toward urine microscopy among internal medicine residents and to implement virtual urine microscopy teaching sessions.MethodsA voluntary, anonymous, online survey was sent to all of the categorical internal medicine residents (n=131) training at the Icahn School of Medicine at Mount Sinai (ISMMS). The survey included 13 questions to assess attitudes toward, experience with, and clinical interpretation of urine microscopy specimens. In response to the survey results, we implemented virtual urine microscopy teaching sessions using video conferencing software that incorporated real-time urine sediment analysis with nephrology fellows and attending nephrologists.ResultsThe survey response rate was 45% (59 of 131). Forty-seven percent (28 of 59) of respondents reported performing urine microscopy at least once during their training, and 75% (44 of 59) of respondents did not feel comfortable performing urine microscopy. The majority of residents (92%; 54 of 59) reported they felt urine microscopy was very helpful or somewhat helpful in the evaluation of patients with AKI. Overall, 41% of responses to clinical interpretation questions were considered correct. Following survey completion, virtual urine microscopy sessions were held monthly and well received by the participants.ConclusionsOur study found that internal medicine residents perceive urine microscopy as a helpful diagnostic tool, although lack the skills to perform and interpret urine microscopy sediments. Virtual educational sessions using video conferencing software are a technically feasible approach to teaching urine microscopy to internal medicine residents. Future studies include a study of the effect of these sessions on learning of urine microscopy.PodcastThis article contains a podcast at https://www.asn-online.org/media/podcast/K360/2021_01_28_KID0006282020.mp3.

Project description:The patient-centered medical home (PCMH) model holds promise for improving primary care delivery, but it has not been adequately tested in teaching settings.We implemented an intervention guided by PCMH principles at a safety-net teaching clinic with resident physician providers. Two similar clinics served as controls.Using a cross-sectional design, we measured the effect on patient and resident satisfaction using the Consumer Assessment of Healthcare Providers and Systems survey and a validated teaching clinic survey, respectively. Both surveys were conducted at baseline and 1 year after the intervention. We also measured the effect on emergency department and hospital utilization.Following implementation of our intervention, the clinic’s score on the National Committee for Quality Assurance’s PCMH certification tool improved from 35 to 53 of 100 possible points, although our clinic did not achieve all must-pass elements to qualify as a PCMH. During the 1-year study period, 4676 patients were exposed to the intervention; 39.9% of these used at least 1 program component. Compared with baseline, patient-reported access and overall satisfaction improved to a greater extent in the intervention clinic, and the composite satisfaction rating increased from 48% to 65% in the intervention clinic vs from 50% to 59% in the control sites (P?=?.04). The improvements were particularly notable for questions relating to access. For example, satisfaction with urgent appointment scheduling increased from 12% to 53% in the intervention clinic vs from 14% to 18% in the control clinics (P?<?.001). Resident satisfaction also improved in the intervention clinic: the composite satisfaction score increased from 39% to 51% in the intervention clinic vs a decrease from 46% to 42% in the control clinics (P?=?.01). Emergency department utilization did not differ significantly between the intervention and control clinics, and hospitalizations increased from 26 to 27 visits per 1000 patients per month in the intervention clinic vs a decrease from 28 to 25 in the control clinics (P?=?.02).Our PCMH-guided intervention, which represented a modest but substantive step toward the PCMH vision, had favorable effects on patient and resident satisfaction at a safety-net teaching clinic but did not reduce emergency department or hospital utilization in the first year. Our experience may provide lessons for other teaching clinics in safety-net settings hoping to implement PCMH-guided reforms.

Project description:BackgroundImplementation science comprises a large set of theories suggesting interacting factors at different organisational levels. Development of literature syntheses and frameworks for implementation have contributed to comprehensive descriptions of implementation. However, corresponding instruments for measuring these comprehensive descriptions are currently lacking. The present study aimed to develop an instrument measuring care providers' perceptions of an implementation effort, and to explore the instrument's psychometric properties.MethodsBased on existing implementation literature, a questionnaire was designed with items on individual and team factors and on stages of change in an implementation process. The instrument was tested in a Norwegian study on implementation of evidence based practices for psychosis. Item analysis, factor structure, and internal consistency at baseline were examined.ResultsThe 27-item Implementation Process Assessment Tool (IPAT) revealed large variation between mean score of the items. The total scale scores were widely dispersed across respondents. Internal consistency for the total scale was high (Cronbach's alpha: .962), and all but one item contributed positively to the construct. The results indicated four underlying constructs: individual stages for behavioural change, individual activities and perceived support, collective readiness and support, and individual perceptions of the intervention.ConclusionsThe IPAT appears to be a feasible instrument for investigating the implementation process from the perspective of those making the change. It can enable examination of the relative importance of factors thought to be essential for implementation outcomes. It may also provide ongoing feedback for leaders tailoring support for teams to improve implementation. However, further research is needed to detect the instrument's properties later in the implementation process and in different contexts.Trial registrationClinicalTrials.gov code NCT03271242 (retrospective registered September 5, 2017).

Dataset Information

Avoid reinventing the wheel: implementation of the Ottawa Clinic Assessment Tool (OCAT) in Internal Medicine.

Publications

Avoid reinventing the wheel: implementation of the Ottawa Clinic Assessment Tool (OCAT) in Internal Medicine.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets