Dataset Information

Standardized Checklist for Otoscopy Performance Evaluation: A Validation Study of a Tool to Assess Pediatric Otoscopy Skills.

ABSTRACT:

Introduction

Acute otitis media (AOM) is the most frequently diagnosed pediatric illness in the United States and the most common indication for antibiotic prescription. Skill in pediatric otoscopy is essential to correctly identify children with AOM. However, studies have found diagnostic inconsistency and significant overdiagnosis among practitioners. Given the potential public and individual health consequences, there has been a call for improved education regarding the diagnostic certainty of AOM. Yet educational efforts continue to be limited, particularly in regard to competency assessment. The lack of a validated tool to assess otoscopy skill attainment objectively diminishes the instructor's ability to provide useful feedback and direction to the learner.

Methods

We have undertaken an educational intervention with the goal of developing a validated Standardized Checklist for Otoscopy Performance Evaluation (SCOPE), building on key principles of the general pediatric ear exam. The SCOPE was developed with the input of process and content experts with attention to specific domains of validity.

Results

Our analysis provides important validity evidence for the SCOPE assessment tool. The instrument was piloted and successfully implemented with medical students and varying levels of residents in pediatrics and emergency medicine over a 5-year period in varied settings: urgent care, large and small pediatric clinics, and the emergency departments at two institutions. It has been used for both instruction and assessment purposes.

Discussion

Because the SCOPE can be used in teaching demonstration purposes, in formative and summative assessment settings, and across the continuum of learners, this instrument offers the potential for more educational efforts in the field of assessment in direct patient care. We anticipate that the SCOPE will foster an environment of efficient yet high-yield review and discussion of otoscopy and diagnostic competency.

SUBMITTER: Paul CR

PROVIDER: S-EPMC6464442 | biostudies-literature | 2016 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Standardized Checklist for Otoscopy Performance Evaluation: A Validation Study of a Tool to Assess Pediatric Otoscopy Skills.

Paul Caroline R CR Keeley Meg G MG Rebella Gregory G Frohna John G JG

MedEdPORTAL : the journal of teaching and learning resources 20160805

<h4>Introduction</h4>Acute otitis media (AOM) is the most frequently diagnosed pediatric illness in the United States and the most common indication for antibiotic prescription. Skill in pediatric otoscopy is essential to correctly identify children with AOM. However, studies have found diagnostic inconsistency and significant overdiagnosis among practitioners. Given the potential public and individual health consequences, there has been a call for improved education regarding the diagnostic cer ...[more]

PMID: 31008212

Similar Datasets

Project description:Background Acute otitis media (AOM) is the most frequent indication for antibiotic treatment of children in the United States. Its diagnosis relies on visualization of the tympanic membrane, a clinical skill acquired through a deliberate approach. Instruction in pediatric otoscopy begins in medical school. Medical students receive their primary experience with pediatric otoscopy during the required pediatric clerkship, traditionally relying on an immersion, apprentice-type learning model. A better understanding of their preceptors’ clinical and teaching practices could lead to improved skill acquisition. This study investigates how pediatric preceptors (PP) and members of the Council on Medical Student Education in Pediatrics (COMSEP) perceive teaching otoscopy. Methods A 30-item online survey was administered to a purposeful sample of PP at six institutions in 2017. A comparable 23-item survey was administered to members through the 2018 COMSEP Annual Survey. Only COMSEP members who identified themselves as teaching otoscopy to medical students were asked to complete the otoscopy-related questions on the survey. Results Survey respondents included 58% of PP (180/310) and 44% (152/348) of COMSEP members. Forty-one percent (62/152) of COMSEP member respondents identified themselves as teaching otoscopy and completed the otoscopy-related questions. The majority agreed that standardized curricula are needed (PP 78%, COMSEP members 97%) and that all graduating medical students should be able to perform pediatric otoscopy (PP 95%, COMSEP members 79%). Most respondents reported usefulness of the American Academy of Pediatrics (AAP) AOM guidelines (PP 95%, COMSEP members 100%). More COMSEP members than PP adhered to the AAP’s diagnostic criteria (pediatric preceptors 42%, COMSEP members 93%). The most common barriers to teaching otoscopy were a lack of assistive technology (PP 77%, COMSEP members 56%), presence of cerumen (PP 58%, COMSEP members 60%), time to teach in direct patient care (PP 46%, COMSEP members 48%), and parent anxiety (PP 62%, COMSEP members 54%). Conclusions Our study identified systemic and individual practice patterns and barriers to teaching pediatric otoscopy. These results can inform education leaders in supporting and enabling preceptors in their clinical teaching. This approach can be adapted to ensure graduating medical students obtain intended core clinical skills.

Project description:BackgroundThe high prevalence of mental disorders in early adolescents, and their consequences, encourage the need for validated instruments to identify and assess psychosocial problems.Objectivesi) To evaluate the psychometric properties of the Spanish version of the Pediatric Symptom Checklist (PSC) questionnaires (PSC-Y, 35 items, and PSC-17-Y) and its subscales (Attention, Internalizing and Externalizing subscales), including the assessment of the item structure, concurrent validity, and reliability; and ii) To assess possible associations between bullying experiences, school climate and school membership with psychological problems identified by the PSC questionnaire.MethodsA cross-sectional study was carried out in 39 schools in Santiago, Chile. The sample consisted of 3,968 adolescents aged between 10 and 11 years. A descriptive analysis of the Pediatric Symptom Checklist was performed along with measures of dimensionality, reliability, and correlations with a validated questionnaire exploring similar constructs, the Strengths and Difficulties Questionnaire. Finally, associations of bullying, school climate, and school membership with the three subscales of the PSC were explored.ResultsBoth versions of PSC had problems with item #7 (Act as if driven by motor), which did not load in any of the latent factors. It was removed from later analyses. The three-factor structure of PSC was confirmed. All remaining items had high factor loadings in their corresponded latent factors, and the reliability was high for the total scales (PSC-34-Y, ω = 0.78; PSC-16-Y, ω = 0.94) and the subscales of PSC-16-Y (Attention, ω = 0.77; Internalizing, ω = 0.79; Externalizing, ω = 0.78). The goodness of fit was adequate, and the correlation between PSC subscales and SDQ subscales was high. Victimization and perpetration were associated with all PSC subscales, and higher school climate and stronger school memberships were negatively associated with PSC symptoms.ConclusionsThe current findings seem to demonstrate that the Spanish version of the PSC is a valid and reliable instrument for identifying and assessing psychosocial problems in early adolescents.

Project description:Background and objectivesFor patients with ESRD, referral from a dialysis facility to a transplant center for evaluation is an important step toward kidney transplantation. However, a standardized measure for assessing clinical performance of dialysis facilities transplant access is lacking. We describe methodology for a new dialysis facility measure: the Standardized Transplantation Referral Ratio.Design, setting, participants, & measurementsTransplant referral data from 8308 patients with incident ESRD within 249 dialysis facilities in the United States state of Georgia were linked with US Renal Data System data from January of 2008 to December of 2011, with follow-up through December of 2012. Facility-level expected referrals were computed from a two-stage Cox proportional hazards model after patient case mix risk adjustment including demographics and comorbidities. The Standardized Transplantation Referral Ratio (95% confidence interval) was calculated as a ratio of observed to expected referrals. Measure validity and reliability were assessed.ResultsOver 2008-2011, facility Standardized Transplantation Referral Ratios in Georgia ranged from 0 to 4.87 (mean =1.16, SD=0.76). Most (77%) facilities had observed referrals as expected, whereas 11% and 12% had Standardized Transplantation Referral Ratios significantly greater than and less than expected, respectively. Age, race, sex, and comorbid conditions were significantly associated with the likelihood of referral, and they were included in risk adjustment for Standardized Transplantation Referral Ratio calculations. The Standardized Transplantation Referral Ratios were positively associated with evaluation, waitlisting, and transplantation (r=0.46, 0.35, and 0.20, respectively; P<0.01). On average, approximately 33% of the variability in Standardized Transplantation Referral Ratios was attributed to between-facility variation, and 67% of the variability in Standardized Transplantation Referral Ratios was attributed to within-facility variation.ConclusionsThe majority of observed variation in dialysis facility referral performance was due to characteristics within a dialysis facility rather than patient factors included in risk adjustment models. Our study shows a method for computing a facility-level standardized measure for transplant referral on the basis of a pilot sample of Georgia dialysis facilities that could be used to monitor transplant referral performance of dialysis facilities.

Dataset Information

Standardized Checklist for Otoscopy Performance Evaluation: A Validation Study of a Tool to Assess Pediatric Otoscopy Skills.

Introduction

Methods

Results

Discussion

Publications

Standardized Checklist for Otoscopy Performance Evaluation: A Validation Study of a Tool to Assess Pediatric Otoscopy Skills.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets