Dataset Information

Reliability and validity of clinician ECG interpretation for athletes.

ABSTRACT:

Background

Electrocardiogram (ECG) with preparticipation evaluation (PPE) for athletes remains controversial in the United States and diagnostic accuracy of clinician ECG interpretation is unclear. This study aimed to assess reliability and validity of clinician ECG interpretation using expert-validated ECGs according to the 2010 European Society of Cardiology (ESC) interpretation criteria.

Methods

This is a blinded, prospective study of diagnostic accuracy of clinician ECG interpretation. Anonymized ECGs were validated for normal and abnormal patterns by blinded expert interpreters according to the ESC interpretation criteria from October 2011 through March 2012. Six pairs of clinician interpreters were recruited from relevant clinical specialties in an academic medical center in March 2012. Each clinician interpreted 85 ECGs according to the ESC interpretation guidelines. Cohen and Fleiss' kappa, sensitivity, and specificity were calculated within specialties and across primary care and cardiology specialty groups.

Results

Experts interpreted 189 ECGs yielding a kappa of 0.63, demonstrating "substantial" inter-rater agreement. A total of 85 validated ECGs, including 26 abnormals, were selected for clinician interpretation. The kappa across cardiology specialists was "substantial" and "moderate" across primary care (0.69 vs 0.52, respectively, P < 0.001). Sensitivity and specificity to detect abnormal patterns were similar between cardiology and primary care groups (sensitivity 93.3% vs 81.3%, respectively, P = 0.31; specificity 88.8% vs 89.8%, respectively, P = 0.91).

Conclusions

Clinician ECG interpretation according to the ESC interpretation criteria appears to demonstrate limited reliability and validity. Before widespread adoption of ECG for PPE of U.S. athletes, further research of training focused on improved reliability and validity of clinician ECG interpretation is warranted.

SUBMITTER: Magee C

PROVIDER: S-EPMC6932271 | biostudies-literature | 2014 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability and validity of clinician ECG interpretation for athletes.

Magee Charles C Kazman Joshua J Haigney Mark M Oriscello Ralph R DeZee Kent J KJ Deuster Patricia P Depenbrock Patrick P O'Connor Francis G FG

Annals of noninvasive electrocardiology : the official journal of the International Society for Holter and Noninvasive Electrocardiology, Inc 20140212 4

<h4>Background</h4>Electrocardiogram (ECG) with preparticipation evaluation (PPE) for athletes remains controversial in the United States and diagnostic accuracy of clinician ECG interpretation is unclear. This study aimed to assess reliability and validity of clinician ECG interpretation using expert-validated ECGs according to the 2010 European Society of Cardiology (ESC) interpretation criteria.<h4>Methods</h4>This is a blinded, prospective study of diagnostic accuracy of clinician ECG interp ...[more]

PMID: 24520825

Similar Datasets

Project description:BackgroundAthletes can experience exercise-induced transient arrythmias during high-intensity exercise or competition, which are difficult to capture on traditional Holter monitors or replicate in clinical exercise testing. The aim of this study was to investigate the reliability of a portable single channel ECG sensor and data recorder (PluxECG) and to evaluate the confidence and reliability in interpretation of ECGs recorded using the PluxECG during remote rowing.MethodsThis was a two-phase study on rowing athletes. Phase I assessed the accuracy and precision of heart rate (HR) using the PluxECG system compared to a reference 12-lead ECG system. Phase II evaluated the confidence and reliability in interpretation of ECGs during ergometer (ERG) and on-water (OW) rowing at moderate and high intensities. ECGs were reviewed by two expert readers for HR, rhythm, artifact and confidence in interpretation.ResultsFindings from Phase I found that 91.9% of samples were within the 95% confidence interval for the instantaneous value of the changing exercising HR. The mean correlation coefficient across participants and tests was 0.9886 (σ = 0.0002, SD = 0.017) and between the two systems at elevated HR was 0.9676 (σ = 0.002, SD = 0.05). Findings from Phase II found significant differences for the presence of artifacts and confidence in interpretation in ECGs between readers' for both intensities and testing conditions. Interpretation of ECGs for OW rowing had a lower level of reader agreement than ERG rowing for HR, rhythm, and artifact. Using consensus data between readers' significant differences were apparent between OW and ERG rowing at high-intensity rowing for HR (p = 0.05) and artifact (p = 0.01). ECGs were deemed of moderate-low quality based on confidence in interpretation and the presence of artifacts.ConclusionsThe PluxECG device records accurate and reliable HR but not ECG data during exercise in rowers. The quality of ECG tracing derived from the PluxECG device is moderate-low, therefore the confidence in ECG interpretation using the PluxECG device when recorded on open water is inadequate at this time.

Project description:BackgroundECGs are often taught without clinical context. However, in the clinical setting, ECGs are rarely interpreted without knowing the clinical presentation. We aimed to determine whether ECG diagnostic accuracy was influenced by knowledge of the clinical context and/or prior clinical exposure to the ECG diagnosis.MethodsFourth- (junior) and sixth-year (senior) medical students, as well as medical residents were invited to complete two multiple-choice question (MCQ) tests and a survey. Test 1 comprised 25 ECGs without case vignettes. Test 2, completed immediately thereafter, comprised the same 25 ECGs and MCQs, but with case vignettes for each ECG. Subsequently, participants indicated in the survey when last, during prior clinical clerkships, they have seen each of the 25 conditions tested. Eligible participants completed both tests and survey. We estimated that a minimum sample size of 165 participants would provide 80% power to detect a mean difference of 7% in test scores, considering a type 1 error of 5%.ResultsThis study comprised 176 participants (67 [38.1%] junior students, 55 [31.3%] senior students, 54 [30.7%] residents). Prior ECG exposure depended on their level of training, i.e., junior students were exposed to 52% of the conditions tested, senior students 63.4% and residents 96.9%. Overall, there was a marginal improvement in ECG diagnostic accuracy when the clinical context was known (Cohen's d = 0.35, p < 0.001). Gains in diagnostic accuracy were more pronounced amongst residents (Cohen's d = 0.59, p < 0.001), than senior (Cohen's d = 0.38, p < 0.001) or junior students (Cohen's d = 0.29, p < 0.001). All participants were more likely to make a correct ECG diagnosis if they reported having seen the condition during prior clinical training, whether they were provided with a case vignette (odds ratio [OR] 1.46, 95% confidence interval [CI] 1.24-1.71) or not (OR 1.58, 95% CI 1.35-1.84).ConclusionECG interpretation using clinical vignettes devoid of real patient experiences does not appear to have as great an impact on ECG diagnostic accuracy as prior clinical exposure. However, exposure to ECGs during clinical training is largely opportunistic and haphazard. ECG training should therefore not rely on experiential learning alone, but instead be supplemented by other formal methods of instruction.

Dataset Information

Reliability and validity of clinician ECG interpretation for athletes.

Background

Methods

Results

Conclusions

Publications

Reliability and validity of clinician ECG interpretation for athletes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets