Inter-observer agreement in athletes ECG interpretation using the recent international recommendations for ECG interpretation in athletes among observers with different levels of expertise.
Ontology highlight
ABSTRACT: Introduction
International criteria for the interpretation of the athlete's electrocardiogram (ECG) have been proposed. We aimed to evaluate the inter-observer agreement among observers with different levels of expertise.Methods
Consecutive ECGs of Swiss elite athletes (≥14 years), recorded during routine pre-participation screening between 2013 and 2016 at the Swiss Federal Institute of Sports were analysed. A medical student (A), a cardiology fellow (B) and an electrophysiologist (C) interpreted the ECG's independently according to the most recent criteria. The frequencies and percentages for each observer were calculated. An inter-observer reliability analysis using Cohen Kappa (κ) statistics was used to determine consistency among observers.Results
A total of 287 ECGs (64.1% males) were analysed. Mean age of the athletes was 20.4±4.9 years. The prevalence of abnormal ECG findings was 1.4%. Both, normal and borderline findings in athletes showed moderate to good agreement between all observers. κ scores for abnormal findings resulted in excellent agreement (κ 0.855 in observer A vs C and B vs C to κ 1.000 in observer A vs B). Overall agreement ranged from moderate (κ 0.539; 0.419-0.685 95% CI) between observer B vs C to good agreement (κ 0.720; 0.681-0.821 95% CI) between observer A vs B.Conclusions
Our cohort of elite athletes had a low prevalence of abnormal ECGs. Agreement in abnormal ECG findings with the use of the recently published International recommendations for ECG interpretation in athletes among observers with different levels of expertise was excellent. ECG interpretation resulted in moderate to good overall agreement.
SUBMITTER: Schneiter S
PROVIDER: S-EPMC6248914 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundAccurate determination of cardiopulmonary exercise test (CPET) derived parameters is essential to allow for uniform preoperative risk assessment. The objective of this prospective observational study was to evaluate the inter-observer agreement of preoperative CPET-derived variables by comparing a self-preferred approach with a systematic guideline-based approach.MethodsTwenty-six professionals from multiple centers across the Netherlands interpreted 12 preoperative CPETs of patients scheduled for hepatopancreatobiliary surgery. Outcome parameters of interest were oxygen uptake at the ventilatory anaerobic threshold (V̇O2VAT) and at peak exercise (V̇O2peak), the slope of the relationship between the minute ventilation and carbon dioxide production (V̇E/V̇CO2-slope), and the oxygen uptake efficiency slope (OUES). Inter-observer agreement of the self-preferred approach and the guideline-based approach was quantified by means of the intra-class correlation coefficient.ResultsAcross the complete cohort, inter-observer agreement intraclass correlation coefficient (ICC) was 0.76 (95% confidence interval (CI) 0.57-0.93) for V̇O2VAT, 0.98 (95% CI 0.95-0.99) for V̇O2peak, and 0.86 (95% CI 0.75-0.95) for the V̇E/V̇CO2-slope when using the self-preferred approach. By using a systematic guideline-based approach, ICCs were 0.88 (95% CI 0.74-0.97) for V̇O2VAT, 0.99 (95% CI 0.99-1.00) for V̇O2peak, 0.97 (95% CI 0.94-0.99) for the V̇E/V̇CO2-slope, and 0.98 (95% CI 0.96-0.99) for the OUES.ConclusionsInter-observer agreement of numerical values of CPET-derived parameters can be improved by using a systematic guideline-based approach. Effort-independent variables such as the V̇E/V̇CO2-slope and the OUES might be useful to further improve uniformity in preoperative risk assessment in addition to, or in case V̇O2VAT and V̇O2peak are not determinable.
| S-EPMC9055752 | biostudies-literature
Project description:BackgroundRecent developments in diagnostic techniques for malaria, particularly DNA probes and sero-immunology, have raised questions as to how these techniques might be used to facilitate malaria diagnosis at the most peripheral levels of the primary health care system. At present, malaria diagnosis is based on the standard microscopic examination of blood films in most field epidemiologic studies and is likely to remain so in the immediate future in Africa. The objective of this study was to assess inter-observer agreement for the examination of Giemsa-stained slides for Plasmodium falciparum parasites.MethodsChildren aged 0 to 10 years were enrolled yearly in Bancoumana village (West Africa), mainly during the transmission season (June to October). The blood smears obtained from the persistently negative children in June 1996, August 1996, October 1996 and March 1997 were systematically re-examined. A stratified random sample (10%) proportional to the following parasite density classes 1-100, 101-5000, and 5001 and over was taken from the slides collected. The kappa statistics and the intra-class correlation were used as measures of agreement the first and the second slide examinations.ResultsThe weighted kappa statistic, widely used as a chance-corrected measure for nominal agreement, showed excellent inter-observer agreement (?(w)=0.7926; 95% CI [0.7588, 0.8263]; p=0.01). The intra-class correlation co-efficient had the same value of 0.7926 confirming the appropriateness of the weighted kappa statistic. Inter-observer agreement for slides read as negative by one observer, or as containing more than 100 parasites per ?l, was excellent: 97% (493/506) and 92% (145/158), respectively. In contrast, the inter-observer agreement for slides read by one observer as containing 1-100 parasites/?l was poor, 36% (96/268).ConclusionsIn field conditions in Mali, there was a high reproducibility for slides reported as negative or as having more than 100 parasites per ?l. However, smears with readings of 1-100 parasites per ?l were less reproducible and should be re-examined carefully.
| S-EPMC3849530 | biostudies-literature
Project description:BackgroundElectrocardiogram (ECG) with preparticipation evaluation (PPE) for athletes remains controversial in the United States and diagnostic accuracy of clinician ECG interpretation is unclear. This study aimed to assess reliability and validity of clinician ECG interpretation using expert-validated ECGs according to the 2010 European Society of Cardiology (ESC) interpretation criteria.MethodsThis is a blinded, prospective study of diagnostic accuracy of clinician ECG interpretation. Anonymized ECGs were validated for normal and abnormal patterns by blinded expert interpreters according to the ESC interpretation criteria from October 2011 through March 2012. Six pairs of clinician interpreters were recruited from relevant clinical specialties in an academic medical center in March 2012. Each clinician interpreted 85 ECGs according to the ESC interpretation guidelines. Cohen and Fleiss' kappa, sensitivity, and specificity were calculated within specialties and across primary care and cardiology specialty groups.ResultsExperts interpreted 189 ECGs yielding a kappa of 0.63, demonstrating "substantial" inter-rater agreement. A total of 85 validated ECGs, including 26 abnormals, were selected for clinician interpretation. The kappa across cardiology specialists was "substantial" and "moderate" across primary care (0.69 vs 0.52, respectively, P < 0.001). Sensitivity and specificity to detect abnormal patterns were similar between cardiology and primary care groups (sensitivity 93.3% vs 81.3%, respectively, P = 0.31; specificity 88.8% vs 89.8%, respectively, P = 0.91).ConclusionsClinician ECG interpretation according to the ESC interpretation criteria appears to demonstrate limited reliability and validity. Before widespread adoption of ECG for PPE of U.S. athletes, further research of training focused on improved reliability and validity of clinician ECG interpretation is warranted.
| S-EPMC6932271 | biostudies-literature
Project description:Health and socioeconomic disparities tend to be experienced along racial and ethnic lines, but investigators are not sure how individuals are assigned to groups, or how consistent this process is. To address these issues, 1,919 orthodontic patient records were examined by at least two observers who estimated each individual's race and the characteristics that influenced each estimate. Agreement regarding race is high for African and European Americans, but not as high for Asian, Hispanic, and Native Americans. The indicator observers most often agreed upon as important in estimating group membership is name, especially for Asian and Hispanic Americans. The observers, who were almost all European American, most often agreed that skin color is an important indicator of race only when they also agreed the subject was European American. This suggests that in a diverse community, light skin color is associated with a particular group, while a range of darker shades can be associated with members of any other group. This research supports comparable studies showing that race estimations in medical records are likely reliable for African and European Americans, but are less so for other groups. Further, these results show that skin color is not consistently the primary indicator of an individual's race, but that other characteristics such as facial features add significant information.
| S-EPMC3163683 | biostudies-literature
Project description:Invasive lobular breast carcinoma (ILC) is the second most common breast carcinoma (BC) subtype and is mainly driven by loss of E-cadherin expression. Correct classification of BC as ILC is important for patient treatment. This study assessed the degree of agreement among pathologists for the diagnosis of ILC. Two sets of hormone receptor (HR)-positive/HER2-negative BCs were independently reviewed by participating pathologists. In set A (61 cases), participants were provided with hematoxylin/eosin (HE)-stained sections. In set B (62 cases), participants were provided with HE-stained sections and E-cadherin immunohistochemistry (IHC). Tumor characteristics were balanced. Participants classified specimens as non-lobular BC versus mixed BC versus ILC. Pairwise inter-observer agreement and agreement with a pre-defined reference diagnosis were determined with Cohen's kappa statistics. Subtype calls were correlated with molecular features, including CDH1/E-cadherin mutation status. Thirty-five pathologists completed both sets, providing 4,305 subtype calls. Pairwise inter-observer agreement was moderate in set A (median κ = 0.58, interquartile range [IQR]: 0.48-0.66) and substantial in set B (median κ = 0.75, IQR: 0.56-0.86, p < 0.001). Agreement with the reference diagnosis was substantial in set A (median κ = 0.67, IQR: 0.57-0.75) and almost perfect in set B (median κ = 0.86, IQR: 0.73-0.93, p < 0.001). The median frequency of CDH1/E-cadherin mutations in specimens classified as ILC was 65% in set A (IQR: 56-72%) and 73% in set B (IQR: 65-75%, p < 0.001). Cases with variable subtype calls included E-cadherin-positive ILCs harboring CDH1 missense mutations, and E-cadherin-negative ILCs with tubular elements and focal P-cadherin expression. ILCs with trabecular growth pattern were often misclassified as non-lobular BC in set A but not in set B. In conclusion, subtyping of BC as ILC achieves almost perfect agreement with a pre-defined reference standard, if assessment is supported by E-cadherin IHC. CDH1 missense mutations associated with preserved E-cadherin protein expression, E- to P-cadherin switching in ILC with tubular elements, and trabecular ILC were identified as potential sources of discordant classification.
| S-EPMC8822373 | biostudies-literature
Project description:Background:Colon capsule endoscopy is a promising technique for evaluation of the colon, but its reproducibility is still unknown. Objective:This study assesses intra and inter-observer agreement in evaluations of colon capsule endoscopy videos. Methods:Forty-two complete colon capsule endoscopy investigations were analysed by three experts and two beginners. Intra-observer agreement was assessed in paired readings of two experts and two beginners. Agreement was determined by the intraclass correlation coefficient: poor (<0.5), moderate (0.5-0.75), good (0.75-0.9) and excellent (>0.9). Results:Agreement on 'indication for a following colonoscopy' based on the number and size of detected polyps and bowel cleansing quality was poor among all observers. Agreement among experts on the detection of large polyps and number of polyps was moderate, but agreement on bowel cleansing quality was poor. Beginners were in moderate agreement with the experts on polyp detection. Intra-observer agreement in experts was moderate to excellent for the detection of large polyps (?10?mm), excellent for the number of polyps, and poor to moderate for bowel cleansing quality. Intra-observer agreement in beginners was poor to moderate for all variables. Conclusions:This study shows a poor agreement on 'indication for a following colonoscopy', but a high intra and inter-observer agreement for polyp detection among experts, as well as a moderate agreement between beginners and experts.Trial registration: NCT02303756.
| S-EPMC6297930 | biostudies-literature
Project description:Ulcerative colitis (UC) endoscopic scores translate mucosal damage into values standardizing image analysis. Due to potential limits of current endoscopic activity indexes, we have elaborated on a new score, the "Extended Mayo Endoscopic Score (EMES)," and evaluated its inter-observer agreement in a multicenter endoscopy team, comparing concordance with the Mayo subscore. Sixteen UC consecutive patients underwent follow-up colonoscopy. Recorded videos were anonymously loaded on a web platform. Thirteen expert endoscopists evaluated UC activity using both Mayo and EMES. EMES was described in every colon segment: erythema (0: absent, 1: mild, 2: moderate, 3: severe), vascular pattern (0: normal, 1: reduction, 2: disappearance), erosions and ulcers (0: absent, 1: from 1 to 5, 2: 6 to 10, 3: >10). Weighted Fleiss' kappa with 95% confidence interval (CI) and p-value defined inter-rater agreement. Global inter-observer agreement of EMES was moderate (kappa = 0.56, 95% CI = 0.46-0.67, p < 0.001). The evaluation of each colonic segment showed moderate agreement for all segments: ascending (kappa = 0.46, 95% CI = 0.32-0.60, p < 0.001), transverse (kappa = 0.48, 95% CI = 0.29-0.67, p < 0.001); descending (kappa = 0.49, 95% CI = 0.35-0.64, p < 0.001), sigmoid (kappa = 0.52, 95% CI = 0.39-0.65, p < 0.001) and rectum (kappa = 0.55, 95% CI = 0.42-0.69, p < 0.001). Mayo subscore agreement was similar to global EMES (kappa = 0.53, 95% CI = 0.39-0.66, p = 0.001). Therefore, our report emphasizes the importance of assessing inter-observer agreement for EMES, but also for other known scoring systems, including the Mayo subscore.
| S-EPMC7236596 | biostudies-literature
Project description:Sanitary risk inspection, an observation protocol for identifying contamination hazards around water sources, is promoted for managing rural water supply safety. However, it is unclear how far different observers consistently identify contamination hazards and consistently classify water source types using standard typologies. This study aimed to quantify inter-observer agreement in hazard identification and classification of rural water sources. Six observers separately visited 146 domestic water sources in Siaya County, Kenya, in wet and dry seasons. Each observer independently classified the source type and conducted a sanitary risk inspection using a standard protocol. Water source types assigned by an experienced observer were cross-tabulated against those of his colleagues, as were contamination hazards identified, and inter-observer agreement measures calculated. Agreement between hazards observed by the most experienced observer versus his colleagues was significant but low (intra-class correlation = 0.49), with inexperienced observers detecting fewer hazards. Inter-observer agreement in classifying water sources was strong (Cohen's kappa = 0.84). However, some source types were frequently misclassified, such as sources adapted to cope with water insecurity (e.g. tanks drawing on both piped and rainwater). Observers with limited training and experience thus struggle to consistently identify hazards using existing protocols, suggesting observation protocols require revision and their implementation should be supported by comprehensive training. Findings also indicate that field survey teams struggle to differentiate some water source types based on a standard water source classification, particularly sources adapted to cope with water insecurity. These findings demonstrate uncertainties underpinning international monitoring and analyses of safe water access via household surveys.
| S-EPMC7661424 | biostudies-literature
Project description:ObjectivesElectroencephalography (EEG) technologists commonly screen continuous EEG. Until now, the inter-rater agreement or sensitivity for important EEG findings has been unknown in this group.MethodsTwenty-nine EEG technologists and three clinical neurophysiologists interpreted 90 five-minute samples of pediatric critical care EEG. Inter-rater agreement was examined with Cohen's kappa and Fleiss' kappa for EEG findings. A gold-standard consensus agreement was developed for examining sensitivity and specificity for seizures or discontinuity. Kruskal-Wallis tests with Benjamani-Hochberg corrections for multiple comparisons were utilized to examine associations between correct scoring and certification status and years of experience.ResultsAggregate agreement was moderate for seizures and fair for EEG background continuity among EEG technologists. Individual agreement for seizures and continuity varied from slight to substantial. For individual EEG technologists, sensitivity for seizures ranged from 44 to 93% and sensitivity for continuity ranged from 81 to 100%. Raters with Certified Long Term Monitoring credentials were more likely to identify seizures correctly.SignificanceThis is the first study to evaluate inter-rater agreement and interpretation correctness among EEG technologists interpreting pediatric critical care EEG. EEG technologists demonstrated better aggregate agreement for seizure detection than other EEG findings, yet individual results and internal consistency varied widely. These data provide important insight into the common practice of utilizing EEG technologists for screening critical care EEG.
| S-EPMC7856064 | biostudies-literature
Project description:BACKGROUND:The METastasis Reporting and Data System for Prostate Cancer (MET-RADS-P) guidelines are designed to enable reproducible assessment in detecting and quantifying metastatic disease response using whole-body magnetic resonance imaging (WB-MRI) in patients with advanced prostate cancer (APC). The purpose of our study was to evaluate the inter-observer agreement of WB-MRI examination reports produced by readers of different expertise when using the MET-RADS-P guidelines. METHODS:Fifty consecutive paired WB-MRI examinations, performed from December 2016 to February 2018 on 31 patients, were retrospectively examined to compare reports by a Senior Radiologist (9?years of experience in WB-MRI) and Resident Radiologist (after a 6-months training) using MET-RADS-P guidelines, for detection and for primary/dominant and secondary response assessment categories (RAC) scores assigned to metastatic disease in 14 body regions. Inter-observer agreement regarding RAC score was evaluated for each region by using weighted-Cohen's Kappa statistics (K). RESULTS:The number of metastatic regions reported by the Senior Radiologist (249) and Resident Radiologist (251) was comparable. For the primary/dominant RAC pattern, the agreement between readers was excellent for the metastatic findings in cervical, dorsal, and lumbosacral spine, pelvis, limbs, lungs and other sites (K:0.81-1.0), substantial for thorax, retroperitoneal nodes, other nodes and liver (K:0.61-0.80), moderate for pelvic nodes (K:0.56), fair for primary soft tissue and not assessable for skull due to the absence of findings. For the secondary RAC pattern, agreement between readers was excellent for the metastatic findings in cervical spine (K:0.93) and retroperitoneal nodes (K:0.89), substantial for those in dorsal spine, pelvis, thorax, limbs and pelvic nodes (K:0.61-0.80), and moderate for lumbosacral spine (K:0.44). CONCLUSIONS:We found inter-observer agreement between two readers of different expertise levels to be excellent in bone, but mixed in other body regions. Considering the importance of bone metastases in patients with APC, our results favor the use of MET-RADS-P in response to the growing clinical need for monitoring of metastasis in these patients.
| S-EPMC7590732 | biostudies-literature