Evaluation of general practitioners' single-lead electrocardiogram interpretation skills: a case-vignette study.
Ontology highlight
ABSTRACT: Background
Handheld single-lead electrocardiograms (1L-ECG) present a welcome addition to the diagnostic arsenal of general practitioners (GPs). However, little is known about GPs' 1L-ECG interpretation skills, and thus its reliability in real-world practice.Objective
To determine the diagnostic accuracy of GPs in diagnosing atrial fibrillation or flutter (AF/Afl) based on 1L-ECGs, with and without the aid of automatic algorithm interpretation, as well as other relevant ECG abnormalities.Methods
We invited 2239 Dutch GPs for an online case-vignette study. GPs were asked to interpret four 1L-ECGs, randomly drawn from a pool of 80 case-vignettes. These vignettes were obtained from a primary care study that used smartphone-operated 1L-ECG recordings using the AliveCor KardiaMobile. Interpretation of all 1L-ECGs by a panel of cardiologists was used as reference standard.Results
A total of 457 (20.4%) GPs responded and interpreted a total of 1613 1L-ECGs. Sensitivity and specificity for AF/Afl (prevalence 13%) were 92.5% (95% CI: 82.5-97.0%) and 89.8% (95% CI: 85.5-92.9%), respectively. PPV and NPV for AF/Afl were 45.7% (95% CI: 22.4-70.9%) and 98.8% (95% CI: 97.1-99.5%), respectively. GP interpretation skills did not improve in case-vignettes where the outcome of automatic AF-detection algorithm was provided. In detecting any relevant ECG abnormality (prevalence 22%), sensitivity, specificity, PPV and NPV were 96.3% (95% CI: 92.8-98.2%), 68.8% (95% CI: 62.4-74.6%), 43.9% (95% CI: 27.7-61.5%) and 97.9% (95% CI: 94.9-99.1%), respectively.Conclusions
GPs can safely rule out cardiac arrhythmias with 1L-ECGs. However, whenever an abnormality is suspected, confirmation by an expert-reader is warranted.
SUBMITTER: Karregat EPM
PROVIDER: S-EPMC8006764 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:AimsTraditional long-term ECG monitoring systems have primarily been used by cardiologist. New remote and wearable easy-to-use devices have led to increased use of ECG recordings also outside cardiology clinics. The aims of this study were to assess the feasibility and diagnostic accuracy of interpretation of the one-lead ECG recordings from a patch ECG device (ECG247 Smart Heart Sensor system) by general practitioners (GP).MethodsNorwegian GPs were invited to digitally assess 10 long-term ECG recordings with different arrhythmias performed by the ECG247 Smart Heart Sensor system. For all ECG examinations, the presence/absence of different arrhythmias was registered.ResultsA total of 40 GPs accepted the invitation and assessed all the 10 long-term ECG recordings. All the tests were assessed as interpretable by all the GPs. Arrhythmias (atrial fibrillation/flutter, supraventricular tachycardia, and ventricular tachycardia) were correctly identified in most cases, with sensitivity of 98% (95% CI 95-99%), specificity of 75% (95% CI 68-82%), and diagnostic accuracy of 89% (85-92%). Incorrect automatic system algorithm interpretations were rarely corrected by the GPs.ConclusionGPs interpreted one-lead recordings by the ECG247 Smart Heart Sensor system with high diagnostic accuracy for common arrhythmias. However, in cases with rare arrhythmias, we recommend consulting a cardiologist to confirm the diagnosis before treatment is initiated. This trial is registered with NCT04700865.
| S-EPMC10904176 | biostudies-literature
Project description:BackgroundPerforming electrocardiography is common in general practice, but the quality of indication setting and diagnostic accuracy have been disputed.ObjectivesTo assess the competence of general practitioners (GPs) in their decision-making process with regard to recording and interpreting an electrocardiogram (ECG) and evaluating the relevance of the result for management.MethodsAn online case vignette survey was performed among GPs and cardiologists (in 2015). Nine cases describing situations for which Dutch clinical guidelines recommend or advise against recording an ECG were presented. In each case, the participant had to make choices on recording an ECG, interpreting it, and using the result in a management decision. The reference standard for each ECG diagnosis was set by the expert author team.ResultsFifty GPs who interpret ECGs themselves, eight GPs who do not and 12 cardiologists completed the survey. Adherence to guidelines recommending an ECG was high for suspected atrial fibrillation, suspected arrhythmia present during consultation, including bradycardia, but much lower for progressive heart failure and stable angina. Diagnostic accuracy of GPs was best in atrial fibrillation (96%), sick sinus syndrome (85%) and old myocardial infarction (82%), but poor in left anterior fascicular block (16%) and incomplete right bundle branch block (10%). GPs often acknowledged the low relevance of the results of a non-indicated ECG.ConclusionGPs do not fully adhere to Dutch cardiovascular guidelines on indications for recording ECGs. Diagnostic accuracy was high for atrial fibrillation, sick sinus syndrome and old myocardial infarction and poor for left anterior fascicular block and incomplete right bundle branch block.
| S-EPMC6046661 | biostudies-literature
Project description:BackgroundGeneral practitioners (GPs) should regularly review patients' medications and, if necessary, deprescribe, as inappropriate polypharmacy may harm patients' health. However, deprescribing can be challenging for physicians. This study investigates GPs' deprescribing decisions in 31 countries.MethodsIn this case vignette study, GPs were invited to participate in an online survey containing three clinical cases of oldest-old multimorbid patients with potentially inappropriate polypharmacy. Patients differed in terms of dependency in activities of daily living (ADL) and were presented with and without history of cardiovascular disease (CVD). For each case, we asked GPs if they would deprescribe in their usual practice. We calculated proportions of GPs who reported they would deprescribe and performed a multilevel logistic regression to examine the association between history of CVD and level of dependency on GPs' deprescribing decisions.ResultsOf 3,175 invited GPs, 54% responded (N?=?1,706). The mean age was 50?years and 60% of respondents were female. Despite differences across GP characteristics, such as age (with older GPs being more likely to take deprescribing decisions), and across countries, overall more than 80% of GPs reported they would deprescribe the dosage of at least one medication in oldest-old patients (>?80?years) with polypharmacy irrespective of history of CVD. The odds of deprescribing was higher in patients with a higher level of dependency in ADL (OR =1.5, 95%CI 1.25 to 1.80) and absence of CVD (OR =3.04, 95%CI 2.58 to 3.57).InterpretationThe majority of GPs in this study were willing to deprescribe one or more medications in oldest-old multimorbid patients with polypharmacy. Willingness was higher in patients with increased dependency in ADL and lower in patients with CVD.
| S-EPMC7792080 | biostudies-literature
Project description:BackgroundThe standard configuration's set of twelve electrocardiogram (ECG) leads is optimal for the medical diagnosis of diverse cardiac conditions. However, it requires ten electrodes on the patient's limbs and chest, which is uncomfortable and cumbersome. Interlead conversion methods can reconstruct missing leads and enable more comfortable acquisitions, including in wearable devices, while still allowing for adequate diagnoses. Currently, methodologies for interlead ECG conversion either require multiple reference (input) leads and/or require input signals to be temporally aligned considering the ECG landmarks.MethodsUnlike the methods in the literature, this paper studies the possibility of converting ECG signals into all twelve standard configuration leads using signal segments from only one reference lead, without temporal alignment (blindly-segmented). The proposed methodology is based on a deep learning encoder-decoder U-Net architecture, which is compared with adaptations based on convolutional autoencoders and label refinement networks. Moreover, the method is explored for conversion with one single shared encoder or multiple individual encoders for each lead.ResultsDespite the more challenging settings, the proposed methodology was able to attain state-of-the-art level performance in multiple target leads, and both lead I and lead II seem especially suitable to convert certain sets of leads. In cross-database tests, the methodology offered promising results despite acquisition setup differences. Furthermore, results show that the presence of medical conditions does not have a considerable effect on the method's performance.ConclusionsThis study shows the feasibility of converting ECG signals using single-lead blindly-segmented inputs. Although the results are promising, further efforts should be devoted towards the improvement of the methodologies, especially the robustness to diverse acquisition setups, in order to be applicable to cardiac health monitoring in wearable devices and less obtrusive clinical scenarios.
| S-EPMC9710059 | biostudies-literature
Project description:Abstract Background Coeliac disease (CD) is a highly prevalent (∼1%) disease that allegedly remains undiagnosed in over 80% of the cases because of atypical symptoms or silent disease. Currently, it is unknown how GPs deal with (suspected) CD. Objectives This study aimed to better understand the diagnostic approach and the clinical reasoning process of GPs concerning CD and concurrently address diagnostic pitfalls. Methods A questionnaire with case vignettes to assess the knowledge, diagnostic reasoning pattern and practice for CD by GPs was developed. It was sent through academic GP research networks (encompassing over 1500 GPs) in two large cities and to smaller practices in rural areas. The questionnaire was composed of seven background questions, 13 questions related to four case vignettes and six additional CD-related questions Results Responses were received from 106 GPs. Knowledge on risk factors for CD and appropriate testing of at-risk populations was limited. Twenty-two percent would diagnose CD in adults exclusively based on serology, without histopathological confirmation. In total, 99% would refer a newly diagnosed patient to a dietitian to initiate a gluten-free diet (GFD). In the absence of symptoms, only 33% would initiate a GFD. Conclusion The results of this study have given us insight into the diagnostic process of GPs encountering patient with gluten-related complaints. Multiple serology test is available and used, while a positive serology test is not always followed up by a gastroduodenal biopsy to confirm the diagnosis. Most GPs would refer a symptomatic CD patient to a dietician for a GFD.
| S-EPMC8583831 | biostudies-literature
Project description:BackgroundIn developed countries, primary care physicians manage most patients with depression. Relatively few studies allow a comprehensive assessment of the decisions these doctors make in these cases and the factors associated with these decisions. We studied how general practitioners (GPs) manage the acute phase of a new episode of non-comorbid major depression (MD) and the factors associated with their decisions.Methodology/principal findingsIn this cross-sectional telephone survey, professional investigators interviewed an existing panel of randomly selected GPs (1249/1431, response rate: 87.3%). We used case-vignettes about new MD episodes in 8 versions differing by patient gender and socioeconomic status (blue/white collar) and disease intensity (mild/severe). GPs were randomized to receive one of these 8 versions. Overall, 82.6% chose pharmacotherapy; among them GPs chose either an antidepressant (79.8%) or an anxiolytic/hypnotic alone (18.5%). They rarely recommended referral for psychotherapy alone, regardless of severity, but 38.2% chose it in combination with pharmacotherapy. Antidepressant prescription was associated with severity of depression (OR?=?1.74; 95%CI?=?1.33-2.27), patient gender (female, OR?=?0.75; 95%CI?=?0.58-0.98), GP personal characteristics (e.g. history of antidepressant treatment: OR?=?2.31; 95%CI?=?1.41-3.81) and GP belief that antidepressants are overprescribed in France (OR?=?0.63; 95%CI?=?0.48-0.82). The combination of antidepressants and psychotherapy was associated with severity of depression (OR?=?1.82; 95%CI?=?1.31-2.52), patient's white-collar status (OR?=?1.58; 95%CI?=?1.14-2.18), and GPs' dissatisfaction with cooperation with mental health specialists (OR?=?0.63; 95%CI?=?0.45-0.89). These choices were not associated with either GPs' professional characteristics or psychiatrist density in the GP's practice areas.Conclusions/significanceGPs' choices for treating severe MD complied with clinical guidelines better than those for mild MD; GPs rarely recommended psychotherapy alone but rather as a complement to pharmacotherapy. Their decisions were mainly influenced by personal life experience and attitudes regarding treatment more than by professional characteristics. These results call into question the methods and content of continuing medical education in France about MD management.
| S-EPMC3525552 | biostudies-literature
Project description:BackgroundAccurate interpretation of a 12-lead electrocardiogram (ECG) demands high levels of skill and expertise. Early training in medical school plays an important role in building the ECG interpretation skill. Thus, understanding how medical students perform the task of interpretation is important for improving this skill.ObjectiveWe aimed to use eye tracking as a tool to research how eye fixation can be used to gain a deeper understanding of how medical students interpret ECGs.MethodsIn total, 16 medical students were recruited to interpret 10 different ECGs each. Their eye movements were recorded using an eye tracker. Fixation heatmaps of where the students looked were generated from the collected data set. Statistical analysis was conducted on the fixation count and duration using the Mann-Whitney U test and the Kruskal-Wallis test.ResultsThe average percentage of correct interpretations was 55.63%, with an SD of 4.63%. After analyzing the average fixation duration, we found that medical students study the three lower leads (rhythm strips) the most using a top-down approach: lead II (mean=2727 ms, SD=456), followed by leads V1 (mean=1476 ms, SD=320) and V5 (mean=1301 ms, SD=236). We also found that medical students develop a personal system of interpretation that adapts to the nature and complexity of the diagnosis. In addition, we found that medical students consider some leads as their guiding point toward finding a hint leading to the correct interpretation.ConclusionsThe use of eye tracking successfully provides a quantitative explanation of how medical students learn to interpret a 12-lead ECG.
| S-EPMC8554676 | biostudies-literature
Project description:Computerized interpretation of electrocardiogram plays an important role in daily cardiovascular healthcare. However, inaccurate interpretations lead to misdiagnoses and delay proper treatments. In this work, we built a high-quality Chinese 12-lead resting electrocardiogram dataset with 15,357 records, and called for a community effort to improve the performances of CIE through the China ECG AI Contest 2019. This dataset covers most types of ECG interpretations, including the normal type, 8 common abnormal types, and the other type which includes both uncommon abnormal and noise signals. Based on the Contest, we systematically assessed and analyzed a set of top-performing methods, most of which are deep neural networks, with both their commonalities and characteristics. This study establishes the benchmarks for computerized interpretation of 12-lead resting electrocardiogram and provides insights for the development of new methods. Graphical Abstract A community effort to assess and improve computerized interpretation of 12-lead resting electrocardiogram.
| S-EPMC8724189 | biostudies-literature
Project description:ImportanceMillions of clinicians rely daily on automated preliminary electrocardiogram (ECG) interpretation. Critical comparisons of machine learning-based automated analysis against clinically accepted standards of care are lacking.ObjectiveTo use readily available 12-lead ECG data to train and apply an explainability technique to a convolutional neural network (CNN) that achieves high performance against clinical standards of care.Design, setting, and participantsThis cross-sectional study was conducted using data from January 1, 2003, to December 31, 2018. Data were obtained in a commonly available 12-lead ECG format from a single-center tertiary care institution. All patients aged 18 years or older who received ECGs at the University of California, San Francisco, were included, yielding a total of 365 009 patients. Data were analyzed from January 1, 2019, to March 2, 2021.ExposuresA CNN was trained to predict the presence of 38 diagnostic classes in 5 categories from 12-lead ECG data. A CNN explainability technique called LIME (Linear Interpretable Model-Agnostic Explanations) was used to visualize ECG segments contributing to CNN diagnoses.Main outcomes and measuresArea under the receiver operating characteristic curve (AUC), sensitivity, and specificity were calculated for the CNN in the holdout test data set against cardiologist clinical diagnoses. For a second validation, 3 electrophysiologists provided consensus committee diagnoses against which the CNN, cardiologist clinical diagnosis, and MUSE (GE Healthcare) automated analysis performance was compared using the F1 score; AUC, sensitivity, and specificity were also calculated for the CNN against the consensus committee.ResultsA total of 992 748 ECGs from 365 009 adult patients (mean [SD] age, 56.2 [17.6] years; 183 600 women [50.3%]; and 175 277 White patients [48.0%]) were included in the analysis. In 91 440 test data set ECGs, the CNN demonstrated an AUC of at least 0.960 for 32 of 38 classes (84.2%). Against the consensus committee diagnoses, the CNN had higher frequency-weighted mean F1 scores than both cardiologists and MUSE in all 5 categories (CNN frequency-weighted F1 score for rhythm, 0.812; conduction, 0.729; chamber diagnosis, 0.598; infarct, 0.674; and other diagnosis, 0.875). For 32 of 38 classes (84.2%), the CNN had AUCs of at least 0.910 and demonstrated comparable F1 scores and higher sensitivity than cardiologists, except for atrial fibrillation (CNN F1 score, 0.847 vs cardiologist F1 score, 0.881), junctional rhythm (0.526 vs 0.727), premature ventricular complex (0.786 vs 0.800), and Wolff-Parkinson-White (0.800 vs 0.842). Compared with MUSE, the CNN had higher F1 scores for all classes except supraventricular tachycardia (CNN F1 score, 0.696 vs MUSE F1 score, 0.714). The LIME technique highlighted physiologically relevant ECG segments.Conclusions and relevanceThe results of this cross-sectional study suggest that readily available ECG data can be used to train a CNN algorithm to achieve comparable performance to clinical cardiologists and exceed the performance of MUSE automated analysis for most diagnoses, with some exceptions. The LIME explainability technique applied to CNNs highlights physiologically relevant ECG segments that contribute to the CNN's diagnoses.
| S-EPMC8340011 | biostudies-literature
Project description:OBJECTIVE:To quantify general practitioners' (GPs) sensitivity to anxiety disorders (ADs) when confronted with the range of symptoms common to children with ADs. Also, to explore GPs' conscious preferences and implicit tendencies for referral of children with ADs to mental healthcare. DESIGN AND SETTING:In a cross-sectional vignette-based survey, all attendees of a Dutch continuing medical education conference for primary care physicians were presented with subtitled audio fragments of five vignettes that we constructed to mimic symptom presentation of children with ADs in general practice. We asked attendees to select per vignette the most plausible diagnoses and most adequate referral option, and for their general referral preferences when they suspect each of the most common mental health problems. PARTICIPANTS:A sample of 229 GPs, resulting in a total of 1128 vignette evaluations. MAIN OUTCOME MEASURE:GPs' selection rate of ADs in the five vignettes compared with a benchmark provided by mental health professionals (MHPs). RESULTS:Overall, recognition of ADs was less likely in GPs compared with MHPs (OR=0.26, 95%?CI 0.15 to 0.46). GPs varied in their recognition of anxiety, with 44.1% not once selecting anxiety as the probable presenting problem. When asked explicitly, 63.9% of the GPs reported that they would refer a child to mental healthcare when they suspect probable ADs. By contrast, only 12.0% of the GPs who recognised anxiety in the vignettes actually selected that referral option. CONCLUSION:A significant fraction of GPs did not notice the depicted symptoms as anxiety. Despite the widespread prevalence of ADs, GPs seem to overlook anxiety already in their early diagnostic opinion. Improving GPs' familiarity with initial symptom presentation, ADs' base-rate, relevance and impact yields potential for timely recognition.
| S-EPMC7200042 | biostudies-literature