Assessing the Diagnostic Accuracy of Physicians for Home Death Certification in Shanghai: Application of SmartVA.
Ontology highlight
ABSTRACT:
SUBMITTER: Chen L
PROVIDER: S-EPMC9247331 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundThere is little information on the validity of using record linkage with routinely collected data for case ascertainment of stroke in large population-based studies in the UK. We examined the accuracy of these routine record linkage approaches for identifying incident stroke cases in a large UK population-based study, the European Prospective Investigation into Cancer (EPIC)-Norfolk cohort.MethodsWe examined a sample of hospital records of incident stroke cases identified by linkage with two routine data sources, death certificates and a national hospital record linkage system (ENCORE), using predefined study criteria. Two senior Specialist Registrars with clinical experience in stroke medicine examined the hospital records and searched for the evidence of stroke recorded in these records between 1993/97-2003.ResultsOf 520 incident strokes identified between 1993/1997-2003 using record linkage systems in the EPIC-Norfolk, a sample of 250 medical case notes were examined between March and July 2004. Using the predefined study criteria, there were 191 definite strokes (76%), 20 probable strokes (8%), 11 possible strokes and 11 cases of transient ischaemic attacks (4% each) i.e. 233/250 (93%) with possible or definite stroke or transient ischaemic attacks. Stroke could not be verified using hospital records in 13 cases (5%) and 4 cases (2%) had other diagnoses: 3 cases of vascular dementia and 1 case of benign intracranial hypertension. The diagnosis of stroke in 185 out of 250 cases identified in the EPIC-Norfolk (74.0%) was supported by radiological evidence using WHO criteria.ConclusionDeath certificates and hospital record linkage in this British prospective study have a high accuracy or positive predictive value in correctly identifying incident stroke cases.
| S-EPMC2605452 | biostudies-literature
Project description:BackgroundTimely and accurate discrimination of wide complex tachycardias (WCTs) into ventricular tachycardia (VT) or supraventricular WCT (SWCT) is critically important. Previously we developed and validated an automated VT Prediction Model that provides a VT probability estimate using the paired WCT and baseline 12-lead ECGs. Whether this model improves physicians' diagnostic accuracy has not been evaluated.ObjectiveWe sought to determine whether the VT Prediction Model improves physicians' WCT differentiation accuracy.MethodsOver four consecutive days, nine physicians independently interpreted fifty WCT ECGs (25 VTs and 25 SWCTs confirmed by electrophysiological study) as either VT or SWCT. Day 1 used the WCT ECG only, Day 2 used the WCT and baseline ECG, Day 3 used the WCT ECG and the VT Prediction Model's estimation of VT probability, and Day 4 used the WCT ECG, baseline ECG, and the VT Prediction Model's estimation of VT probability.ResultsInclusion of the VT Prediction Model data increased diagnostic accuracy versus the WCT ECG alone (Day 3: 84.2% vs. Day 1: 68.7%, p 0.009) and WCT and baseline ECGs together (Day 3: 84.2% vs. Day 2: 76.4%, p 0.003). There was no further improvement of accuracy with addition of the baseline ECG comparison to the VT Prediction Model (Day 3: 84.2% vs. Day 4: 84.0%, p 0.928). Overall sensitivity (Day 3: 78.2% vs. Day 1: 67.6%, p 0.005) and specificity (Day 3: 90.2% vs. Day 1: 69.8%, p 0.016) for VT were superior after the addition of the VT Prediction Model.ConclusionThe VT Prediction Model improves physician ECG diagnostic accuracy for discriminating WCTs.
| S-EPMC9799284 | biostudies-literature
Project description:BackgroundMortality data are essential for many aspects of everyday public health practices at both national and international levels. Despite the current developments in various aspects of the medical field, the apparent inability of physicians to complete death notification forms (DNF) accurately is still worldwide concern. The aim of this study is to assess the physicians' knowledge and practice on completing the DNF.MethodsA self-administered questionnaire was distributed to 200 physicians in governmental and non-governmental hospitals in the North West-Bank in Palestine. Furthermore, a case scenario was included in the questionnaire and physicians were asked to fill the cause of death section. The percentage of errors committed while completing the cause of death section were computed. A Chi square test was used to assess the association between physicians' characteristics and their responses.ResultsOnly 40.6% of the participants completed the cause of death section correctly. The immediate and underlying causes of death were correctly identified by 48.7% and 71.3% of physicians, respectively. Almost one-fifth (17.3%) of physicians wrote the mechanism of death without reporting the underlying cause of death and 14.7% of them reported the sequence of events leading to death incorrectly.ConclusionsPhysicians' knowledge and practice on completing the DNF is poor and insufficient, which may seriously affect the accuracy of mortality data. Complicated cases, problems in the current design of the DNFs and lack of training were the most common factors contributing to inaccuracy in death certification. We recommend offering periodical training workshops on completing the DNF to all physicians, and developing a manual on completing the DNFs with clear instructions and guidelines.
| S-EPMC5759221 | biostudies-literature
Project description:Backgrounddeath certification data are routinely collected in most developed countries. Coded causes of death are a readily accessible source and have the potential advantage of providing complete follow-up, but with limitations.Objectiveto investigate the reliability of using death certificates for surveillance of dementia, the time trend of recording dementia on death certificates and predictive factors of recording of dementia.Subjectsindividuals aged 65 and over in six areas across England and Wales were randomly selected for the Medical Research Council Cognitive Function and Ageing Study (CFAS) and CFAS II with mortality follow-up.Methodsprevalence of dementia recorded on death certificates were calculated by year. Reporting of dementia on death certificates compared with the study diagnosis of dementia, with sensitivity, specificity and Cohen's ? were estimated. Multivariable logistic regression models explored the impact of potential factors on the reporting of dementia on the death certificate.Resultsthe overall unadjusted prevalence of dementia on death certificates rose from 5.3% to 25.9% over the last 26 years. Dementia reported on death certificates was poor with sensitivity 21.0% in earlier cohort CFAS, but it had increased to 45.2% in CFAS II. Dementia was more likely to be recorded on death certificates in individuals with severe dementia, or those living in an institution, yet less likely reported if individuals died in hospital.Conclusionrecording dementia on death certificate has improved significantly in the England and Wales. However, such information is still an underestimate and should be used alongside epidemiological estimations.
| S-EPMC6014308 | biostudies-literature
Project description:BackgroundCorrect certification of cause of death by physicians (i.e. completing the medical certificate of cause of death or MCCOD) and correct coding according to International Classification of Diseases (ICD) rules are essential to produce quality mortality statistics to inform health policy. Despite clear guidelines, errors in medical certification are common. This study objectively measures the impact of different medical certification errors upon the selection of the underlying cause of death.MethodsA sample of 1592 error-free MCCODs were selected from the 2017 United States multiple cause of death data. The ten most common types of errors in completing the MCCOD (according to published studies) were individually simulated on the error-free MCCODs. After each simulation, the MCCODs were coded using Iris automated mortality coding software. Chance-corrected concordance (CCC) was used to measure the impact of certification errors on the underlying cause of death. Weights for each error type and Socio-demographic Index (SDI) group (representing different mortality conditions) were calculated from the CCC and categorised (very high, high, medium and low) to describe their effect on cause of death accuracy.FindingsThe only very high impact error type was reporting an ill-defined condition as the underlying cause of death. High impact errors were found to be reporting competing causes in Part 1 [of the death certificate] and illegibility, with medium impact errors being reporting underlying cause in Part 2 [of the death certificate], incorrect or absent time intervals and reporting contributory causes in Part 1, and low impact errors comprising multiple causes per line and incorrect sequence. There was only small difference in error importance between SDI groups.ConclusionsReporting an ill-defined condition as the underlying cause of death can seriously affect the coding outcome, while other certification errors were mitigated through the correct application of mortality coding rules. Training of physicians in not reporting ill-defined conditions on the MCCOD and mortality coders in correct coding practices and using Iris should be important components of national strategies to improve cause of death data quality.
| S-EPMC8575485 | biostudies-literature
Project description:In this paper, we extend the definitions of the net reclassification improvement (NRI) and the integrated discrimination improvement (IDI) in the context of multicategory classification. Both measures were proposed in Pencina and others (2008. Evaluating the added predictive ability of a new marker: from area under the receiver operating characteristic (ROC) curve to reclassification and beyond. Statistics in Medicine 27, 157-172) as numeric characterizations of accuracy improvement for binary diagnostic tests and were shown to have certain advantage over analyses based on ROC curves or other regression approaches. Estimation and inference procedures for the multiclass NRI and IDI are provided in this paper along with necessary asymptotic distributional results. Simulations are conducted to study the finite-sample properties of the proposed estimators. Two medical examples are considered to illustrate our methodology.
| S-EPMC3695653 | biostudies-literature
Project description:BackgroundIn Mexico, the vital registration system relies on information collected from death certificates to generate official mortality figures. Although the death certificate has high coverage across the country, there is little information regarding its validity. The objective of this study was to assess the concordance between the underlying cause of death in official statistics obtained from death certificates and a gold standard diagnosis of the same deaths derived from medical records of hospitals.MethodsThe study sample consisted of 1,589 deaths that occurred in 34 public hospitals in the Federal District and the state of Morelos, Mexico in 2009. Neonatal, child, and adult cases were selected for causes of death that included infectious diseases, noncommunicable diseases, and injuries. We compared the underlying cause of death, obtained from medical death certificates, against a gold standard diagnosis derived from a review of medical records developed by the Population Health Metrics Research Consortium. We used chance-corrected concordance and accuracy as metrics to evaluate the quality of performance of the death certificate.ResultsAnalysis considering only the underlying cause of death resulted in a median chance-corrected concordance between the cause of death in medical death certificates versus the gold standard of 54.3% (95% uncertainty interval [UI]: 52.2, 55.6) for neonates, 38.5% (37.0, 40.0) for children, and 66.5% (65.9, 66.9) for adults. The accuracy resulting from the same analysis was 0.756 (0.747, 0.769) for neonates, 0.683 (0.663, 0.701) for children, and 0.780 (0.774, 0.785) for adults. Median chance-corrected concordance and accuracy increased when considering the mention of any cause of death in the death certificate, not just the underlying cause. Concordance varied substantially depending on cause of death, and accuracy varied depending on the true cause-specific mortality fraction composition.ConclusionsAlthough we cannot generalize our conclusions to Mexico as a whole, the results demonstrate important problems with the quality of the main source of information for causes of death used by decision-makers in settings with highly technological vital registration systems. It is necessary to improve death certification procedures, especially in the case of child and neonatal deaths. This requires an important commitment from the health system and health institutions.
| S-EPMC3160931 | biostudies-literature
Project description:IntroductionDocumentation of the cause of death is important for local and national epidemiology as well as for research and public health funding allocation. Despite this, many physicians lack the skills necessary to accurately complete a death certificate.MethodsWe created a 45-minute virtual workshop to improve skills in completing death certificates. Participants examined the role of death certificates in disease epidemiology and resource allocation for research and public health interventions, reviewed the components of a death certificate, and practiced correcting and filling out death certificates from actual patient cases. To assess the workshop, participants completed sample death certificates immediately before and after the workshop for two representative cases.ResultsThirty-six internal medicine residents (17 PGY 1s, 12 PGY 2s, and seven PGY 3s) completed the workshop. Prior to the workshop, 89% of the sample death certificates contained one or more errors, compared with 46% postworkshop. Major errors, such as incorrect categorization of a cause of death, decreased from 58% preworkshop to 17% postworkshop. Learners expressed discomfort after realizing they had made errors in completing previous death certificates and noted a desire for continuing education and reference materials on this topic.DiscussionDeath certification is a key competency for physicians. Our virtual workshop improved participants' skills in completing death certificates. Although a significant number of errors remained after the workshop, most of these residual errors were minor and would not affect cause-of-death reporting. The durability of these improvements over time requires further study.
| S-EPMC9842806 | biostudies-literature
Project description:The objective of this paper is to describe general approaches of diagnostic test accuracy (DTA) that are available for the quantitative synthesis of data using R software. We conduct a DTA that summarizes statistics for univariate analysis and bivariate analysis. The package commands of R software were "metaprop" and "metabin" for sensitivity, specificity, and diagnostic odds ratio; forest for forest plot; reitsma of "mada" for a summarized receiver-operating characteristic (ROC) curve; and "metareg" for meta-regression analysis. The estimated total effect sizes, test for heterogeneity and moderator effect, and a summarized ROC curve are reported using R software. In particular, we focus on how to calculate the effect sizes of target studies in DTA. This study focuses on the practical methods of DTA rather than theoretical concepts for researchers whose fields of study were non-statistics related. By performing this study, we hope that many researchers will use R software to determine the DTA more easily, and that there will be greater interest in related research.
| S-EPMC6545496 | biostudies-literature
Project description:BackgroundThe board certification system serves as a quality assurance system for physicians, and its design and operation are important health policy issues. In Japan, board certification was established and operated independently by academic societies and has not been directly linked to reimbursement systems. The phenomenon of younger physicians seeking specialist careers has raised concerns about acceleration of the tendency of fewer physicians working in rural areas and the maldistribution of physicians. Little is known about the associations between physicians' geographical migration patterns and board certification status changes or between the continuation of urban/rural practice and the maintenance of board certification. This study aimed to identify these associations and to discuss their policy implications.MethodsWe analyzed 2012 and 2014 data from the Survey of Physicians, Dentists, and Pharmacists, a national census survey. To analyze geographical migration patterns, transitions in practice location (rural, intermediate, and urban) were analyzed by board certification status change (new, lost, consistently certified, and consistently uncertified). Logistic regression analysis was conducted to assess whether the odds of migrating to more urban/rural municipalities were associated with board certification status changes, adjusting for covariates, and whether practicing in a rural area was associated with maintaining board certification.ResultsAmong 18,726 newly board-certified physicians, 94.9% (13,435/14,150) of those working in urban areas before certification remained in urban areas, whereas 64.6% (393/608) of those working in rural areas stayed in rural areas. Those who were newly certified had higher odds of moving to more urban areas, adjusting for covariates. Those who stayed in rural areas showed lower odds of maintaining board certification, adjusting for covariates.ConclusionsNewly board-certified physicians are more likely to migrate to other types of areas, particularly more urban areas, than other physicians. Allocating more training quotas to rural areas could be one option for leveling the distribution of specialists. It also appeared that those practicing in rural areas have difficulty maintaining their certification, so the need to establish a support system for already-certified physicians in rural areas should be emphasized.
| S-EPMC6081900 | biostudies-literature