Dataset Information

Effectiveness of training interventions to improve quality of medical certification of cause of death: systematic review and meta-analysis.

ABSTRACT:

Background

Valid cause of death data are essential for health policy formation. The quality of medical certification of cause of death (MCCOD) by physicians directly affects the utility of cause of death data for public policy and hospital management. Whilst training in correct certification has been provided for physicians and medical students, the impact of training is often unknown. This study was conducted to systematically review and meta-analyse the effectiveness of training interventions to improve the quality of MCCOD.

Methods

This review was registered in the International Prospective Register of Systematic Reviews (PROSPERO; Registration ID: CRD42020172547) and followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. CENTRAL, Ovid MEDLINE and Ovid EMBASE databases were searched using pre-defined search strategies covering the eligibility criteria. Studies were selected using four screening questions using the Distiller-SR software. Risk of bias assessments were conducted with GRADE recommendations and ROBINS-I criteria for randomised and non-randomised interventions, respectively. Study selection, data extraction and bias assessments were performed independently by two reviewers with a third reviewer to resolve conflicts. Clinical, methodological and statistical heterogeneity assessments were conducted. Meta-analyses were performed with Review Manager 5.4 software using the 'generic inverse variance method' with risk difference as the pooled estimate. A 'summary of findings' table was prepared using the 'GRADEproGDT' online tool. Sensitivity analyses and narrative synthesis of the findings were also performed.

Results

After de-duplication, 616 articles were identified and 21 subsequently selected for synthesis of findings; four underwent meta-analysis. The meta-analyses indicated that selected training interventions significantly reduced error rates among participants, with pooled risk differences of 15-33%. Robustness was identified with the sensitivity analyses. The findings of the narrative synthesis were similarly suggestive of favourable outcomes for both physicians and medical trainees.

Conclusions

Training physicians in correct certification improves the accuracy and policy utility of cause of death data. Investment in MCCOD training activities should be considered as a key component of strategies to improve vital registration systems given the potential of such training to substantially improve the quality of cause of death data.

SUBMITTER: Gamage USH

PROVIDER: S-EPMC7728523 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Effectiveness of training interventions to improve quality of medical certification of cause of death: systematic review and meta-analysis.

Gamage U S H USH Mahesh Pasyodun Koralage Buddhika PKB Schnall Jesse J Mikkelsen Lene L Hart John D JD Chowdhury Hafiz H Li Hang H McLaughlin Deirdre D Lopez Alan D AD

BMC medicine 20201211 1

<h4>Background</h4>Valid cause of death data are essential for health policy formation. The quality of medical certification of cause of death (MCCOD) by physicians directly affects the utility of cause of death data for public policy and hospital management. Whilst training in correct certification has been provided for physicians and medical students, the impact of training is often unknown. This study was conducted to systematically review and meta-analyse the effectiveness of training interv ...[more]

PMID: 33302931

Similar Datasets

Project description:Accurate and timely data on cause of death are critically important for guiding health programs and policies. Deaths certified by doctors are implicitly considered to be reliable and accurate, yet the quality of information provided in the international Medical Certificate of Cause of Death (MCCD) usually varies according to the personnel involved in certification, the diagnostic capacity of the hospital, and the category of hospitals. There are no published studies that have analysed how certifying doctors in Bangladesh adhere to international rules when completing the MCCD or have assessed the quality of clinical record keeping.The study took place between January 2011 and April 2014 in the Chandpur and Comilla districts of Bangladesh. We introduced the international MCCD to all study hospitals. Trained project physicians assigned an underlying cause of death, assessed the quality of the death certificate, and reported the degree of certainty of the medical records provided for a given cause. We examined the frequency of common errors in completing the MCCD, the leading causes of in-hospital deaths, and the degree of certainty in the cause of death data.The study included 4914 death certificates. 72.9% of medical records were of too poor quality to assign a cause of death, with little difference by age, hospital, and cause of death. 95.6% of death certificates did not indicate the time interval between onset and death, 31.6% required a change in sequence, 13.9% required to include a new diagnosis, 50.7% used abbreviations, 41.5% used multiple causes per line, and 33.2% used an ill-defined condition as the underlying cause of death. 99.1% of death certificates had at least one error. The leading cause of death among adults was stroke (15.8%), among children was pneumonia (31.7%), and among neonates was birth asphyxia (52.8%).Physicians in Bangladeshi hospitals had difficulties in completing the MCCD correctly. Physicians routinely made errors in death certification practices and medical record quality was poor. There is an urgent need to improve death certification practices and the quality of hospital data in Bangladesh if these data are to be useful for policy.

Project description:BackgroundIn Mexico, the vital registration system relies on information collected from death certificates to generate official mortality figures. Although the death certificate has high coverage across the country, there is little information regarding its validity. The objective of this study was to assess the concordance between the underlying cause of death in official statistics obtained from death certificates and a gold standard diagnosis of the same deaths derived from medical records of hospitals.MethodsThe study sample consisted of 1,589 deaths that occurred in 34 public hospitals in the Federal District and the state of Morelos, Mexico in 2009. Neonatal, child, and adult cases were selected for causes of death that included infectious diseases, noncommunicable diseases, and injuries. We compared the underlying cause of death, obtained from medical death certificates, against a gold standard diagnosis derived from a review of medical records developed by the Population Health Metrics Research Consortium. We used chance-corrected concordance and accuracy as metrics to evaluate the quality of performance of the death certificate.ResultsAnalysis considering only the underlying cause of death resulted in a median chance-corrected concordance between the cause of death in medical death certificates versus the gold standard of 54.3% (95% uncertainty interval [UI]: 52.2, 55.6) for neonates, 38.5% (37.0, 40.0) for children, and 66.5% (65.9, 66.9) for adults. The accuracy resulting from the same analysis was 0.756 (0.747, 0.769) for neonates, 0.683 (0.663, 0.701) for children, and 0.780 (0.774, 0.785) for adults. Median chance-corrected concordance and accuracy increased when considering the mention of any cause of death in the death certificate, not just the underlying cause. Concordance varied substantially depending on cause of death, and accuracy varied depending on the true cause-specific mortality fraction composition.ConclusionsAlthough we cannot generalize our conclusions to Mexico as a whole, the results demonstrate important problems with the quality of the main source of information for causes of death used by decision-makers in settings with highly technological vital registration systems. It is necessary to improve death certification procedures, especially in the case of child and neonatal deaths. This requires an important commitment from the health system and health institutions.

Project description:BackgroundCorrect certification of cause of death by physicians (i.e. completing the medical certificate of cause of death or MCCOD) and correct coding according to International Classification of Diseases (ICD) rules are essential to produce quality mortality statistics to inform health policy. Despite clear guidelines, errors in medical certification are common. This study objectively measures the impact of different medical certification errors upon the selection of the underlying cause of death.MethodsA sample of 1592 error-free MCCODs were selected from the 2017 United States multiple cause of death data. The ten most common types of errors in completing the MCCOD (according to published studies) were individually simulated on the error-free MCCODs. After each simulation, the MCCODs were coded using Iris automated mortality coding software. Chance-corrected concordance (CCC) was used to measure the impact of certification errors on the underlying cause of death. Weights for each error type and Socio-demographic Index (SDI) group (representing different mortality conditions) were calculated from the CCC and categorised (very high, high, medium and low) to describe their effect on cause of death accuracy.FindingsThe only very high impact error type was reporting an ill-defined condition as the underlying cause of death. High impact errors were found to be reporting competing causes in Part 1 [of the death certificate] and illegibility, with medium impact errors being reporting underlying cause in Part 2 [of the death certificate], incorrect or absent time intervals and reporting contributory causes in Part 1, and low impact errors comprising multiple causes per line and incorrect sequence. There was only small difference in error importance between SDI groups.ConclusionsReporting an ill-defined condition as the underlying cause of death can seriously affect the coding outcome, while other certification errors were mitigated through the correct application of mortality coding rules. Training of physicians in not reporting ill-defined conditions on the MCCOD and mortality coders in correct coding practices and using Iris should be important components of national strategies to improve cause of death data quality.

Project description:BackgroundMonitoring medically certified causes of death is essential to shape national health policies, track progress to Sustainable Development Goals, and gauge responses to epidemic and pandemic disease. The combination of electronic health information systems with new methods for data quality monitoring can facilitate quality assessments and help target quality improvement. Since 2015, Tanzania has been upgrading its Civil Registration and Vital Statistics system including efforts to improve the availability and quality of mortality data.MethodsWe used a computer application (ANACONDA v4.01) to assess the quality of medical certification of cause of death (MCCD) and ICD-10 coding for the underlying cause of death for 155,461 deaths from health facilities from 2014 to 2018. From 2018 to 2019, we continued quality analysis for 2690 deaths in one large administrative region 9 months before, and 9 months following MCCD quality improvement interventions. Interventions addressed governance, training, process, and practice. We assessed changes in the levels, distributions, and nature of unusable and insufficiently specified codes, and how these influenced estimates of the leading causes of death.Results9.7% of expected annual deaths in Tanzania obtained a medically certified cause of death. Of these, 52% of MCCD ICD-10 codes were usable for health policy and planning, with no significant improvement over 5 years. Of certified deaths, 25% had unusable codes, 17% had insufficiently specified codes, and 6% were undetermined causes. Comparing the before and after intervention periods in one Region, codes usable for public health policy purposes improved from 48 to 65% within 1 year and the resulting distortions in the top twenty cause-specific mortality fractions due to unusable causes reduced from 27.4 to 13.5%.ConclusionData from less than 5% of annual deaths in Tanzania are usable for informing policy. For deaths with medical certification, errors were prevalent in almost half. This constrains capacity to monitor the 15 SDG indicators that require cause-specific mortality. Sustainable quality assurance mechanisms and interventions can result in rapid improvements in the quality of medically certified causes of death. ANACONDA provides an effective means for evaluation of such changes and helps target interventions to remaining weaknesses.

Project description:BACKGROUND:Accurate and timely cause of death (COD) data are essential for informed public health policymaking. Medical certification of COD generally provides the majority of COD data in a population and is an essential component of civil registration and vital statistics (CRVS) systems. Accurate completion of the medical certificate of cause of death (MCCOD) should be a relatively straightforward procedure for physicians, but mistakes are common. Here, we present three training strategies implemented in five countries supported by the Bloomberg Philanthropies Data for Health (D4H) Initiative at the University of Melbourne (UoM) and evaluate the impact on the quality of certification. METHODS:The three training strategies evaluated were (1) training of trainers (TOT) in the Philippines, Myanmar, and Sri Lanka; (2) direct training of physicians by the UoM D4H in Papua New Guinea (PNG); and (3) the implementation of an online and basic training strategy in Peru. The evaluation involved an assessment of MCCODs before and after training using an assessment tool developed by the University of Melbourne. RESULTS:The TOT strategy led to reductions in incorrectly completed certificates of between 28% in Sri Lanka and 40% in the Philippines. Following direct training of physicians in PNG, the reduction in incorrectly completed certificates was 30%. In Peru, the reduction in incorrect certificates was 30% after implementation and training on an online system only and 43% after training on both the online system and basic medical certification principles. CONCLUSIONS:The results of this study indicate that a variety of training strategies can produce benefits in the quality of certification, but further improvements are possible. The experiences of D4H suggest several aspects of the strategies that should be further developed to improve outcomes, particularly key stakeholder engagement from early in the intervention and local committees to oversee activities and support an improved culture in hospitals to support better diagnostic skills and practices.

Project description:INTRODUCTION:Adherence-enhancing interventions have been assessed in the literature, however heterogeneity and conflicting findings have prohibited a consensus on the most effective approach to maintain adherence over time. With the ageing population and growth of chronic conditions, evaluation of sustainable strategies to improve and maintain medication adherence long term is paramount. We aimed to determine the comparative effectiveness of interventions for improving medication adherence over time among adults with any clinical condition. MATERIALS AND METHODS:Meta-analyses evaluating interventions to improve medication adherence were searched in PubMed in January 2019 and reviewed for primary studies. Experimental studies with a comparison group assessing an intervention to enhance medication adherence in adult patients with reported adherence outcomes were included. Two authors extracted data for study characteristics, interventions and adherence outcomes. Interventions were categorized into four groups or combinations: educational, attitudinal, technical and rewards. Four network meta-analyses were performed to compare interventions based on patient follow-up time. Medication adherence effect sizes were reported as odds ratios (OR) with a 95% credibility interval (CrI) and surface under the cumulative ranking curve (SUCRA) to allow ranking probabilities. Risk of bias was assessed as per Cochrane guidelines. RESULTS:Data was obtained from 69 meta-analyses with 468 primary studies being included in qualitative synthesis. The four networks compromised of 249 studies in total (0-3 month follow-up: 99 studies, 4-6 months: 104, 7-9 months: 18, ?10 months: 94). Interventions showing success in follow-ups of less than 10 months varied across time. Significant effects compared to standard of care (SOC) were found in technical (4-6 months: OR 0.34, 95% CrI 0.25-0.45) and attitudinal interventions (7-9 months: 0.37, 0.17-0.84). Multicomponent interventions demonstrated effectiveness compared to standard of care with an additive effect displayed, particularly in longer follow-ups (educational + attitudinal + technical interventions ?10 months: OR 0.49, 95% CrI 0.27-0.88). DISCUSSION:All interventions reviewed improved medication adherence compared to standard of care. Multicomponent interventions displayed the most promising results in maintenance of long-term medication adherence. Technical and reward components enhanced adherence on a short-term basis, while educational and attitudinal interventions evolved over time to be more effective in follow-ups greater than 7 months. Sustainability of adherence to medications over time is dependent upon multicomponent interventions including educational, attitudinal and technical aspects to modify and enhance patient medication-taking behavior. Future research should focus on the most cost-effective approaches able to be integrated into routine practice.

Project description:BackgroundDetailed cause of death data by age group and sex are critical to identify key public health issues and target interventions appropriately. In this study the quality of local routinely collected cause of death data from medical certification is reviewed, and a cause of death profile for Tonga based on amended data is presented.MethodsMedical certificates of death for all deaths in Tonga for 2001 to 2008 and medical records for all deaths in the main island Tongatapu for 2008 were sought from the national hospital. Cause of death data for 2008 were reviewed for quality through (a) a review of current tabulation procedures and (b) a medical record review. Data from each medical record were extracted and provided to an independent medical doctor to assign cause of death, with underlying cause from the medical record tabulated against underlying cause from the medical certificate. Significant associations in reporting patterns were evaluated and final cause of death for each case in 2008 was assigned based on the best quality information from the medical certificate or medical record. Cause of death data from 2001 to 2007 were revised based on findings from the evaluation of certification of the 2008 data and added to the dataset. Proportional mortality was calculated and applied to age- and sex-specific mortality for all causes from 2001 to 2008. Cause of death was tabulated by age group and sex, and age-standardized (all ages) mortality rates for each sex by cause were calculated.ResultsReported tabulations of cause of death in Tonga are of immediate cause, with ischemic heart disease and diabetes underrepresented. In the majority of cases the reported (immediate) cause fell within the same broad category as the underlying cause of death from the medical certificate. Underlying cause of death from the medical certificate, attributed to neoplasms, diabetes, and cardiovascular disease were assigned to other underlying causes by the medical record review in 70% to 77% of deaths. Of the 28 (6.5%) deaths attributed to nonspecific or unknown causes on the medical certificate, 17 were able to be attributed elsewhere following review of the medical record. Final cause of death tabulations for 2001 to 2008 demonstrate that noncommunicable diseases are leading adult mortality, and age-standardized rates for cardiovascular diseases, neoplasms, and diabetes increased significantly between 2001 to 2004 and 2005 to 2008. Cause of death data for 2001 to 2008 show increasing cause-specific mortality (deaths per 100,000) from 2001-2004 to 2005-2008 from cardiovascular (194-382 to 423-644 in 2005-2008 for males and 108-227 to 194-321 for females) and other noncommunicable diseases that cannot be accounted for by changes in the age structure of the population. Mortality from diabetes for 2005 to 2008 is estimated at 94 to 222 deaths per 100,000 population for males and 98 to 190 for females (based on the range of plausible all-cause mortality estimates) compared with 2008 estimates from the global burden of disease study of 40 (males) and 53 (females) deaths per 100,000 population.DiscussionCertification of death was generally found to be the most reliable data on cause of death in Tonga available for Tonga, with 93% of the final assigned causes following review of the 2008 data matching those listed on the medical certificate of death. Cause of death data available in Tonga can be improved by routinely tabulating data by underlying cause and ensuring contributory causes are not recorded in Part I of the certificate during data entry to the database. There is significantly more data on cause of death available in Tonga than are routinely reported or known to international agencies.

Project description:BackgroundAccurate, comprehensive, cause-specific mortality estimates are crucial for informing public health decision making worldwide. Incorrectly or vaguely assigned deaths, defined as garbage-coded deaths, mask the true cause distribution. The Global Burden of Disease (GBD) study has developed methods to create comparable, timely, cause-specific mortality estimates; an impactful data processing method is the reallocation of garbage-coded deaths to a plausible underlying cause of death. We identify the pattern of garbage-coded deaths in the world and present the methods used to determine their redistribution to generate more plausible cause of death assignments.MethodsWe describe the methods developed for the GBD 2019 study and subsequent iterations to redistribute garbage-coded deaths in vital registration data to plausible underlying causes. These methods include analysis of multiple cause data, negative correlation, impairment, and proportional redistribution. We classify garbage codes into classes according to the level of specificity of the reported cause of death (CoD) and capture trends in the global pattern of proportion of garbage-coded deaths, disaggregated by these classes, and the relationship between this proportion and the Socio-Demographic Index. We examine the relative importance of the top four garbage codes by age and sex and demonstrate the impact of redistribution on the annual GBD CoD rankings.ResultsThe proportion of least-specific (class 1 and 2) garbage-coded deaths ranged from 3.7% of all vital registration deaths to 67.3% in 2015, and the age-standardized proportion had an overall negative association with the Socio-Demographic Index. When broken down by age and sex, the category for unspecified lower respiratory infections was responsible for nearly 30% of garbage-coded deaths in those under 1 year of age for both sexes, representing the largest proportion of garbage codes for that age group. We show how the cause distribution by number of deaths changes before and after redistribution for four countries: Brazil, the United States, Japan, and France, highlighting the necessity of accounting for garbage-coded deaths in the GBD.ConclusionsWe provide a detailed description of redistribution methods developed for CoD data in the GBD; these methods represent an overall improvement in empiricism compared to past reliance on a priori knowledge.

Dataset Information

Effectiveness of training interventions to improve quality of medical certification of cause of death: systematic review and meta-analysis.

Background

Methods

Results

Conclusions

Publications

Effectiveness of training interventions to improve quality of medical certification of cause of death: systematic review and meta-analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets