Dataset Information

Methodological issues in economic evaluations of disease prevention and health promotion: an overview of systematic and scoping reviews

ABSTRACT:

Background

We aimed to provide a comprehensive overview of methodological challenges in economic evaluations of disease prevention and health promotion (DPHP)-measures.

Methods

We conducted an overview of reviews searching MEDLINE, EMBASE, NHS Economic Evaluation Database, Database of Promoting Health Effectiveness Reviews, Cochrane Database of Systematic Reviews (CDSR) and Database of Promoting Health Effectiveness Reviews (DOPHER) (from their inception to October 2021). We included both systematic and scoping reviews of economic evaluations in DPHP addressing following methodological aspects: (i) attribution of effects, (ii) outcomes, (iii) inter-sectoral (accruing to non-health sectors of society) costs and consequences and (iv) equity. Data were extracted according to the associated sub-criteria of the four methodological aspects including study design economic evaluation (e.g. model-based), type/scope of the outcomes (e.g. outcomes beyond health), perspective, cost categories related to non-health sectors of society, and consideration of equity (method of inclusion). Two reviewers independently screened all citations, full-text articles, and extracted data. A narrative synthesis without a meta-analysis or other statistical synthesis methods was conducted.

Results

The reviewing process resulted in ten systematic and one scoping review summarizing 494 health economic evaluations. A lifelong time horizon was adopted in about 23% of DPHP evaluations, while 64% of trial-based evaluations had a time horizon up to 2 years. Preference-based outcomes (36%) and non-health outcomes (8%) were only applied in a minority of studies. Although the inclusion of inter-sectoral costs (i.e. costs accruing to non-health sectors of society) has increased in recent years, these were often neglected (between 6 and 23% depending on the cost category). Consideration to equity was barely given in economic evaluations, and only addressed in six of the eleven reviews.

Conclusions

Economic evaluations of DPHP measures give only little attention to the specific methodological challenges related to this area. For future economic DPHP evaluations a tool with structured guidance should be developed. This overview of reviews was not registered and a published protocol does not exist.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-12174-w.

SUBMITTER: Seleznova Y

PROVIDER: S-EPMC8605499 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundPharmacy interventions are a subset of public health interventions and its research is usually performed within the scope of a trial. The economic evaluation of pharmacy interventions requires certain considerations which have some similarities to those of public health interventions and to economic evaluations alongside trials. The objective of this research is to perform an overview of systematic reviews of economic evaluations of pharmacy services and triangulate results with recommendations for economic evaluations of both public health interventions and alongside trials.Methods(1) Exploratory review of recommendations on the economic evaluation of public health interventions, (2) exploratory review of recommendations for conducting economic evaluations alongside trials, (3) overview of systematic reviews of economic evaluations of pharmacy interventions (protocol registered with PROSPERO 2016 outlining information sources, inclusion criteria, appraisal of reviews and synthesis methods).ResultsFourteen systematic reviews containing 75 index publications were included. Reviews reported favorable economic findings for 71% of studies with full economic evaluations. The types of economic analysis are diverse. Two critical quality domains are absent from most reviews. Key findings include the following: certain types of risk of bias, wider scope of study designs, and most economic quality criteria met but some issues unresolved or unclear. Triangulation revealed additional gaps. Limitations include choice of critical quality domains and potential biases in the overview process.ConclusionsEconomic evaluations of pharmacy-based public health interventions seem to follow most economic quality criteria, but there are still some issues in certain key areas to improve. These findings may assist in improving the design of pilot trials of economic evaluations in pharmacy, leading to robust evidence for payers. Based on the findings, we propose a methodological approach for the economic evaluation of pharmacy-based public health interventions.Systematic review registrationPROSPERO CRD42016032768.

Project description:BackgroundThe prevention of mental disorders and promotion of mental health and well-being are growing fields. Whether mental health promotion and prevention interventions provide value for money in children, adolescents, adults, and older adults is unclear. The aim of the current study is to update 2 existing reviews of cost-effectiveness studies in this field in order to determine whether such interventions are cost-effective.Methods and findingsElectronic databases (including MEDLINE, PsycINFO, CINAHL, and EconLit through EBSCO and Embase) were searched for published cost-effectiveness studies of prevention of mental disorders and promotion of mental health and well-being from 2008 to 2020. The quality of studies was assessed using the Quality of Health Economic Studies Instrument (QHES). The protocol was registered with PROSPERO (# CRD42019127778). The primary outcomes were incremental cost-effectiveness ratio (ICER) or return on investment (ROI) ratio across all studies. A total of 65 studies met the inclusion criteria of a full economic evaluation, of which, 23 targeted children and adolescents, 35 targeted adults, while the remaining targeted older adults. A large number of studies focused on prevention of depression and/or anxiety disorders, followed by promotion of mental health and well-being and other mental disorders. Although there was high heterogeneity in terms of the design among included economic evaluations, most studies consistently found that interventions for mental health prevention and promotion were cost-effective or cost saving. The review found that targeted prevention was likely to be cost-effective compared to universal prevention. Screening plus psychological interventions (e.g., cognitive behavioural therapy [CBT]) at school were the most cost-effective interventions for prevention of mental disorders in children and adolescents, while parenting interventions and workplace interventions had good evidence in mental health promotion. There is inconclusive evidence for preventive interventions for mental disorders or mental health promotion in older adults. While studies were of general high quality, there was limited evidence available from low- and middle-income countries. The review was limited to studies where mental health was the primary outcome and may have missed general health promoting strategies that could also prevent mental disorder or promote mental health. Some ROI studies might not be included given that these studies are commonly published in grey literature rather than in the academic literature.ConclusionsOur review found a significant growth of economic evaluations in prevention of mental disorders or promotion of mental health and well-being over the last 10 years. Although several interventions for mental health prevention and promotion provide good value for money, the varied quality as well as methodologies used in economic evaluations limit the generalisability of conclusions about cost-effectiveness. However, the finding that the majority of studies especially in children, adolescents, and adults demonstrated good value for money is promising. Research on cost-effectiveness in low-middle income settings is required.Trial registrationPROSPERO registration number: CRD42019127778.

Project description:Background: Patients over 65 years of age taking multiple medications face several risks, and pharmaceutical interventions can be useful to improve quality of care and reduce those risks. However, there is still no consensus on the effectiveness of these interventions aimed at promoting changes in clinical, epidemiological, economic, and humanistic outcomes for various service delivery, organizational, financial, and implementation-based interventions. The objective of this overview of systematic reviews was to summarize evidence on the effectiveness of community-level pharmaceutical interventions to reduce the risks associated with polypharmacy in the population over 65 years of age. Method: This overview used a previously described protocol to search for systematic review articles, with and without meta-analysis, and economic evaluations, without any language or time restrictions, including articles published up to May 2018. The following databases were searched: the Cochrane Library, Epistemonikos, Health Evidence, Health Systems Evidence, Virtual Health Library, and Google Scholar. The basic search terms used were "elderly," "polypharmacy," and "pharmaceutical interventions." The findings for outcomes of interest were categorized using a taxonomy for health policies and systems. Equity-related questions were also investigated. The studies were evaluated for methodological quality and produced a narrative synthesis. Results: A total of 642 records were retrieved: 50 from Health Evidence, 197 from Epistemonikos, 194 from Cochrane, 116 from Health Systems Evidence, and 85 from the Virtual Health Library. Of these, 16 articles were selected: 1 overview of systematic reviews, 12 systematic reviews, and 3 economic evaluations. There is evidence of improvement in clinical, epidemiological, humanistic, and economic outcomes for various types of community-level pharmaceutical interventions, but differences in observed outcomes may be due to study designs, primary study sample sizes, risk of bias, difficulty in aggregating data, heterogeneity of indicators and quality of evidence included in the systematic reviews that were assessed. It is necessary to optimize the methodological designs of future primary and secondary studies. Conclusion: Community-level pharmaceutical interventions can improve various clinical, epidemiological, humanistic and economic outcomes and potentially reduce risks associated with polypharmacy in the elderly population.

Project description:BackgroundPrognostic factors are associated with the risk of future health outcomes in individuals with a particular health condition. The prognostic ability of such factors is increasingly being assessed in both primary research and systematic reviews. Systematic review methodology in this area is continuing to evolve, reflected in variable approaches to key methodological aspects. The aim of this article was to (i) explore and compare the methodology of systematic reviews of prognostic factors undertaken for the same clinical question, (ii) to discuss implications for review findings, and (iii) to present recommendations on what might be considered to be 'good practice' approaches.MethodsThe sample was comprised of eight systematic reviews addressing the same clinical question, namely whether 'aspirin resistance' (a potential prognostic factor) has prognostic utility relative to future vascular events in patients on aspirin therapy for secondary prevention. A detailed comparison of methods around study identification, study selection, quality assessment, approaches to analysis, and reporting of findings was undertaken and the implications discussed. These were summarised into key considerations that may be transferable to future systematic reviews of prognostic factors.ResultsAcross systematic reviews addressing the same clinical question, there were considerable differences in the numbers of studies identified and overlap between included studies, which could only partially be explained by different study eligibility criteria. Incomplete reporting and differences in terminology within primary studies hampered study identification and selection process across reviews. Quality assessment was highly variable and only one systematic review considered a checklist for studies of prognostic questions. There was inconsistency between reviews in approaches towards analysis, synthesis, addressing heterogeneity and reporting of results.ConclusionsDifferent methodological approaches may ultimately affect the findings and interpretation of systematic reviews of prognostic research, with implications for clinical decision-making.

Project description:Decision makers increasingly require cost-effectiveness evidence to inform resource allocation and the need for systematic reviews of economic evaluations (SREEs) has grown accordingly. The objective of this article is to describe current practice and identify unique challenges in conducting and reporting SREEs. Current guideline documents for SREEs were consulted and summarised. A rapid review of English-language SREEs, using MEDLINE and EMBASE, published in 2017/2018, containing at least 20 studies was undertaken to describe current practice. Information on data extraction methods, quality assessment (QA) tools and reporting methods were narratively summarised. Lessons learned from a recently conducted SREE of weight loss interventions for severely obese adults were discussed. Sixty-three publications were included in the rapid review. Substantial heterogeneity in review methods, reporting standards and QA approaches was evident. Our recently conducted SREE on weight loss interventions identified scope to improve process efficiency, opportunity for more transparent and succinct reporting, and potential to improve consistency of QA. Practical solutions may include (1) using pre-piloted data extraction forms linked explicitly to results tables; (2) consistently reporting on key assumptions and sensitivity analyses that drive results; and (3) using checklists that include topic-specific items where relevant and allow reviewers to distinguish between reporting, justification and QA. The lack of a mutually agreed, standardised set of best practice guidelines has led to substantial heterogeneity in the conduct and reporting of SREEs. Future work is required to standardise the approach to conducting SREEs so that they can generate efficient, timely and relevant evidence to support decision-making. We suggest only data extracting information that will be reported, focusing discussion around the key drivers of cost-effectiveness, and improving consistency in QA by distinguishing between what is reported, justified by authors and deemed appropriate by the reviewer.