Methodological Quality of Economic Evaluations in Integrated Care: Evidence from a Systematic Review.
Ontology highlight
ABSTRACT: Introduction
The aim of this review is to systematically assess the methodological quality of economic evaluations in integrated care and to identify challenges with conducting such studies.Theory and methods
Searches of grey-literature and scientific papers were performed, from January 2000 to December 2018. A checklist was developed to assess the quality of economic evaluations. Authors' statements of challenges encountered during their evaluations were qualitatively coded.Results
Forty-four articles were eligible for inclusion. The review found that study design, measurement of cost and outcomes, statistical analysis and presentation of data were the areas with most quality variation. Authors identified challenges mostly related to time horizon of the evaluation, inadequate or lack of comparator group, contamination bias, and a post-hoc evaluation culture.Discussion
Our review found significant differences in quality, with some studies showing poor methodological rigor; challenging conclusions on the cost-effectiveness of integrated care.Conclusion
It is essential for evaluators to use best-practice standards when planning and conducting economic evaluations, in order to build a reliable evidence base for decision-making in integrated care.
SUBMITTER: Kadu M
PROVIDER: S-EPMC6743034 | biostudies-literature | 2019 Sep
REPOSITORIES: biostudies-literature
Publications
Methodological Quality of Economic Evaluations in Integrated Care: Evidence from a Systematic Review.
Kadu Mudathira M Ehrenberg Nieves N Stein Viktoria V Tsiachristas Apostolos A
International journal of integrated care 20190909 3
<h4>Introduction</h4>The aim of this review is to systematically assess the methodological quality of economic evaluations in integrated care and to identify challenges with conducting such studies.<h4>Theory and methods</h4>Searches of grey-literature and scientific papers were performed, from January 2000 to December 2018. A checklist was developed to assess the quality of economic evaluations. Authors' statements of challenges encountered during their evaluations were qualitatively coded.<h4> ...[more]
Similar Datasets
Project description:INTRODUCTION:In light of this growing palliative care and end of life care patient population, as well as new (expensive) drugs and treatments, quality research providing evidence for decision-making is required. However, common research guidance is lacking in this field, especially in respect to the methods applied in economic evaluations. Therefore, the aim of the planned systematic review is to identify and summarise relevant information on methodological challenges, potential solutions and recommendations for conducting economic evaluations of interventions in adult patients, irrespective of their underlying disease and gender in the palliative or end of life care settings, with no restrictions in regards to countries/geographical regions. The results of this systematic review may help to clarify the current methodological questions and form the basis of new, setting specific methods guidelines and support ongoing applied economic evaluations in the field. METHODS AND ANALYSIS:A systematic review will be conducted using Medline, Embase, Health Technology Assessment Database and NHS Economic Evaluation Database to identify the studies published from 1999 onwards with relevant information on methodological challenges, potential solutions and recommendations for conducting economic evaluations in the palliative or end of life care settings. Articles in English, German, Spanish, French or Dutch language will be considered. Two independent reviewers will conduct the screening of articles; any discrepancies will be resolved by discussion and involvement of a third reviewer. Predesigned data extraction forms will be applied, consequently narratively synthesised and categorised. Studies' methodological quality will be critically appraised. Besides existing economic guidelines and checklists for specific information on the palliative and end of life care sector will be searched. ETHICS AND DISSEMINATION:Ethical approval is not required, as this is a planned systematic review of published literature. An article will be disseminated in a related peer-reviewed journal, as well as presented at leading palliative care and health economic conferences. PROSPERO REGISTRATION NUMBER:CRD42020148160.
| S-EPMC7259853 | biostudies-literature
Project description:ObjectiveFor assessing cost-effectiveness, Health Technology Assessment (HTA) organisations may use primary economic evaluations (P-HEs) or Systematic Reviews of Health Economic evaluations (SR-HEs). A prerequisite for meaningful results of SR-HEs is that the results from existing P-HEs are transferable to the decision context (e.g, HTA jurisdiction). A particularly pertinent issue is the high variability of costs and resource needs across jurisdictions. Our objective was to review the methods documents of HTA organisations and compare their recommendations on considering transferability in SR-HE.MethodsWe systematically hand searched the webpages of 158 HTA organisations for relevant methods documents from 8th January to 31st March 2019. Two independent reviewers performed searches and selected documents according to pre-defined criteria. One reviewer extracted data in standardised and piloted tables and a second reviewer checked them for accuracy. We synthesised data using tabulations and in a narrative way.ResultsWe identified 155 potentially relevant documents from 63 HTA organisations. Of these, 7 were included in the synthesis. The included organisations have different aims when preparing a SR-HE (e.g. to determine the need for conducting their own P-HE). The recommendations vary regarding the underlying terminology (e.g. transferability/generalisability), the assessment approaches (e.g. structure), the assessment criteria and the integration in the review process.ConclusionOnly few HTA organisations address the assessment of transferability in their methodological recommendations for SR-HEs. Transferability considerations are related to different purposes. The assessment concepts and criteria are heterogeneous. Developing standards to consider transferability in SR-HEs is desirable.
| S-EPMC8858549 | biostudies-literature
Project description:Public health interventions have unique characteristics compared to health technologies, which present additional challenges for economic evaluation (EE). High quality EEs that are able to address the particular methodological challenges are important for public health decision-makers. In England, they are even more pertinent given the transition of public health responsibilities in 2013 from the National Health Service to local government authorities where new agents are shaping policy decisions. Addressing alcohol misuse is a globally prioritised public health issue. This article provides a systematic review of EE and priority-setting studies for interventions to prevent and reduce alcohol misuse published internationally over the past decade (2006-2016). This review appraises the EE and priority-setting evidence to establish whether it is sufficient to meet the informational needs of public health decision-makers. 619 studies were identified via database searches. 7 additional studies were identified via hand searching journals, grey literature and reference lists. 27 met inclusion criteria. Methods identified included cost-utility analysis (18), cost-effectiveness analysis (6), cost-benefit analysis (CBA) (1), cost-consequence analysis (CCA) (1) and return-on-investment (1). The review identified a lack of consideration of methodological challenges associated with evaluating public health interventions and limited use of methods such as CBA and CCA which have been recommended as potentially useful for EE in public health. No studies using other specific priority-setting tools were identified.
| S-EPMC5710990 | biostudies-literature
Project description:A comprehensive systematic review of economic evaluations of complementary and integrative medicine (CIM) to establish the value of these therapies to health reform efforts.PubMed, CINAHL, AMED, PsychInfo, Web of Science and EMBASE were searched from inception through 2010. In addition, bibliographies of found articles and reviews were searched, and key researchers were contacted.Studies of CIM were identified using criteria based on those of the Cochrane complementary and alternative medicine group. All studies of CIM reporting economic outcomes were included. STUDY APPRAISAL METHODS: All recent (and likely most cost-relevant) full economic evaluations published 2001-2010 were subjected to several measures of quality. Detailed results of higher-quality studies are reported.A total of 338 economic evaluations of CIM were identified, of which 204, covering a wide variety of CIM for different populations, were published 2001-2010. A total of 114 of these were full economic evaluations. And 90% of these articles covered studies of single CIM therapies and only one compared usual care to usual care plus access to multiple licensed CIM practitioners. Of the recent full evaluations, 31 (27%) met five study-quality criteria, and 22 of these also met the minimum criterion for study transferability ('generalisability'). Of the 56 comparisons made in the higher-quality studies, 16 (29%) show a health improvement with cost savings for the CIM therapy versus usual care. Study quality of the cost-utility analyses (CUAs) of CIM was generally comparable to that seen in CUAs across all medicine according to several measures, and the quality of the cost-saving studies was slightly, but not significantly, lower than those showing cost increases (85% vs 88%, p=0.460).This comprehensive review identified many CIM economic evaluations missed by previous reviews and emerging evidence of cost-effectiveness and possible cost savings in at least a few clinical populations. Recommendations are made for future studies.
| S-EPMC3437424 | biostudies-other
Project description:BackgroundMobile health (mHealth) is often reputed to be cost-effective or cost-saving. Despite optimism, the strength of the evidence supporting this assertion has been limited. In this systematic review the body of evidence related to economic evaluations of mHealth interventions is assessed and summarized.MethodsSeven electronic bibliographic databases, grey literature, and relevant references were searched. Eligibility criteria included original articles, comparison of costs and consequences of interventions (one categorized as a primary mHealth intervention or mHealth intervention as a component of other interventions), health and economic outcomes and published in English. Full economic evaluations were appraised using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist and The PRISMA guidelines were followed.ResultsSearches identified 5902 results, of which 318 were examined at full text, and 39 were included in this review. The 39 studies spanned 19 countries, most of which were conducted in upper and upper-middle income countries (34, 87.2%). Primary mHealth interventions (35, 89.7%), behavior change communication type interventions (e.g., improve attendance rates, medication adherence) (27, 69.2%), and short messaging system (SMS) as the mHealth function (e.g., used to send reminders, information, provide support, conduct surveys or collect data) (22, 56.4%) were most frequent; the most frequent disease or condition focuses were outpatient clinic attendance, cardiovascular disease, and diabetes. The average percent of CHEERS checklist items reported was 79.6% (range 47.62-100, STD 14.18) and the top quartile reported 91.3-100%. In 29 studies (74.3%), researchers reported that the mHealth intervention was cost-effective, economically beneficial, or cost saving at base case.ConclusionsFindings highlight a growing body of economic evidence for mHealth interventions. Although all studies included a comparison of intervention effectiveness of a health-related outcome and reported economic data, many did not report all recommended economic outcome items and were lacking in comprehensive analysis. The identified economic evaluations varied by disease or condition focus, economic outcome measurements, perspectives, and were distributed unevenly geographically, limiting formal meta-analysis. Further research is needed in low and low-middle income countries and to understand the impact of different mHealth types. Following established economic reporting guidelines will improve this body of research.
| S-EPMC5289471 | biostudies-literature
Project description:AimsThe aim of this systematic review of economic evaluations alongside randomised controlled trials (RCTs) was to provide a comprehensive overview of the evidence concerning cost-effectiveness analyses of common treatment options for major depression.MethodsAn existing database was used to identify studies reporting cost-effectiveness results from RCTs. This database has been developed by a systematic literature search in the bibliographic databases of PubMed, PsychINFO, Embase and Cochrane library from database inception to December 2014. We evaluated the quality of economic evaluations using a 10-item short version of the Drummond checklist. Results were synthesised narratively. The risk of bias of the included RCTs was assessed, based on the Cochrane risk of bias assessment tool.ResultsFourteen RCTs were included from the 5580 articles screened on titles and abstracts. The methodological quality of the health economic evaluations was relatively high and the majority of the included RCTs had low risk of bias in most of Cochrane items except blinding of participants and personnel. Cognitive behavioural therapy was examined in seven trials as part of a variety of treatment protocols and seems cost-effective compared with pharmacotherapy in the long-term. However cost-effectiveness results for the combination of psychotherapy with pharmacotherapy are conflicting and should be interpreted with caution due to limited comparability between the examined trials. For several treatments, only a single economic evaluation was reported as part of a clinical trial. This was the case for comparisons between different classes of antidepressants, for several types of psychotherapy (behavioural activation, occupational therapy, interpersonal psychotherapy, short-term psychotherapy, psychodynamic psychotherapy, rational emotive behavioural therapy, solution focused therapy), and for transcranial magnetic stimulation v. electroconvulsive therapy. The limited evidence base for these interventions means generalisations, based on economic evaluation alongside clinical trials, cannot easily be made.ConclusionsThere is some economic evidence underpinning many of the common treatment options for major depression. Wide variability was observed in study outcomes, probably attributable to differences in population, interventions or follow-up periods. For many interventions, only a single economic evaluation alongside clinical trials was identified. Thus, significant economic evidence gaps remain in the area of major depressive disorder.
| S-EPMC6998890 | biostudies-literature
Project description:BackgroundSchistosomiasis is a neglected tropical disease (NTD) that affects over 230 million people in low and middle-income countries (LMICs) and can lead to long-term debilitating health effects. It is associated with impoverishment and has been prioritised by the World Health Organization for prevention, control and elimination. This systematic review aimed to identify and evaluate existing economic evaluations of interventions to tackle schistosomiasis.MethodologyA comprehensive search strategy of four databases and additional hand-searching was employed on the 17th July 2020. The articles were screened and sorted using a two-stage classification system. Full economic evaluations published in English between 1st January 1998 and 17th July 2020 were included, and methodological quality was appraised using the international decision support initiative (iDSI), Phillips and Evers checklists.ResultsEighteen economic evaluations were identified, nine trial-based and nine model-based, with the majority focused on preventative chemotherapy. Schistosomiasis interventions were collectively found to be cost-effective, but the quantity and quality of studies were limited. The outcome measures and time-horizons utilised varied substantially making comparison difficult. The majority of papers failed to address equity and affordability.ConclusionSeveral methodological issues were highlighted which might have implications for optimal decision-making. Future research is needed to ensure the standardisation of methods, in order to ensure that scarce healthcare resources are focused on the most cost-effective programmes to tackle schistosomiasis and other NTDs.
| S-EPMC9591071 | biostudies-literature
Project description:BACKGROUND:In increasingly constrained healthcare budgets worldwide, efforts to improve quality and reduce costs are vital. Quality Improvement Collaboratives (QICs) are often used in healthcare settings to implement proven clinical interventions within local and national programs. The cost of this method of implementation, however, is cited as a barrier to use. This systematic review aims to identify and describe studies reporting on costs and cost-effectiveness of QICs when used to implement clinical guidelines in healthcare. METHODS:Multiple databases (CINAHL, MEDLINE, PsycINFO, EMBASE, EconLit and ProQuest) were searched for economic evaluations or cost studies of QICs in healthcare. Studies were included if they reported on economic evaluations or costs of QICs. Two authors independently reviewed citations and full text papers. Key characteristics of eligible studies were extracted, and their quality assessed against the Consolidated Health Economic Evaluation Reporting Standards (CHEERS). Evers CHEC-List was used for full economic evaluations. Cost-effectiveness findings were interpreted through the Johanna Briggs Institute 'three by three dominance matrix tool' to guide conclusions. Currencies were converted to United States dollars for 2018 using OECD and World Bank databases. RESULTS:Few studies reported on costs or economic evaluations of QICs despite their use in healthcare. Eight studies across multiple healthcare settings in acute and long-term care, community addiction treatment and chronic disease management were included. Five were considered good quality and favoured the establishment of QICs as cost-effective implementation methods. The cost savings to the healthcare setting identified in these studies outweighed the cost of the collaborative itself. CONCLUSIONS:Potential cost savings to the health care system in both acute and chronic conditions may be possible by applying QICs at scale. However, variations in effectiveness, costs and elements of the method within studies, indicated that caution is needed. Consistent identification of costs and description of the elements applied in QICs would better inform decisions for their use and may reduce perceived barriers. Lack of studies with negative findings may have been due to publication bias. Future research should include economic evaluations with societal perspectives of costs and savings and the cost-effectiveness of elements of QICs. TRIAL REGISTRATION:PROSPERO registration number: CRD42018107417.
| S-EPMC7053095 | biostudies-literature
Project description:BackgroundThe coverage of postpartum care is not ideal, and has not been used very well due to not enough attention being paid to the puerperal women and newborns, especially in developing countries. Practice guidelines on postpartum care provide beneficial practice guidance and help to reduce maternal mortality. However, little is known about the credibility and consistency of those guidelines. This systematic review was conducted to summarize main postpartum care indications and appraise methodological quality of guidelines.MethodsSeven literature databases and guideline development institutions and organizations of obstetrics and maternity care were searched. Two reviewers independently assessed guideline quality using the AGREE II instrument, and synthesized consistent and non-consistent recommendations using the content analysis approach.ResultsTwenty-nine guidelines were included and a total of eight postpartum care indications were identified. Most guidelines focused on care indications and interventions including exclusive breastfeeding, maternal nutrition, home visit, infant or newborn care and sexuality, contraception, and birth spacing. However, indications such as pain or weight management, pelvic floor muscle training, abdominal rehabilitation, and mental health got less attention. Additionally, the overall quality of all involving postpartum care guidelines is relatively good and acceptable.ConclusionsGuidelines developed by NICE, RANO, and WHO indicated higher methodological quality. For postpartum care indications, most guidelines are incomplete. Variation in practice guidelines for postpartum care recommendations exists. In the future, implementation research into shared decision-making, as well as further high-quality research to broaden the evidence base for postpartum care indications is recommended.Supplementary informationThe online version contains supplementary material available at 10.1007/s10389-021-01629-4.
| S-EPMC8288832 | biostudies-literature
Project description:There has been an increased interest in health technology assessment and economic evaluations for health policy in Ethiopia over the last few years. In this systematic review, we examined the scope and quality of healthcare economic evaluation studies in Ethiopia. We searched seven electronic databases (PubMed/MEDLINE, EMBASE, PsycINFO, CINHAL, Econlit, York CRD databases and CEA Tufts) from inception to May 2021 to identify published full health economic evaluations of a health-related intervention or programme in Ethiopia. This was supplemented with forward and backward citation searches of included articles, manual search of key government websites, the Disease Control Priorities-Ethiopia project and WHO-CHOICE programme. The quality of reporting of economic evaluations was assessed using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist. The extracted data were grouped into subcategories based on the subject of the economic evaluation, organized into tables and reported narratively. This review identified 34 full economic evaluations conducted between 2009 and 2021. Around 14 (41%) of studies focussed on health service delivery, 8 (24%) on pharmaceuticals, vaccines and devices, and 4 (12%) on public-health programmes. The interventions were mostly preventive in nature and focussed on communicable diseases (n = 19; 56%) and maternal and child health (n = 6; 18%). Cost-effectiveness ratios varied widely from cost-saving to more than US $37 313 per life saved depending on the setting, perspectives, types of interventions and disease conditions. While the overall quality of included studies was judged as moderate (meeting 69% of CHEERS checklist), only four out of 27 cost-effectiveness studies characterized heterogeneity. There is a need for building local technical capacity to enhance the design, conduct and reporting of health economic evaluations in Ethiopia.
| S-EPMC9128743 | biostudies-literature