Dataset Information

Factors Determining the Success and Failure of eHealth Interventions: Systematic Review of the Literature.

ABSTRACT: BACKGROUND:eHealth has an enormous potential to improve healthcare cost, effectiveness, and quality of care. However, there seems to be a gap between the foreseen benefits of research and clinical reality. OBJECTIVE:Our objective was to systematically review the factors influencing the outcome of eHealth interventions in terms of success and failure. METHODS:We searched the PubMed database for original peer-reviewed studies on implemented eHealth tools that reported on the factors for the success or failure, or both, of the intervention. We conducted the systematic review by following the patient, intervention, comparison, and outcome framework, with 2 of the authors independently reviewing the abstract and full text of the articles. We collected data using standardized forms that reflected the categorization model used in the qualitative analysis of the outcomes reported in the included articles. RESULTS:Among the 903 identified articles, a total of 221 studies complied with the inclusion criteria. The studies were heterogeneous by country, type of eHealth intervention, method of implementation, and reporting perspectives. The article frequency analysis did not show a significant discrepancy between the number of reports on failure (392/844, 46.5%) and on success (452/844, 53.6%). The qualitative analysis identified 27 categories that represented the factors for success or failure of eHealth interventions. A quantitative analysis of the results revealed the category quality of healthcare (n=55) as the most mentioned as contributing to the success of eHealth interventions, and the category costs (n=42) as the most mentioned as contributing to failure. For the category with the highest unique article frequency, workflow (n=51), we conducted a full-text review. The analysis of the 23 articles that met the inclusion criteria identified 6 barriers related to workflow: workload (n=12), role definition (n=7), undermining of face-to-face communication (n=6), workflow disruption (n=6), alignment with clinical processes (n=2), and staff turnover (n=1). CONCLUSIONS:The reviewed literature suggested that, to increase the likelihood of success of eHealth interventions, future research must ensure a positive impact in the quality of care, with particular attention given to improved diagnosis, clinical management, and patient-centered care. There is a critical need to perform in-depth studies of the workflow(s) that the intervention will support and to perceive the clinical processes involved.

SUBMITTER: Granja C

PROVIDER: S-EPMC5954232 | biostudies-literature | 2018 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Factors Determining the Success and Failure of eHealth Interventions: Systematic Review of the Literature.

Granja Conceição C Janssen Wouter W Johansen Monika Alise MA

Journal of medical Internet research 20180501 5

<h4>Background</h4>eHealth has an enormous potential to improve healthcare cost, effectiveness, and quality of care. However, there seems to be a gap between the foreseen benefits of research and clinical reality.<h4>Objective</h4>Our objective was to systematically review the factors influencing the outcome of eHealth interventions in terms of success and failure.<h4>Methods</h4>We searched the PubMed database for original peer-reviewed studies on implemented eHealth tools that reported on the ...[more]

PMID: 29716883

Similar Datasets

Project description:BackgroundUntil now, the use of technology in health care was driven mostly by the assumptions about the benefits of electronic health (eHealth) rather than its evidence. It is noticeable that the magnitude of evidence of effectiveness and efficiency of eHealth is not proportionate to the number of interventions that are regularly conducted. Reliable evidence generated through comprehensive evaluation of eHealth interventions may accelerate the growth of eHealth for long-term successful implementation and help to experience eHealth benefits in an enhanced way.ObjectiveThis study aimed to understand how the evidence of effectiveness and efficiency of eHealth can be generated through evaluation. Hence, we aim to discern (1) how evaluation is conducted in distinct eHealth intervention phases, (2) the aspects of effectiveness and efficiency that are typically evaluated during eHealth interventions, and (3) how eHealth interventions are evaluated in practice.MethodsA systematic literature review was conducted to explore the evaluation methods for eHealth interventions. Preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines were followed. We searched Google Scholar and Scopus for the published papers that addressed the evaluation of eHealth or described an eHealth intervention study. A qualitative analysis of the selected papers was conducted in several steps.ResultsWe intended to see how the process of evaluation unfolds in distinct phases of an eHealth intervention. We revealed that in practice and in several conceptual papers, evaluation is performed at the end of the intervention. There are some studies that discuss the importance of conducting evaluation throughout the intervention; however, in practice, we found no case study that followed this. For our second research question, we discovered aspects of efficiency and effectiveness that are proposed to be assessed during interventions. The aspects that were recurrent in the conceptual papers include clinical, human and social, organizational, technological, cost, ethical and legal, and transferability. However, the case studies reviewed only evaluate the clinical and human and social aspects. At the end of the paper, we discussed a novel approach to look into the evaluation. Our intention was to stir up a discussion around this approach with the hope that it might be able to gather evidence in a comprehensive and credible way.ConclusionsThe importance of evidence in eHealth has not been discussed as rigorously as have the diverse evaluation approaches and evaluation frameworks. Further research directed toward evidence-based evaluation can not only improve the quality of intervention studies but also facilitate successful long-term implementation of eHealth in general. We conclude that the development of more robust and comprehensive evaluation of eHealth studies or an improved validation of evaluation methods could ease the transferability of results among similar studies. Thus, the resources can be used for supplementary research in eHealth.

Project description:BACKGROUND:Dyadic psychosocial interventions have been found beneficial both for people coping with mental or physical health conditions as well as their family members and friends who provide them with support. Delivering these interventions via electronic health (eHealth) may help increase their scalability. OBJECTIVE:This scoping review aimed to provide the first comprehensive overview of dyadic eHealth interventions for individuals of all ages affected by mental or physical illness and their family members or friends who support them. The goal was to understand how dyadic eHealth interventions have been used and to highlight areas of research needed to advance dyadic eHealth intervention development and dissemination. METHODS:A comprehensive electronic literature search of PubMed, EMBASE, Cochrane, Cumulative Index to Nursing and Allied Health Literature, and PsycINFO was conducted for articles published in the English language through March 2019. Eligible records described a psychosocial eHealth intervention that intervened with both care recipients and their support person. RESULTS:A total of 7113 records were reviewed of which 101 met eligibility criteria. There were 52 unique dyadic eHealth interventions identified, which were tested across 73 different trials. Of the unique interventions, 33 were conducted among dyads of children and their supporting parent, 1 was conducted with an adolescent-young adult care recipient population, and the remaining 18 were conducted among adult dyads. Interventions targeting pediatric dyads most commonly addressed a mental health condition (n=10); interventions targeting adult dyads most commonly addressed cancer (n=9). More than three-fourths of interventions (n=40) required some human support from research staff or clinicians. Most studies (n=64) specified one or more primary outcomes for care recipients, whereas less than one-fourth (n=22) specified primary outcomes for support persons. Where specified, primary outcomes were most commonly self-reported psychosocial or health factors for both care recipients (n=43) and support persons (n=18). Results of the dyadic eHealth intervention tended to be positive for care recipients, but evidence of effects for support persons was limited because of few studies specifying primary outcomes for supporters. Trials of dyadic eHealth interventions were most commonly randomized controlled trials (RCTs; n=44), and RCTs most commonly compared the dyadic eHealth intervention to usual care alone (n=22). CONCLUSIONS:This first comprehensive review of dyadic eHealth interventions demonstrates that there is substantial, diverse, and growing literature supporting this interventional approach. However, several significant gaps were identified. Few studies were designed to evaluate the unique effects of dyadic interventions relative to individual interventions. There was also limited assessment and reporting of outcomes for support persons, and there were no interventions meeting our eligibility criteria specifically targeting the needs of older adult dyads. Findings highlight areas of research opportunities for developing dyadic eHealth interventions for novel populations and for increasing access to dyadic care.

Project description:BackgroundThe number of people with noncommunicable diseases is increasing. Noncommunicable diseases are the major cause of disability and premature mortality worldwide, associated with negative workplace outcomes such as sickness absence and reduced work productivity. There is a need to identify scalable interventions and their active components to relieve disease and treatment burden and facilitate work participation. eHealth interventions have shown potential in clinical and general populations to increase well-being and physical activity and could be well suited for workplace settings.ObjectiveWe aimed to provide an overview of the effectiveness of eHealth interventions at the workplace targeting employee health behaviors and map behavior change techniques (BCTs) used in these interventions.MethodsA systematic literature search was performed in PubMed, Embase, PsycINFO, Cochrane CENTRAL, and CINAHL in September 2020 and updated in September 2021. Extracted data included participant characteristics, setting, eHealth intervention type, mode of delivery, reported outcomes, effect sizes, and attrition rates. Quality and risk of bias of the included studies were assessed using the Cochrane Collaboration risk-of-bias 2 tool. BCTs were mapped in accordance with the BCT Taxonomy v1. The review was reported according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.ResultsIn total, 17 randomized controlled trials met the inclusion criteria. The measured outcomes, treatment and follow-up periods, content of eHealth interventions, and workplace contexts had high heterogeneity. Of the 17 studies, 4 (24%) reported unequivocally significant findings for all primary outcomes, with effect sizes ranging from small to large. Furthermore, 53% (9/17) of the studies reported mixed results, and 24% (4/17) reported nonsignificant results. The most frequently targeted behavior was physical activity (15/17, 88% of the studies); the least frequently targeted behavior was smoking (2/17, 12% of the studies). Attrition varied greatly across the studies (0%-37%). Risk of bias was high in 65% (11/17) of the studies, with some concerns in the remaining 35% (6/17). Interventions used various BCTs, and the most frequently used were feedback and monitoring (14/17, 82%), goals and planning (10/17, 59%), antecedents (10/17, 59%), and social support (7/17, 41%).ConclusionsThis review suggests that, although eHealth interventions may have potential, there are still unanswered questions regarding their effectiveness and what drives the mechanism behind these effects. Low methodological quality, high heterogeneity and complexity, the characteristics of the included samples, and often high attrition rates challenge the investigation of the effectiveness and the making of sound inferences about the effect sizes and significance of the results. To address this, new studies and methods are needed. A megastudy design in which different interventions are evaluated in the same population over the same period on the same outcomes may solve some of the challenges.Trial registrationPROSPERO CRD42020202777; https://www-crd-york-ac-uk/prospero/display_record.php?RecordID=202777.

Project description:BACKGROUND:Computerised clinical decision support (CDS) can potentially better inform decisions, and it can help with the management of information overload. It is perceived to be a key component of a learning health care system. Despite its increasing implementation worldwide, it remains uncertain why the effect of CDS varies and which factors make CDS more effective. OBJECTIVE:To examine which factors make CDS strategies more effective on a number of outcomes, including adherence to recommended practice, patient outcome measures, economic measures, provider or patient satisfaction, and medical decision quality. METHODS:We identified randomised controlled trials, non-randomised trials, and controlled before-and-after studies that directly compared CDS implementation with a given factor to CDS without that factor by searching CENTRAL, MEDLINE, EMBASE, and CINAHL and checking reference lists of relevant studies. We considered CDS with any objective for any condition in any healthcare setting. We included CDS interventions that were either displayed on screen or provided on paper and that were directed at healthcare professionals or targeted at both professionals and patients. The reviewers screened the potentially relevant studies in duplicate. They extracted data and assessed risk of bias in independent pairs or individually followed by a double check by another reviewer. We summarised results using medians and interquartile ranges and rated our certainty in the evidence using the GRADE system. RESULTS:We identified 66 head-to-head trials that we synthesised across 14 comparisons of CDS intervention factors. Providing CDS automatically versus on demand led to large improvements in adherence. Displaying CDS on-screen versus on paper led to moderate improvements and making CDS more versus less patient-specific improved adherence modestly. When CDS interventions were combined with professional-oriented strategies, combined with patient-oriented strategies, or combined with staff-oriented strategies, then adherence improved slightly. Providing CDS to patients slightly increased adherence versus CDS aimed at the healthcare provider only. Making CDS advice more explicit and requiring users to respond to the advice made little or no difference. The CDS intervention factors made little or no difference to patient outcomes. The results for economic outcomes and satisfaction outcomes were sparse. CONCLUSION:Multiple factors may affect the success of CDS interventions. CDS may be more effective when the advice is provided automatically and displayed on-screen and when the suggestions are more patient-specific. CDS interventions combined with other strategies probably also improves adherence. Providing CDS directly to patients may also positively affect adherence. The certainty of the evidence was low to moderate for all factors. TRIAL REGISTRATION:PROSPERO, CRD42016033738.

Project description:BackgroundRapid advancements in eHealth and mobile health (mHealth) technologies have driven researchers to design and evaluate numerous technology-based interventions to promote smoking cessation. The evolving nature of cessation interventions emphasizes a strong need for knowledge synthesis.ObjectiveThis systematic review and meta-analysis aimed to summarize recent evidence from randomized controlled trials regarding the effectiveness of eHealth-based smoking cessation interventions in promoting abstinence and assess nonabstinence outcome indicators, such as cigarette consumption and user satisfaction, via narrative synthesis.MethodsWe searched for studies published in English between 2017 and June 30, 2022, in 4 databases: PubMed (including MEDLINE), PsycINFO, Embase, and Cochrane Library. Two independent reviewers performed study screening, data extraction, and quality assessment based on the GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) framework. We pooled comparable studies based on the population, follow-up time, intervention, and control characteristics. Two researchers performed an independent meta-analysis on smoking abstinence using the Sidik-Jonkman random-effects model and log risk ratio (RR) as the effect measurement. For studies not included in the meta-analysis, the outcomes were narratively synthesized.ResultsA total of 464 studies were identified through an initial database search after removing duplicates. Following screening and full-text assessments, we deemed 39 studies (n=37,341 participants) eligible for this review. Of these, 28 studies were shortlisted for meta-analysis. According to the meta-analysis, SMS or app text messaging can significantly increase both short-term (3 months) abstinence (log RR=0.50, 95% CI 0.25-0.75; I2=0.72%) and long-term (6 months) abstinence (log RR=0.77, 95% CI 0.49-1.04; I2=8.65%), relative to minimal cessation support. The frequency of texting did not significantly influence treatment outcomes. mHealth apps may significantly increase abstinence in the short term (log RR=0.76, 95% CI 0.09-1.42; I2=88.02%) but not in the long term (log RR=0.15, 95% CI -0.18 to 0.48; I2=80.06%), in contrast to less intensive cessation support. In addition, personalized or interactive interventions showed a moderate increase in cessation for both the short term (log RR=0.62, 95% CI 0.30-0.94; I2=66.50%) and long term (log RR=0.28, 95% CI 0.04-0.53; I2=73.42%). In contrast, studies without any personalized or interactive features had no significant impact. Finally, the treatment effect was similar between trials that used biochemically verified or self-reported abstinence. Among studies reporting outcomes besides abstinence (n=20), a total of 11 studies reported significantly improved nonabstinence outcomes in cigarette consumption (3/14, 21%) or user satisfaction (8/19, 42%).ConclusionsOur review of 39 randomized controlled trials found that recent eHealth interventions might promote smoking cessation, with mHealth being the dominant approach. Despite their success, the effectiveness of such interventions may diminish with time. The design of more personalized interventions could potentially benefit future studies.Trial registrationPROSPERO CRD42022347104; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=347104.

Project description:BackgroundAn estimated 12.8% of children and adolescents experience chronic health conditions that lead to poor quality of life, adjustment and coping issues, and concurrent mental health problems. Digital health deployment of psychosocial interventions to support youth with chronic illness has become increasingly popular with the advent of the technological advances in the digital age.ObjectiveOur objectives were to systematically review published efficacy studies of eHealth and mHealth (mobile health) psychosocial interventions for youths with chronic illnesses and review intervention theory and treatment components.MethodsPubMed, Embase, Web of Science, PsycInfo, and Cochrane Database of Systematic Reviews were searched for studies published from 2008 to 2019 of eHealth and mHealth psychosocial interventions designed for children and adolescents with chronic illnesses in which efficacy outcomes were reported. We excluded studies of interventions for caregivers, healthy youth, disease and medication management, and telehealth interventions that function solely as a platform to connect patients to providers via phone, text, or videoconference.ResultsWe screened 2551 articles and 133 relevant full-text articles. Sixteen efficacy studies with psychosocial and health outcomes representing 12 unique interventions met the inclusion criteria. Of the included studies, 12 were randomized controlled trials and 4 were prospective cohort studies with no comparison group. Most interventions were based in cognitive behavioral theory and designed as eHealth interventions; only 2 were designed as mHealth interventions. All but 2 interventions provided access to support staff via text, phone, email, or discussion forums. The significant heterogeneity in intervention content, intervention structure, medical diagnoses, and outcomes precluded meta-analysis. For example, measurement time points ranged from immediately postcompletion of the mHealth program to 18 months later, and we identified 39 unique outcomes of interest. The majority of included studies (11/16, 69%) reported significant changes in measured health and/or psychosocial posttreatment outcomes, with small to large effect sizes.ConclusionsAlthough the available literature on the efficacy of eHealth and mHealth psychosocial interventions for youth with chronic illnesses is limited, preliminary research suggests some evidence of positive treatment responses. Future studies should continue to evaluate whether digital health platforms may be a viable alternative model of delivery to traditional face-to-face approaches.

Dataset Information

Factors Determining the Success and Failure of eHealth Interventions: Systematic Review of the Literature.

Publications

Factors Determining the Success and Failure of eHealth Interventions: Systematic Review of the Literature.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets