Dataset Information

Applying the RE-AIM Framework for the Evaluation of a Clinical Decision Support Tool for Pediatric Head Trauma: A Mixed-Methods Study.

ABSTRACT: BACKGROUND:The overuse of cranial computed tomography (CT) to diagnose potential traumatic brain injuries (TBIs) exposes children with minor blunt head trauma to unnecessary ionizing radiation. The Pediatric Emergency Care Applied Research Network and the Clinical Research on Emergency Services and Treatments Network implemented TBI prediction rules via electronic health record (EHR) clinical decision support (CDS) to decrease use of CTs in children with minor blunt head trauma. OBJECTIVE:This article aims to facilitate implementation and dissemination of a CDS alert into emergency departments around the country. METHODS:We evaluated the EHR CT CDS tool through a mixed-methods analysis of 38 audio-recorded interviews with health care stakeholders and quantitative data sources, using the Reach, Efficacy, Adoption, Implementation, and Maintenance framework. RESULTS:Reach -: The demographics of participants enrolled in the clinical trial were consistent with national estimates of TBI prevalence. Efficacy-There was a variable and modest reduction in CT rates for the 8,067 children with minor head trauma whose clinicians received CDS. Adoption -: The EHR CT CDS tool was well matched with the organizational mission, values, and priorities of the implementation sites. Implementation- The most important predisposing factors for successful implementation were the presence of an approachable clinical champion at each site and belief that the tool was a relevant, reusable knowledge asset. Enabling factors included an effective integration within the clinical workflow, organizational investment in user training, and ease of use. Maintenance -: Reinforcing factors for the EHR CT CDS tool included a close fit with the institutional culture, belief that it was useful for providers and families, and a good educational and informational tool. As such, the EHR CT CDS tool was maintained in clinical practice long after study completion. CONCLUSION:Data from this mixed-methods study complement findings from the efficacy trial and provide critical components for consideration prior to integration and subsequent dissemination of the EHR CT CDS tool. TRIAL REGISTRATION:NCT01453621, Registered September 27, 2011.

SUBMITTER: Masterson Creber RM

PROVIDER: S-EPMC6125135 | biostudies-literature | 2018 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Applying the RE-AIM Framework for the Evaluation of a Clinical Decision Support Tool for Pediatric Head Trauma: A Mixed-Methods Study.

Masterson Creber Ruth M RM Dayan Peter S PS Kuppermann Nathan N Ballard Dustin W DW Tzimenatos Leah L Alessandrini Evaline E Mistry Rakesh D RD Hoffman Jeffrey J Vinson David R DR Bakken Suzanne S

Applied clinical informatics 20180701 3

<h4>Background</h4>The overuse of cranial computed tomography (CT) to diagnose potential traumatic brain injuries (TBIs) exposes children with minor blunt head trauma to unnecessary ionizing radiation. The Pediatric Emergency Care Applied Research Network and the Clinical Research on Emergency Services and Treatments Network implemented TBI prediction rules via electronic health record (EHR) clinical decision support (CDS) to decrease use of CTs in children with minor blunt head trauma.<h4>Objec ...[more]

PMID: 30184559

Similar Datasets

Project description:BackgroundProlonged caregiving of an older adult can cause family caregivers to be overwhelmed, potentially affecting the well-being of both the caregivers and their care-recipients. Carer Matters is a holistic hospital-to-home programme, centred on caregivers' needs as their care-recipients transit from hospital to home. The programme was piloted to support caregivers through caregivers needs assessment, tailored resources, tele-support, training courses, and community support network. This study aimed to examine the feasibility of Carer Matters in a tertiary hospital in Singapore.MethodsThis feasibility study was conducted on the pilot implementation from January to December 2021, during the Covid-19 pandemic. It adopted the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. The study highlighted quantitative data collected from key process indicators, such as number of caregivers screened, assessed on their needs and provided with assistance. Additionally, qualitative data was collected from in-depth interviews with 51 stakeholders involved in the implementation to examine their perspectives and experiences. These included family caregivers, clinician caregiver support nurses, hospital leaders and community partners.ResultsDuring the pilot, 550 caregivers were enrolled. All caregivers received educational resources when they completed the needs assessment, while 69 of them who reported high burden were given tele-support and 252 attended our caregiver training courses. Despite initial recruitment challenges and obstacles to adoption, stakeholders interviewed found Carer Matters to be effective in providing caregivers with emotional support, knowledge and skills that improved their caregiving abilities, and reduced their sense of isolation and caregiving stress. Among caregivers, the training courses were effective with majority of caregivers agreeing that the courses addressed their needs (99%) and improved their knowledge of the relevant disease conditions (97%). Programme maintenance considered among stakeholders included strategies such as multipronged approach in recruiting caregivers and inviting caregiver advocates to share their experiences.ConclusionThis feasibility study highlights that Carer Matters is a valuable component to the ecosystem of support for family caregivers and their care recipients. Carer Matters extends the current patient-centric care model to a more holistic post-discharge continuity of care for both caregivers and their care-recipients, improving and maintaining their overall well-being to better allow transition from hospital-to home.Trial registrationFeasibility Study of Project Carer Matters for Family Caregivers of Persons with Dementia (NCT number: NCT05205135 ).

Project description:BackgroundThe positive health impact of physical activity (PA) is well known, yet a large proportion of the world's population remains sedentary. General PA programs are common as health promotion initiatives. However, effectiveness evaluations of such PA programs on individual and organizational aspects, which could inform the decision-making process of public health bodies are still lacking, particularly in the most socially disadvantaged areas, where health promotion schemes are particularly needed. The aim of this study was to assess the effectiveness of a Guided Walking Program in a high social vulnerability context.MethodsA quasi-experimental, mixed methods study was conducted. The program had a duration of 6 months and a 6-month follow-up period after the intervention. Session frequency was five times a week, where sessions consisted of supervised PA combined with educational sessions. The Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework was followed to assess the program. The International Physical Activity Questionnaire (IPAQ) and accelerometers were used to measure levels of PA. Focus groups were conducted to gain a comprehensive insight on the implementation domain.ResultsMost subjects in the intervention (IG) (n = 74) and control (CG) (n = 74) groups were female (IG:90.5%; CG:95.9%), aged 18-49 years (IG:44.6%; CG:43.2%), received less than 1 minimum wage (IG:74.3%; CG:83.7%) and had 0-4 years of formal education (IG:52.1%; CG:46.1%). The reach of the intervention was 0.3%. The IG showed increased levels of PA at post-intervention and 6-month follow-up. However, the difference between groups was not statistically significant. Adoption data revealed that 89.5% of the professionals in the Primary Health Care Center (health center) team perceived the benefits of the program for the population. The program was independently promoted by the health center team for a further 4 months post-intervention. The qualitative data revealed that the program was discontinued due to participants' low adherence and human resource limitations in the unit's operational dynamics.ConclusionsA health promotion intervention in a socially deprived setting faces challenges but can be effective and feasible to implement. The present study informs the development of future health promotion initiatives in this context.Trial registrationNCT02857127 . Registered: 30 July 2016 (retrospectively registered).

Project description:Background: The RE-AIM framework has been widely used in health research but it is unclear the extent to which this framework is also used for planning and evaluating health-related programs in clinical and community settings. Our objective was to evaluate how RE-AIM is used in the "real-world" and identify opportunities for improving use outside of research contexts. Methods: We used purposive and snowball sampling to identify clinical and community health programs that used RE-AIM for planning and/or evaluation. Recruitment methods included surveys with email follow-up to funders, implementers, and RE-AIM working group members. We identified 17 programs and conducted structured in-depth interviews with key informants (n = 18). Across RE-AIM dimensions, respondents described motivations, uses, and measures; rated understandability and usefulness; discussed benefits and challenges, strategies to overcome challenges, and resources used. We used descriptive statistics for quantitative ratings, and content analysis for qualitative data. Results: Program content areas included chronic disease management and prevention, healthy aging, mental health, or multiple, often behavioral health-related topics. During planning, most programs considered reach (n = 9), adoption (n = 11), and implementation (n = 12) while effectiveness (n = 7) and maintenance (n = 6) were considered less frequently. In contrast, most programs evaluated all RE-AIM dimensions, ranging from 13 programs assessing maintenance to 15 programs assessing implementation and effectiveness. On five-point scales, all RE-AIM dimensions were rated as easy to understand (Overall M = 4.7 ± 0.5), but obtaining data was rated as somewhat challenging (Overall M = 3.4 ± 0.9). Implementation was the most frequently used dimension to inform program design (M = 4.7 ± 0.6) relative to the other dimensions (3.0-3.9). All dimensions were considered similarly important for decision-making (average M = 4.1 ± 1.4), with the exception of maintenance (M = 3.4 ± 1.7). Qualitative corresponded to the quantitative findings in that RE-AIM was reported to be a practical, easy to understand, and well-established implementation science framework. Challenges included understanding differences among RE-AIM dimensions and data acquisition. Valuable resources included the RE-AIM website and collaborating with an expert. Discussion: RE-AIM is an efficient framework for planning and evaluation of clinical and community-based projects. It provides structure to systematically evaluate health program impact. Programs found planning for and assessing maintenance difficult, providing opportunities for further refinement.

Project description:BackgroundCognitive impairment (CI) is a risk factor for falls due to environmental or living settings, balance, gait and vision impairments, as well as medications. While previous systematic reviews have focused on the effectiveness of fall prevention programs in adults with cognitive impairment, very limited information is available on their implementation. This review examines what aspects of fall prevention interventions for community-dwelling adults with CI have been reported using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework to support successful implementation.MethodsWe examined the included studies from our systematic review, which searched 7 databases for primary and secondary fall prevention interventions involving community-dwelling adults ≥50 years with mild to moderate CI. Reviewers screened citations and extracted data for study characteristics and the 5 dimensions (62 criteria) of the RE-AIM framework.ResultsTwelve randomized or clinical controlled trials (RCTs/CCTs) consisting of 8 exercise interventions, 3 multifactorial interventions, and 1 medication treatment were included in the review. Only 4 of 62 criteria were reported by all 12 included studies and 29 criteria were not reported by any of the studies. Five of the included studies reported on 20 or more of the 62 possible RE-AIM criteria and 3 of these studies self-identified as "feasibility" studies. While Reach was the best-reported construct by the included studies, followed by Effectiveness and Implementation, the criteria within the Adoption and Maintenance constructs were rarely mentioned by these studies. In general, there was also wide variation in how each of the criteria were reported on by study authors.ConclusionBased on the reporting of RE-AIM components in this review, we are unable to make connections to successful intervention components and thus practice-based recommendations for fall prevention in those with CI. The lack of detail regarding implementation approaches greatly limits the interpretation and comparisons across studies to fully inform future research efforts.

Project description:IntroductionDespite recommendation that all women receive an ultrasound in pregnancy prior to 24 weeks', this remains unavailable to many women in low-income countries where trained practitioners are scarce. Although many programmes have demonstrated efficacy, few have achieved longterm sustainability, with a lack of information about how best to implement such programmes. This mixed-methods study aimed to evaluate the implementation of a novel education package to teach ultrasound-naive midwives in Malawi basic obstetric ultrasound, assessing its impact in the context of the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework.MethodsThe study ran across six sites in Malawi between October 2020 and June 2021, encompassing three phases; pre-implementation, implementation and post-implementation. Twenty nine midwives underwent a bespoke education package with matched pre and post course surveys assessed their knowledge, attitudes and confidence and "hands on" assessments evaluating practical skills. Training evaluation forms and in-depth interviews explored their satisfaction with the package, with repeat assessment and remote image review evaluating maintenance of skills.Results28/29 midwives completed the training, with significant increases in knowledge, confidence and practical skills. Adherence to the education package varied, however many changes to the proposed methodology were adaptive and appeared to facilitate the efficacy of the programme. Unfortunately, despite reporting approval regarding the training itself, satisfaction regarding supervision and follow up was mixed, reflecting the difficulties encountered with providing ongoing in-person and remote support.ConclusionThis programme was successful in improving trainees' knowledge, confidence and skill in performing basic obstetric ultrasound, largely on account of an adaptive approach to implementation. The maintenance of ongoing support was challenging, reflected by trainee dissatisfaction. By evaluating the success of this education package based on its implementation and not just its efficacy, we have generated new insights into the barriers to sustainable upscale, specifically those surrounding maintenance.

Project description:IntroductionDiabetes represents a major public health and health system burden. As part of the Alberta's Caring for Diabetes (ABCD) Project, two quality-improvement interventions are being piloted in four Primary Care Networks in Alberta. Gaps between health research, policy and practice have been documented and the need to evaluate the impact of public health interventions in real-world settings to inform decision-making and clinical practice is paramount. In this article, we describe the application of the RE-AIM framework to evaluate the interventions beyond effectiveness.Methods and analysisTwo quality-improvement interventions were implemented, based on previously proven effective models of care and are directed at improving the physical and mental health of patients with type-2 diabetes. Our goal is to adapt and apply the RE-AIM framework, using a mixed-methods approach, to understand the impact of the interventions to inform policy and clinical decision-making. We present the proposed measures, data sources and data management and analysis strategies used to evaluate the interventions by RE-AIM dimension.Ethics and disseminationEthics approval for the ABCD Project has been granted from the Health Research Ethics Board (HREB #PRO00012663) at the University of Alberta. The RE-AIM framework will be used to structure our dissemination activities by dimension.ResultsIt will be presented at relevant conferences and prepared for publication in peer-reviewed journals. Various products, such as presentations, briefing reports and webinars, will be developed to inform key stakeholders of the findings. Presentation of findings by RE-AIM dimension will facilitate discussion regarding the public health impact of the two interventions within the primary care context of Alberta and lessons learned to be used in programme planning and care delivery for patients with type-2 diabetes. It will also promote the application of evaluation models to better assess the impact of community-based primary healthcare interventions through our dissemination activities.

Project description:BackgroundClinical decision support systems are designed to utilize medical data, knowledge, and analysis engines and to generate patient-specific assessments or recommendations to health professionals in order to assist decision making. Artificial intelligence-enabled clinical decision support systems aid the decision-making process through an intelligent component. Well-defined evaluation methods are essential to ensure the seamless integration and contribution of these systems to clinical practice.ObjectiveThe purpose of this study was to develop and validate a measurement instrument and test the interrelationships of evaluation variables for an artificial intelligence-enabled clinical decision support system evaluation framework.MethodsAn artificial intelligence-enabled clinical decision support system evaluation framework consisting of 6 variables was developed. A Delphi process was conducted to develop the measurement instrument items. Cognitive interviews and pretesting were performed to refine the questions. Web-based survey response data were analyzed to remove irrelevant questions from the measurement instrument, to test dimensional structure, and to assess reliability and validity. The interrelationships of relevant variables were tested and verified using path analysis, and a 28-item measurement instrument was developed. Measurement instrument survey responses were collected from 156 respondents.ResultsThe Cronbach α of the measurement instrument was 0.963, and its content validity was 0.943. Values of average variance extracted ranged from 0.582 to 0.756, and values of the heterotrait-monotrait ratio ranged from 0.376 to 0.896. The final model had a good fit (χ262=36.984; P=.08; comparative fit index 0.991; goodness-of-fit index 0.957; root mean square error of approximation 0.052; standardized root mean square residual 0.028). Variables in the final model accounted for 89% of the variance in the user acceptance dimension.ConclusionsUser acceptance is the central dimension of artificial intelligence-enabled clinical decision support system success. Acceptance was directly influenced by perceived ease of use, information quality, service quality, and perceived benefit. Acceptance was also indirectly influenced by system quality and information quality through perceived ease of use. User acceptance and perceived benefit were interrelated.

Dataset Information

Applying the RE-AIM Framework for the Evaluation of a Clinical Decision Support Tool for Pediatric Head Trauma: A Mixed-Methods Study.

Publications

Applying the RE-AIM Framework for the Evaluation of a Clinical Decision Support Tool for Pediatric Head Trauma: A Mixed-Methods Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets