Dataset Information

RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings.

ABSTRACT: Background: The RE-AIM framework has been widely used in health research but it is unclear the extent to which this framework is also used for planning and evaluating health-related programs in clinical and community settings. Our objective was to evaluate how RE-AIM is used in the "real-world" and identify opportunities for improving use outside of research contexts. Methods: We used purposive and snowball sampling to identify clinical and community health programs that used RE-AIM for planning and/or evaluation. Recruitment methods included surveys with email follow-up to funders, implementers, and RE-AIM working group members. We identified 17 programs and conducted structured in-depth interviews with key informants (n = 18). Across RE-AIM dimensions, respondents described motivations, uses, and measures; rated understandability and usefulness; discussed benefits and challenges, strategies to overcome challenges, and resources used. We used descriptive statistics for quantitative ratings, and content analysis for qualitative data. Results: Program content areas included chronic disease management and prevention, healthy aging, mental health, or multiple, often behavioral health-related topics. During planning, most programs considered reach (n = 9), adoption (n = 11), and implementation (n = 12) while effectiveness (n = 7) and maintenance (n = 6) were considered less frequently. In contrast, most programs evaluated all RE-AIM dimensions, ranging from 13 programs assessing maintenance to 15 programs assessing implementation and effectiveness. On five-point scales, all RE-AIM dimensions were rated as easy to understand (Overall M = 4.7 ± 0.5), but obtaining data was rated as somewhat challenging (Overall M = 3.4 ± 0.9). Implementation was the most frequently used dimension to inform program design (M = 4.7 ± 0.6) relative to the other dimensions (3.0-3.9). All dimensions were considered similarly important for decision-making (average M = 4.1 ± 1.4), with the exception of maintenance (M = 3.4 ± 1.7). Qualitative corresponded to the quantitative findings in that RE-AIM was reported to be a practical, easy to understand, and well-established implementation science framework. Challenges included understanding differences among RE-AIM dimensions and data acquisition. Valuable resources included the RE-AIM website and collaborating with an expert. Discussion: RE-AIM is an efficient framework for planning and evaluation of clinical and community-based projects. It provides structure to systematically evaluate health program impact. Programs found planning for and assessing maintenance difficult, providing opportunities for further refinement.

SUBMITTER: Kwan BM

PROVIDER: S-EPMC6883916 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundChildhood overweight and obesity is a major public health concern. Community-based interventions have the potential to reach caregivers and children. However, the overall health impact of these programs is rarely comprehensively assessed. This study evaluated a physical activity and healthy eating family program (Healthy Together; HT) using the RE-AIM framework.MethodsTen sites implemented the 5-week program. Thirty-nine staff members and 277 program participants (126 caregivers [M age ?=?35.6] and 151 children [M age ?=?13]) participated in the evaluation. Each RE-AIM dimension was assessed independently using a mixed-methods approach. Sources of data included archival records, interviews and surveys. Effectiveness outcome variables were assessed at pre- and post-intervention and 6-month follow-up.ResultsReach: HT participants were almost entirely recruited from existing programs within sites. Effectiveness: Caregivers' nutrition related efficacy beliefs increased following HT (ps?<?.03). Participation in HT was not associated with significant changes in physical activity or nutrition behaviour or perceived social support (ps?>?.05). Knowledge surrounding healthy diets and physical activity increased in children and caregivers (ps?<?.05). Adoption: Thirty-five percent of sites approached to implement HT expressed interest. The 10 sites selected recruited existing staff members to implement HT.ImplementationProgram objectives were met 72.8% of the time and 71 adaptations were made. HT was finance- and time-dependent. Maintenance: Two sites fully implemented HT in the follow-up year and 5 sites incorporated aspects of HT into other programs.ConclusionsWorking alongside organizations that develop community programs to conduct comprehensive, arms-length evaluations can systematically highlight areas of success and challenges. Overall HT represents a feasible community-based intervention; however further support is required in order to ensure the program is effective at positively targeting the desired outcomes. As a result of this evaluation, modifications are currently being implemented to HT.

Project description:ObjectiveMost formats of currently used community-based health education for cognitive impairment prevention are limited to one-way communication, such as distributing leaflets, pasting posters, or holding a lecture, and they lack comprehensive evaluation. Here we aim to design, test, and evaluate a novel pilot cognitive health education program combined with psychosocial interventions (CHECPI).MethodsWe designed the CHECPI program and tested it among adults aged 60 and over in an aging-friendly community in 2018. Multidimensional cognitive functions were measured by the Montreal Cognitive Assessment (MoCA) before and three months after the CHECPI program. Quantitative and qualitative analyses were performed based on the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to evaluate the program. Wilcoxon signed-rank tests were used to assess changes in multidimensional cognitive functions.ResultsThe CHECPI program was comprised of 12 courses and introduced 5 kinds of psychosocial interventions. Reach: 28 older adults participated in the program, of whom most were female (n = 22) and younger elderly with an average age of 65.32 years. Effectiveness: 19 participants finished≥6 courses as well as the follow-up survey. Although their MoCA scores did not improve significantly, they had increased their visuospatial ability significantly (with the average score increasing by 0.42). Adoption: the community officers, lecturers, and participants highly recommended the program, but they agreed that the lack of professional instructors may hinder its popularization. Implementation: the program was implemented in full accordance with the pre-program design. Maintenance: three months after the program, 17 participants had maintained at least one of the seven healthy behaviors that were introduced in the program.ConclusionsYounger female elderly were more willing to participate in the program. It enhanced participants' visuospatial ability, but a sufficient number of professional instructors are crucial for large-scale promotion.

Project description:Introduction: Veterans frequently seek chronic pain care from their primary care providers (PCPs) who may not be adequately trained to provide pain management. To address this issue the Veterans Health Administration (VHA) Office of Specialty Care adopted the Specialty Care Access Network Extension for Community Healthcare Outcomes (VA-ECHO née SCAN-ECHO). The VA-ECHO program offered training and mentoring by specialists to PCPs and their staff. VA-ECHO included virtual sessions where expertise was shared in two formats: (1) didactics on common pain conditions, relevant psychological disorders, and treatment options and (2) real-time consultation on patient cases. Materials and methods: VA-ECHO participants' perspectives were obtained using a semi-structured interview guide designed to elicit responses based on the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework. A convenience sampling was used to recruit PCPs and non-physician support staff participants. Non-physicians from rural VHA sites were purposively sampled to gain diverse perspectives. Findings: This qualitative study yielded data on each RE-AIM domain except reach. Program reach was not measured as it is outside the scope of this study. Respondents reported program effectiveness as gains in knowledge and skills to improve pain care delivery. Effective incorporation of learning into practice was reflected in respondents' perceptions of improvements in: patient engagement, evidenced-based approaches, appropriate referrals, and opioid use. Program adoption included how participating health care systems selected trainees from a range of sites and roles to achieve a wide reach of pain expertise. Participation was limited by time to attend and facilitated by institutional support. Differences and similarities were noted in implementation between hub sites. Maintenance was revealed when respondents noted the importance of the lasting relationships formed between fellow participants. Discussion: This study highlights VA-ECHO program attributes and unintended consequences. These findings are expected to inform future use of VA-ECHO as a means to establish a supportive consultation network between primary and specialty care providers to promote the delivery evidence-based pain management practices.

Project description:UnlabelledOver one-third of patients treated in the Veterans Health Administration (VHA) are obese. VHA introduced the MOVE! Weight Management Program for Veterans in 2006 to provide comprehensive weight management services. An evolving, periodic evaluation using the RE-AIM framework (reach, effectiveness, adoption, implementation, and maintenance) has been conducted to gauge success and opportunities for improvement. Key metrics were identified in each RE-AIM dimension. Data were compiled over fiscal years (FY) 2006 through 2010 from a variety of sources including VHA administrative and clinical databases, electronic medical record reviews, and an annual, structured VHA facility self-report. REACH: Screening for obesity and offering weight management treatment to eligible patients increased from 66% to 95% over the past 3 years. MOVE! is currently provided at every VHA hospital facility and at over one-half of VHA community-based outpatient clinics. The percent of eligible patients who participate in at least one weight management visit has doubled since implementation began but has stabilized at 10 to 12%.EffectivenessAbout 18.6% of the 31,854 patients with available weight data who participated in at least two treatment visits between Jul 1, 2008 and Sep 30, 2009 had at least a 5% body weight loss by 6 months as did almost one-third of those who participated in more intense and sustained treatment. By contrast, only 12.5% of a comparison group of patients matched on age, gender, body mass index (BMI) class, and comorbidity status who were not treated with MOVE! had at least a 5% body weight loss. ADOPTION: The median full-time staff equivalent providing weight management services at each facility has increased over time and was 1.76 in FY 2010.ImplementationStaff from multiple disciplines typically provide MOVE!-related care although not all disciplines are involved with providing care at every facility. Group-based treatment has become increasingly utilized, and in FY 2010 it represented 72% of all MOVE!-related visits. Intensity of treatment has increased from an average of 3.6 visits per patient per year in FY 2007 to 4.6 in FY 2010, but more than half of patients have two visits or less. Almost all facilities now report the consistent use of key evidence-based behavioral strategies with patients. MAINTENANCE: While participation in MOVE! by patients continues to grow each year, facility self-reported program staffing and space/equipment challenges are potential barriers to long-term program maintenance. Evidence-based weight management treatment can be delivered at VHA medical centers and community-based outpatient clinics, but the REACH remains limited after several years of implementation. Intense and sustained treatment with MOVE! results in a modest positive impact on short-term weight loss outcomes, but a relatively small proportion of patients engage in this level of care. Increasing reach, improving effectiveness of care, and keeping patients engaged in treatment are areas for future policy, practice, and research.

Project description:CONTEXT: Evaluating the translatability and feasibility of an intervention program has become as important as determining the effectiveness of the intervention. OBJECTIVE: To evaluate the applicability of a 3-month jump-landing training program in basketball players, using the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework. DESIGN: Randomized controlled trial. SETTING: National and regional basketball teams. PATIENTS OR OTHER PARTICIPANTS: Twenty-four teams of the second highest national division and regional basketball divisions in Flanders, Belgium, were randomly assigned (1:1) to a control group and intervention group. A total of 243 athletes (control group = 129, intervention group = 114), ages 15 to 41 years, volunteered. INTERVENTION(S): All exercises in the intervention program followed a progressive development, emphasizing lower extremity alignment during jump-landing activities. MAIN OUTCOME MEASURE(S): The results of the process evaluation of the intervention program were based on the 5 dimensions of the RE-AIM framework. The injury incidence density, hazard ratios, and 95% confidence intervals were determined. RESULTS: The participation rate of the total sample was 100% (reach). The hazard ratio was different between the intervention group and the control group (0.40 [95% confidence interval = 0.16, 0.99]; effectiveness). Of the 12 teams in the intervention group, 8 teams (66.7%) agreed to participate in the study (adoption). Eight of the participating coaches (66.7%) felt positively about the intervention program and stated that they had implemented the training sessions of the program as intended (implementation). All coaches except 1 (87.5%) intended to continue the intervention program the next season (maintenance). CONCLUSIONS: Compliance of the coaches in this coach-supervised jump-landing training program was high. In addition, the program was effective in preventing lower extremity injuries.

Project description:BackgroundThe National Diabetes Prevention Program (National DPP) is rapidly expanding in an effort to help those at high risk of type 2 diabetes prevent or delay the disease. In 2012, the Centers for Disease Control and Prevention funded six national organizations to scale and sustain multistate delivery of the National DPP lifestyle change intervention (LCI). This study aims to describe reach, adoption, and maintenance during the 4-year funding period and to assess associations between site-level factors and program effectiveness regarding participant attendance and participation duration.MethodsThe Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework was used to guide the evaluation from October 2012 to September 2016. Multilevel linear regressions were used to examine associations between participant-level demographics and site-level strategies and number of sessions attended, attendance in months 7-12, and duration of participation.ResultsThe six funded national organizations increased the number of participating sites from 68 in 2012 to 164 by 2016 across 38 states and enrolled 14,876 eligible participants. By September 2016, coverage for the National DPP LCI was secured for 42 private insurers and 7 public payers. Nearly 200 employers were recruited to offer the LCI on site to their employees. Site-level strategies significantly associated with higher overall attendance, attendance in months 7-12, and longer participation duration included using self-referral or word of mouth as a recruitment strategy, providing non-monetary incentives for participation, and using cultural adaptations to address participants' needs. Sites receiving referrals from healthcare providers or health systems also had higher attendance in months 7-12 and longer participation duration. At the participant level, better outcomes were achieved among those aged 65+ (vs. 18-44 or 45-64), those who were overweight (vs. obesity), those who were non-Hispanic white (vs. non-Hispanic black or multiracial/other races), and those eligible based on a blood test or history of gestational diabetes mellitus (vs. screening positive on a risk test).ConclusionsIn a time of rapid dissemination of the National DPP LCI the findings of this evaluation can be used to enhance program implementation and translate lessons learned to similar organizations and settings.

Project description:BackgroundThis study presents an intervention designed to foster the implementation of health promotion programs within District Municipality Community Centers (DMCCs) in Jerusalem, and the creation of a peer network of healthy settings with a shared aspiration of collaborating and implementing health-promoting policies at the community level. We also present the evaluation strategy, based on the EQUIHP and RE-AIM frameworks.MethodsTwenty DMCCs completed our program. This evaluation research involved a comprehensive seminar during the first year for DMCCs coordinators, teaching them the principles of health promotion. An educational kit was distributed during the second year. The evaluation strategy included a process evaluation and annual evaluations based on the EQUIHP and RE-AIM frameworks. The EQUIHP tool was divided into four dimensions of evaluation: 1) Framework of health promotion principles, 2) Project development and implementation, 3) Project management, and 4) Sustainability; while the RE-AIM domains included: 1)Reach, 2)Effectiveness, 3)Adoption, 4)Implementation and 5)Maintenance.ResultsThe program led to high responsiveness among DMCCs and to the implementation of diverse health promotion initiatives, with a participation of approximately 29,191 residents. The EQUIHP evaluation showed an improvement in program quality in Year 2. The final RE-AIM evaluation presented a total median score of 0.61 for all domains, where 0 was non-performance and 1.0 was full performance. The 'Framework of health promotion principles' and 'Reach' components received the highest median score (0.83, 1.0 and 0.87), while the 'Sustainability and 'Maintenance' components received the lowest (0.5).ConclusionsThis innovative program adapts the Healthy Cities approach (initiated by the World Health Organization in 1986) to the development of community center health-promoting settings within the larger municipal framework, training local community center staff members to assess and address local health concerns and build community capacity. The local focus and efforts may help community actors to create health promotion programs more likely to be adopted, feasible in the 'real-world' and able to produce public health impact in the communities where people live. Moreover, collaboration and cooperation among DMCCs may lead to a broader community health vision, forging coalitions that can advocate more powerfully for health promotion.Trial registrationNIH trial registration number: NCT04470960. Retrospectively registered on: 14/07/2020.

Dataset Information

RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets