Dataset Information

Applying a mixed-methods evaluation to Healthy Kids, Healthy Communities.

ABSTRACT: From 2008 to 2014, the Healthy Kids, Healthy Communities (HKHC) national program funded 49 communities across the United States and Puerto Rico to implement healthy eating and active living policy, system, and environmental changes to support healthier communities for children and families, with special emphasis on reaching children at highest risk for obesity on the basis of race, ethnicity, income, or geographic location. Evaluators designed a mixed-methods evaluation to capture the complexity of the HKHC projects, understand implementation, and document perceived and actual impacts of these efforts. Eight complementary evaluation methods addressed 4 primary aims seeking to (1) coordinate data collection for the evaluation through the web-based project management system (HKHC Community Dashboard) and provide training and technical assistance for use of this system; (2) guide data collection and analysis through use of the Assessment and Evaluation Toolkit; (3) conduct a quantitative cross-site impact evaluation among a subset of community partnership sites; and (4) conduct a qualitative cross-site process and impact evaluation among all 49 community partnership sites. Evaluators identified successes and challenges in relation to the following methods: an online performance-monitoring HKHC Community Dashboard system, environmental audits, direct observations, individual and group interviews, partnership and community capacity surveys, group model building, photographs and videos, and secondary data sources (surveillance data and record review). Several themes emerged, including the value of systems approaches, the need for capacity building for evaluation, the value of focusing on upstream and downstream outcomes, and the importance of practical approaches for dissemination. The mixed-methods evaluation of HKHC advances evaluation science related to community-based efforts for addressing childhood obesity in complex community settings. The findings are likely to provide practice-relevant evidence for public health.

SUBMITTER: Brownson RC

PROVIDER: S-EPMC4746076 | biostudies-literature | 2015 May-Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Applying a mixed-methods evaluation to Healthy Kids, Healthy Communities.

Brownson Ross C RC Kemner Allison L AL Brennan Laura K LK

Journal of public health management and practice : JPHMP 20150501

From 2008 to 2014, the Healthy Kids, Healthy Communities (HKHC) national program funded 49 communities across the United States and Puerto Rico to implement healthy eating and active living policy, system, and environmental changes to support healthier communities for children and families, with special emphasis on reaching children at highest risk for obesity on the basis of race, ethnicity, income, or geographic location. Evaluators designed a mixed-methods evaluation to capture the complexity ...[more]

PMID: 25828217

Similar Datasets

Project description:IntroductionSchools are promising settings for physical activity promotion; however, they are complex and adaptive systems that can influence the quality of programme implementation. This paper presents an evaluation of a school-based running programme (Marathon Kids). The aims of this study are (1) to identify the processes by which schools implement the programme, (2) identify and explain the contextual factors affecting implementation and explications of effectiveness and (3) examine the relationship between the level of implementation and perceived outcomes.MethodsUsing a realist evaluation framework, a mixed method single-group before-and-after design, strengthened by multiple interim measurements, will be used. Year 5 (9-10 years old) pupils and their teachers will be recruited from six state-funded primary schools in Leicestershire, UK.Data will be collected once prior to implementation, at five discrete time points during implementation and twice following implementation. A weekly implementation log will also be used. At time point 1 (TP1) (September 2016), data on school environment, teacher and pupil characteristics will be collected. At TP1 and TP6 (July 2017), accelerometry, pupil self-reported physical activity and psychosocial data (eg, social support and intention to be active) will be collected. At TP2, TP3 and TP5 (January, March and June 2017), observations will be conducted. At TP2 and TP5, there will be teacher interviews and pupil focus groups. Follow-up teacher interviews will be conducted at TP7 and TP8 (October 2017 and March 2018) and pupil focus group at TP8. In addition, synthesised member checking will be conducted (June 2018) with a mixed sample of schools.Ethics and disseminationEthical approval for this study was obtained through Loughborough University Human Participants Ethics Subcommittee (R16-P032 & R16-P116). Findings will be disseminated via print, online media and dissemination events as well as practitioner and/or research journals.

Project description:BackgroundDementia-related impairments can cause complex barriers to access, use, and adopt digital health technologies (DHTs). These barriers can contribute to digital health inequities. Therefore, literature-based design principles called DEMIGNED have been developed to support the design and evaluation of DHTs for this rapidly increasing population.ObjectiveThis study aims to apply the DEMIGNED principles in usability evaluation methods to (1) capture usability problems on a mobile website providing information resources for people visiting a memory clinic, including those living with subjective cognitive decline (SCD), mild cognitive impairment (MCI), or dementia, and (2) investigate the realness of usability problems captured by the DEMIGNED principles in expert testing, specifically for mobile websites that act as a means of providing DHTs.MethodsFirst, a heuristic evaluation was conducted, with the DEMIGNED principles serving as domain-specific guidelines, with 3 double experts (experienced in both usability and dementia) and 2 usability engineering experts. Second, think-aloud sessions were conducted with patients visiting a memory clinic who were living with SCD, MCI, or dementia.ResultsThe heuristic evaluation resulted in 36 unique usability problems. A representative sample of 7 people visiting a memory clinic participated in a think-aloud session, including 4 (57%) with SCD, 1 (14%) with MCI, and 2 (29%) with dementia. The analysis of the think-aloud sessions revealed 181 encounters with usability problems. Of these encounters, 144 (79.6%) could be mapped to 18 usability problems identified in the heuristic evaluation. The remaining 37 (20.4%) encounters from the user testing revealed another 10 unique usability problems. Usability problems frequently described in the think-aloud sessions encompassed difficulties with using the search function, discrepancies between the user's expectations and the content organization, the need for scrolling, information overload, and unclear system feedback.ConclusionsBy applying the DEMIGNED principles in expert testing, evaluators were able to capture 79.6% (144/181) of all usability problem encounters in the user testing of a mobile website for people visiting a memory clinic, including people living with dementia. Regarding unique usability problems, 50% (18/36) of the unique usability problems identified during the heuristic evaluation were captured by the user-testing sessions. Future research should look into the applicability of the DEMIGNED principles to other digital health functionalities to increase the accessibility of digital health and decrease digital health inequity for this complex and rapidly increasing population.

Project description:ObjectivesParent carers of children with special educational needs or disability are at risk of poorer mental and physical health. In response to these needs, we codeveloped the 'Healthy Parent Carers' (HPC) programme. This study examined the views and experiences of participants in the HPC feasibility trial to inform programme refinement.Intervention, setting and participantsHPC is a peer-led group-based intervention (supported by online materials) for primary carers of disabled children, encouraging behaviours linked with health and well-being. It was delivered by two lead and six assistant peer facilitators in six community sites (one lead and one assistant per group) in South West England over six or 12 sessions. Control participants had online materials only. The trial involved 47 intervention and 45 control parent carers (97% female and 97% white) and eight facilitators (one male).DesignA preplanned mixed methods process evaluation using questionnaires and checklists (during and after the intervention), qualitative interviews with participants after intervention (n=18) and a focus group with facilitators after trial.ResultsHPC was highly acceptable to participants and facilitators and experiences were very positive. Participants reported that the programme increased awareness of what parent carers could and could not change and their self-efficacy to engage in health-promoting behaviours. The intended mechanisms of action (social identification and peer support) matched participants' expectations and experiences. Control participants found the online-only programme flexible but isolating, as there were no opportunities to share ideas and problem solve with peers, the key function of the programme. Areas for improvement were identified for programme content, facilitator training and delivery.ConclusionHPC was acceptable, well received and offers considerable potential to improve the health of parent carers. Under the pandemic, the challenge going forward is how best to maintain reach and fidelity to function while delivering a more virtual programme.Trial registration numberISRCTN151144652.

Project description:BackgroundA healthy lifestyle may improve mental health. It is yet not known whether and how a mobile intervention can be of help in achieving this in adolescents. This study investigated the effectiveness and perceived underlying mechanisms of the mobile health (mHealth) intervention #LIFEGOALS to promote healthy lifestyles and mental health. #LIFEGOALS is an evidence-based app with activity tracker, including self-regulation techniques, gamification elements, a support chatbot, and health narrative videos.MethodsA quasi-randomized controlled trial (N = 279) with 12-week intervention period and process evaluation interviews (n = 13) took place during the COVID-19 pandemic. Adolescents (12-15y) from the general population were allocated at school-level to the intervention (n = 184) or to a no-intervention group (n = 95). Health-related quality of life (HRQoL), psychological well-being, mood, self-perception, peer support, resilience, depressed feelings, sleep quality and breakfast frequency were assessed via a web-based survey; physical activity, sedentary time, and sleep routine via Axivity accelerometers. Multilevel generalized linear models were fitted to investigate intervention effects and moderation by pandemic-related measures. Interviews were coded using thematic analysis.ResultsNon-usage attrition was high: 18% of the participants in the intervention group never used the app. An additional 30% stopped usage by the second week. Beneficial intervention effects were found for physical activity (χ21 = 4.36, P = .04), sedentary behavior (χ21 = 6.44, P = .01), sleep quality (χ21 = 6.11, P = .01), and mood (χ21 = 2.30, P = .02). However, effects on activity-related behavior were only present for adolescents having normal sports access, and effects on mood only for adolescents with full in-school education. HRQoL (χ22 = 14.72, P < .001), mood (χ21 = 6.03, P = .01), and peer support (χ21 = 13.69, P < .001) worsened in adolescents with pandemic-induced remote-education. Interviewees reported that the reward system, self-regulation guidance, and increased health awareness had contributed to their behavior change. They also pointed to the importance of social factors, quality of technology and autonomy for mHealth effectiveness.Conclusions#LIFEGOALS showed mixed results on health behaviors and mental health. The findings highlight the role of contextual factors for mHealth promotion in adolescence, and provide suggestions to optimize support by a chatbot and narrative episodes.Trial registrationClinicalTrials.gov [NCT04719858], registered on 22/01/2021.

Project description:BACKGROUND:The overuse of cranial computed tomography (CT) to diagnose potential traumatic brain injuries (TBIs) exposes children with minor blunt head trauma to unnecessary ionizing radiation. The Pediatric Emergency Care Applied Research Network and the Clinical Research on Emergency Services and Treatments Network implemented TBI prediction rules via electronic health record (EHR) clinical decision support (CDS) to decrease use of CTs in children with minor blunt head trauma. OBJECTIVE:This article aims to facilitate implementation and dissemination of a CDS alert into emergency departments around the country. METHODS:We evaluated the EHR CT CDS tool through a mixed-methods analysis of 38 audio-recorded interviews with health care stakeholders and quantitative data sources, using the Reach, Efficacy, Adoption, Implementation, and Maintenance framework. RESULTS:Reach -: The demographics of participants enrolled in the clinical trial were consistent with national estimates of TBI prevalence. Efficacy-There was a variable and modest reduction in CT rates for the 8,067 children with minor head trauma whose clinicians received CDS. Adoption -: The EHR CT CDS tool was well matched with the organizational mission, values, and priorities of the implementation sites. Implementation- The most important predisposing factors for successful implementation were the presence of an approachable clinical champion at each site and belief that the tool was a relevant, reusable knowledge asset. Enabling factors included an effective integration within the clinical workflow, organizational investment in user training, and ease of use. Maintenance -: Reinforcing factors for the EHR CT CDS tool included a close fit with the institutional culture, belief that it was useful for providers and families, and a good educational and informational tool. As such, the EHR CT CDS tool was maintained in clinical practice long after study completion. CONCLUSION:Data from this mixed-methods study complement findings from the efficacy trial and provide critical components for consideration prior to integration and subsequent dissemination of the EHR CT CDS tool. TRIAL REGISTRATION:NCT01453621, Registered September 27, 2011.

Project description:BACKGROUND:Although most US mothers initiate breastfeeding, suboptimal breastfeeding rates still exist. Although breastfeeding is a complex process, social support has been linked with increases in positive breastfeeding outcomes. Recent technological advances, including the development of social networking sites, provide mothers with convenient access to a unique array of audiences from which to seek advice about parenting, including breastfeeding. However, little is known about how the use of the sites-specifically groups centered around breastfeeding-influences breastfeeding knowledge, attitudes, or behaviors. OBJECTIVE:This mixed methods study aimed to explore utilization of an existing probreastfeeding Facebook group and how utilization influences breastfeeding-related knowledge, attitudes, and behaviors. METHODS:Participants were recruited online through Facebook wall posts from within the existing group. Mothers aged between 18 and 50 years who were pregnant and intended to breastfeed, were currently breastfeeding, or had recently weaned their infant in the past 3 years were eligible to participate. Participants engaged in online focus group discussions (n=21) and individual interviews (n=12). Inductive content analysis of qualitative data led to the conceptualization and contextualization of a breastfeeding community of practice (COP). Using qualitative results, a quantitative survey was then developed to assess the prevalence of qualities of a COP as well as how COP usage influenced breastfeeding-related attitudes and knowledge. A total of 314 mothers completed the online survey. RESULTS:Qualitative findings showed an overall sense of community, with subthemes of group trust, interaction, and the promotion of breastfeeding. A majority (287/314, 91.5%) of mothers initiated breastfeeding, with 69.0% (216/314) of mothers reporting exclusive breastfeeding their infant at 6 months. Approximately 98.5% (309/314) of mothers reported that the Facebook group captured and stored knowledge; therefore, information could be easily accessed and applied. In addition, 96.2% (302/317) of mothers reported that the Facebook group motivated them to share breastfeeding-related knowledge. CONCLUSIONS:The results suggest that this existing probreastfeeding Facebook group exhibits characteristics of an online COP, which was organically formed. Utilization of the Facebook group, in the context of an online COP, could be beneficial in impacting breastfeeding-related knowledge, attitudes, and behaviors. However, further examination and exploration of breastfeeding COPs, including using this type of model as a method of lactation support or as a telemedicine framework, is a clear need.

Project description:OBJECTIVE:To evaluate the feasibility and acceptability of a personalised telehealth intervention to support dietary self-management in adults with stage 3-4 chronic kidney disease (CKD). DESIGN:Mixed-methods process evaluation embedded in a randomised controlled trial. PARTICIPANTS:People with stage 3-4 CKD (estimated glomerular filtration rate [eGFR]15-60 mL/min/1.73 m2). SETTING:Participants were recruited from three hospitals in Australia and completed the intervention in ambulatory community settings. INTERVENTION:The intervention group received one telephone call per fortnight and 2-8 tailored text messages for 3 months, and then 4-12 tailored text messages for 3 months without telephone calls. The control group received usual care for 3 months then non-tailored education-only text messages for 3 months. MAIN OUTCOME MEASURES:Feasibility (recruitment, non-participation and retention rates, intervention fidelity and participant adherence) and acceptability (questionnaire and semistructured interviews). STATISTICAL ANALYSES PERFORMED:Descriptive statistics and qualitative content analysis. RESULTS:Overall, 80/230 (35%) eligible patients who were approached consented to participate (mean±SD age 61.5±12.6 years). Retention was 93% and 98% in the intervention and control groups, respectively, and 96% of all planned intervention calls were completed. All participants in the intervention arm identified the tailored text messages as useful in supporting dietary self-management. In the control group, 27 (69%) reported the non-tailored text messages were useful in supporting change. Intervention group participants reported that the telehealth programme delivery methods were practical and able to be integrated into their lifestyle. Participants viewed the intervention as an acceptable, personalised alternative to face-face clinic consultations, and were satisfied with the frequency of contact. CONCLUSIONS:This telehealth-delivered dietary coaching programme is an acceptable intervention which appears feasible for supporting dietary self-management in stage 3-4 CKD. A larger-scale randomised controlled trial is needed to evaluate the efficacy of the coaching programme on clinical and patient-reported outcomes. TRIAL REGISTRATION NUMBER:ACTRN12616001212448; Results.

Dataset Information

Applying a mixed-methods evaluation to Healthy Kids, Healthy Communities.

Publications

Applying a mixed-methods evaluation to Healthy Kids, Healthy Communities.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets