Complexity and Community Context: Learning from the Evaluation Design of a National Community Empowerment Programme.
Ontology highlight
ABSTRACT:
SUBMITTER: South J
PROVIDER: S-EPMC6981559 | biostudies-literature | 2019 Dec
REPOSITORIES: biostudies-literature
Publications
Complexity and Community Context: Learning from the Evaluation Design of a National Community Empowerment Programme.
South Jane J Button Daniel D Quick Annie A Bagnall Anne-Marie AM Trigwell Joanne J Woodward Jenny J Coan Susan S Southby Kris K
International journal of environmental research and public health 20191221 1
Community empowerment interventions, which aim to build greater individual and community control over health, are shaped by the community systems in which they are implemented. Drawing on complex systems thinking in public health research, this paper discusses the evaluation approach used for a UK community empowerment programme focused on disadvantaged neighbourhoods. It explores design choices and the tension between the overall enquiry questions, which were based on a programme theory of chan ...[more]
Similar Datasets
Project description:Community-based conservation (CBC) promotes the idea that conservation success requires engaging with, and providing benefits for, local communities. However, CBC projects are neither consistently successful nor free of controversy. Innovative recent studies evaluating the factors associated with success and failure typically examine only a single resource domain, have limited geographic scope, consider only one outcome, or ignore the nested nature of socioecological systems. To remedy these issues, we use a global comparative database of CBC projects identified by systematic review to evaluate success in four outcome domains (attitudes, behaviors, ecological, economic) and explore synergies and trade-offs among these outcomes. We test hypotheses about how features of the national context, project design, and local community characteristics affect these measures of success. Using bivariate analyses and multivariate proportional odds logistic regressions within a multilevel analysis and model-fitting framework, we show that project design, particularly capacity-building in local communities, is associated with success across all outcomes. In addition, some characteristics of the local community in which projects are conducted, such as tenure regimes and supportive cultural beliefs and institutions, are important for project success. Surprisingly, there is little evidence that national context systematically influences project outcomes. We also find evidence of synergies between pairs of outcomes, particularly between ecological and economic success. We suggest that well-designed and implemented projects can overcome many of the obstacles imposed by local and national conditions to succeed in multiple domains.
| S-EPMC3535631 | biostudies-literature
Project description:BackgroundCOPD is the most prevalent chronic respiratory disease in China. It is estimated that there is a large, as-yet undetected, high-risk population who will develop in COPD in future.Methods and designIn this context, a nationwide COPD screening programme was launched on 9 October 2021. This multistage sequential screening programme incorporates a previously validated questionnaire (i.e. COPD Screening Questionnaire) and pre- and post-bronchodilator spirometry to target the COPD high-risk population. The programme plans to recruit 800 000 participants (eligible age 35-75 years) from 160 districts or counties of 31 provinces, autonomous regions or municipalities across China. The filtered COPD high-risk population and early-detected COPD patients will receive integrated management and be followed-up for ≥1 year.DiscussionThis is the first large-scale prospective study to determine the net benefit of mass screening for COPD in China. Whether the smoking cessation rate, morbidity, mortality and health status of individuals at high risk of COPD could be improved along with this systematic screening programme will be observed and validated. Moreover, the diagnostic accuracy, cost-effectiveness and superiority of the screening programme will also be assessed and discussed. The programme marks a remarkable achievement in the management of chronic respiratory disease in China.
| S-EPMC10123511 | biostudies-literature
Project description:Logic models (LMs) have been used in programme evaluation for over four decades. Current debate questions the ability of logic modelling techniques to incorporate contextual factors into logic models. We share experience of developing a logic model within an ongoing realist evaluation which assesses the extent to which, and under what circumstances a community health workers (CHW) programme promotes access to maternity services in Nigeria. The article contributes to logic modelling debate by: i) reflecting on how other scholars captured context during LM development in theory-driven evaluations; and ii) explaining how we explored context during logic model development for realist evaluation of the CHW programme in Nigeria. Data collection methods that informed our logic model development included documents review, email discussions and teleconferences with programme stakeholders and a technical workshop with researchers to clarify programme goals and untangle relationships among programme elements. One of the most important findings is that, rather than being an end in itself, logic model development is an essential step for identifying initial hypotheses for tentative relevant contexts, mechanisms and outcomes (CMOs) and CMO configurations of how programmes produce change. The logic model also informed development of a methodology handbook that is guiding verification and consolidation of underlying programme theories.
| S-EPMC6403102 | biostudies-literature
Project description:BackgroundChildhood behavioural problems are the most common mental health disorder worldwide and represent a major public health concern, particularly in socially disadvantaged communities. Treatment barriers mean that up to 70% of children do not receive recommended parenting interventions. Innovative approaches, including evidence-based peer-led models, such as Empowering Parents Empowering Communities' (EPEC) Being a Parent (BAP) programme, have the potential to reduce childhood difficulties and improve parenting if replicable and successfully delivered at scale.MethodThis real-world quasi-experimental study, with embedded RCT benchmarking, examined the population reach, attendance, acceptability and outcomes of 128 BAP groups (n = 930 parents) delivered by 15 newly established sites participating in a UK EPEC scaling programme.ResultsScaling programme (SP) sites successfully reached parents living in areas of greater social deprivation (n = 476, 75.3%), experiencing significant disadvantage (45.0% left school by 16; 39.9% lived in rental accommodation; 36.9% lone parents). The only benchmarked demographic difference was ethnicity, reflecting the greater proportion of White British parents living in scaling site areas (SP 67.9%; RCT 22.4%). Benchmark comparisons showed scaling sites' parent group leaders achieved similar levels of satisfaction. Scaling site parent participants reported substantial levels of improvement in child concerns (ES 0.6), parenting (ES 0.9), parenting goals (ES 1.2) and parent wellbeing (ES 0.6) that were of similar magnitude to RCT benchmarked results. Though large, parents reported lower levels of parenting knowledge and confidence acquisition compared with the RCT benchmark.ConclusionDespite common methodological limitations associated with real-world scaling evaluations, findings suggest that this peer-led, community-based, parenting approach may be capable of successful replication at scale and may have considerable potential to improve child and parenting difficulties, particularly for socially disadvantaged populations.
| S-EPMC9295349 | biostudies-literature
Project description:Transfer learning (TL) techniques can enable effective learning in data scarce domains by allowing one to re-purpose data or scientific knowledge available in relevant source domains for predictive tasks in a target domain of interest. In this Data in Brief article, we present a synthetic dataset for binary classification in the context of Bayesian transfer learning, which can be used for the design and evaluation of TL-based classifiers. For this purpose, we consider numerous combinations of classification settings, based on which we simulate a diverse set of feature-label distributions with varying learning complexity. For each set of model parameters, we provide a pair of target and source datasets that have been jointly sampled from the underlying feature-label distributions in the target and source domains, respectively. For both target and source domains, the data in a given class and domain are normally distributed, where the distributions across domains are related to each other through a joint prior. To ensure the consistency of the classification complexity across the provided datasets, we have controlled the Bayes error such that it is maintained within a range of predefined values that mimic realistic classification scenarios across different relatedness levels. The provided datasets may serve as useful resources for designing and benchmarking transfer learning schemes for binary classification as well as the estimation of classification error.
| S-EPMC9011006 | biostudies-literature
Project description:Despite the positive outcomes obtained through the application of gamification in the technology-enhanced learning context, previous studies have also reported unexpected results concerning students’ engagement, learning outcomes, and motivation in gamified learning systems. To increase the chances of obtaining positive results in this context, this article proposes a “gamification analytics model for teachers”. In this model, teachers are allowed to define interaction goals, monitor students’ interaction with the system’ learning resources and the gamification elements, and adapt the gamification design through missions to motivate disengaged students to achieve the interaction goals defined. However, the gamification analytics model-based design concepts that will be implemented to support the learning process should be well-planned to teachers’ needs. Hence, one of the contributions of this paper is the validation of twenty design concepts based on the gamification analytics model for teachers by using the speed dating method. Our results suggest that teachers judged useful/relevant visualize students’ interaction with gamification elements such as missions, levels to help them understand the students’ status, but did not evaluate the visualization of the interaction of students with trophies relevant. Teachers also highly evaluated the creation of personalized missions for a student or a specific group as relevant to help demotivated students to engage and achieve the desired goals. Therefore, this study provides some relevant insights to guide the design and re-design of gamified adaptive learning systems.
| S-EPMC7334171 | biostudies-literature
Project description:ObjectivesStakeholder co-production in design of public health programmes may reduce the 'implementation gap' but can be time-consuming and costly. Prototyping, iterative refining relevant to delivery context, offers a potential solution. This evaluation explored implementation and lessons learnt for a 12-week referral-based weight-management programme, 'Momenta', along with feasibility of an iterative prototyping evaluation framework.DesignMixed methods evaluation: Qualitative implementation exploration with referrers and service users; preliminary analysis of anonymised quantitative service data (12 and 52 weeks).SettingTwo leisure centres in Northumberland, North East England.ParticipantsIndividual interviews with referring professionals (n=5) and focus groups with service users (n=13). Individuals (n=182) referred by healthcare professionals (quantitative data).InterventionsThree 12-week programme iterations: Momenta (n=59), Momenta-Fitness membership (n=58) and Fitness membership only (n=65).Primary and secondary outcome measuresPrimary outcome: Qualitative themes developed through stakeholder-engagement. Secondary outcomes included preliminary exploration of recruitment, uptake, retention, and changes in weight, body mass index, waist circumference and psychological well-being.ResultsService users reported positive experiences of Momenta. Implementation gaps were revealed around the referral process and practitioner knowledge. Prototyping enabled iterative refinements such as broadening inclusion criteria. Uptake and 12-week retention were higher for Momenta (84.7%, 45.8%) and Momenta-Fitness (93.1%, 60.3%) versus Fitness only (75.4%, 24.6%). Exploration of other preliminary outcomes (completers only) suggested potential for within-group weight loss and increased psychological well-being for Momenta and Momenta-Fitness at 12 weeks. 52 week follow-up data were limited (32%, 33% and 6% retention for those who started Momenta, Momenta-Fitness and Fitness, respectively) but suggested potential weight loss maintenance for Momenta-Fitness.ConclusionsIdentification of issues within the referral process enabled real-time iterative refinement, while lessons learnt may be of value for local implementation of 'off-the-shelf' weight management packages more generally. Our preliminary data for completers suggest Momenta may have potential for weight loss, particularly when offered with a fitness membership.
| S-EPMC6830698 | biostudies-literature
Project description:BackgroundIn an attempt to address a complex disease burden, including improving progress towards MDGs 4 and 5, South Africa recently introduced a re-engineered Primary Health Care (PHC) strategy, which has led to the development of a national community health worker (CHW) programme. The present study explored the development of a cell phone-based and paper-based monitoring and evaluation (M&E) system to support the work of the CHWs.MethodsOne sub-district in the North West province was identified for the evaluation. One outreach team comprising ten CHWs maintained both the paper forms and mHealth system to record household data on community-based services. A comparative analysis was done to calculate the correspondence between the paper and phone records. A focus group discussion was conducted with the CHWs. Clinical referrals, data accuracy and supervised visits were compared and analysed for the paper and phone systems.ResultsCompared to the mHealth system where data accuracy was assured, 40% of the CHWs showed a consistently high level (>90% correspondence) of data transfer accuracy on paper. Overall, there was an improvement over time, and by the fifth month, all CHWs achieved a correspondence of 90% or above between phone and paper data. The most common error that occurred was summing the total number of visits and/or activities across the five household activity indicators. Few supervised home visits were recorded in either system and there was no evidence of the team leader following up on the automatic notifications received on their cell phones.ConclusionsThe evaluation emphasizes the need for regular supervision for both systems and rigorous and ongoing assessments of data quality for the paper system. Formalization of a mHealth M&E system for PHC outreach teams delivering community based services could offer greater accuracy of M&E and enhance supervision systems for CHWs.
| S-EPMC4150556 | biostudies-literature
Project description:BackgroundIntegrated community case management (iCCM) is a community-based child health strategy designed to reduce deaths due to pneumonia, malaria, and diarrhea in low-income countries. Due to the integrated nature of the intervention and the diversity of its stakeholders and activities, iCCM is complex and comprises many systems elements. However, the extent to which studies examine these different elements is unknown. The purpose of this scoping review is to summarize the key areas of emphasis of the iCCM literature and assess the extent to which this takes into account systems complexity.MethodsThis study will be guided by Arksey and O'Malley's scoping review methodology. We will systematically screen MEDLINE, Web of Science, and the specialized platform Community Case Management (CCM) Central Library for published literature in English related to the design, implementation, and evaluation of iCCM. Two investigators will independently screen the full list of titles and abstracts for eligibility, followed by a full-text review of selected titles divided between investigators. Emergent themes will be categorized according to a thematic tool iteratively developed to guide the charting and analysis process. To compare the extent to which the literature assesses systems factors, we will compare our results with the iCCM Interagency Framework. We will use the Intervention Complexity Tool for Systematic Reviews (iCAT_SR) to assess how literature measures complexity. Results will be presented in narrative fashion, supplemented by interactive graphical interfaces.DiscussionThe results of this scoping review will identify the priorities and deficiencies of the analysis and evaluation of iCCM programs and may illustrate the need for systems approaches. Bottom-up emergent iCCM themes can help researchers, policymakers, and implementers target and better emphasize true priorities of iCCM. Understanding how complexity is considered and examined in iCCM may result in greater attention to this critical dimension of iCCM program assessment, resulting in the design and development of more robust and sustainable iCCM programs.
| S-EPMC7469364 | biostudies-literature
Project description:We evaluated the impact of integrated community case management of childhood illness (iCCM) on careseeking for childhood illness and child mortality in Malawi, using a National Evaluation Platform dose-response design with 27 districts as units of analysis. "Dose" variables included density of iCCM providers, drug availability, and supervision, measured through a cross-sectional cellular telephone survey of all iCCM-trained providers. "Response" variables were changes between 2010 and 2014 in careseeking and mortality in children aged 2-59 months, measured through household surveys. iCCM implementation strength was not associated with changes in careseeking or mortality. There were fewer than one iCCM-ready provider per 1,000 under-five children per district. About 70% of sick children were taken outside the home for care in both 2010 and 2014. Careseeking from iCCM providers increased over time from about 2% to 10%; careseeking from other providers fell by a similar amount. Likely contributors to the failure to find impact include low density of iCCM providers, geographic targeting of iCCM to "hard-to-reach" areas although women did not identify distance from a provider as a barrier to health care, and displacement of facility careseeking by iCCM careseeking. This suggests that targeting iCCM solely based on geographic barriers may need to be reconsidered.
| S-EPMC4775894 | biostudies-literature