Dataset Information

Evaluating the scaling up of an effective implementation intervention (PACE) to increase the delivery of a mandatory physical activity policy in primary schools.

ABSTRACT:

Background

Physically Active Children in Education (PACE) is an effective implementation intervention for increasing the number of minutes classroom teachers schedule physical activity each week. To date, evaluations of PACE have included a smaller number of schools from only one region in New South Wales Australia. If PACE is to have population-wide benefits we must be able to deliver this support to a larger number of schools across multiple regions. This study aimed to evaluate the scale-up of PACE.

Methods

An uncontrolled before and after study, with 100 schools from three regions was conducted. Participating schools received PACE for approximately 12 months. We assessed the following outcomes: delivery of the evidence-based intervention (EBI) (i.e. minutes of physical activity scheduled by classroom teachers per week); delivery of the implementation strategies (i.e. reach, dose delivered, adherence and indicators of sustainability); and key determinants of implementation (i.e. acceptability of strategies and cost). Data were collected via project officer records, and principal and teacher surveys. Linear mixed models were used to assess EBI delivery by evaluating the difference in the mean minutes teachers scheduled physical activity per week from baseline to follow-up. Descriptive data were used to assess delivery of the implementation strategies and their perceived acceptability (i.e. PACE). A prospective, trial-based economic evaluation was used to assess cost.

Results

Delivery of the EBI was successful: teachers increas their average minutes of total physical activity scheduled across the school week by 26.8 min (95% CI: 21.2, 32.4, p < 0.001) after receiving PACE. Indicators for delivery of implementation strategies were high: 90% of consenting schools received all strategies and components (reach); 100% of strategies were delivered by the provider (dose); >50% of schools adhered to the majority of strategies (11 of the 14 components); and acceptability was > 50% agreement for all strategies. The incremental cost per additional minute of physical activity scheduled per week was $27 per school (Uncertainty Interval $24, $31).

Conclusions

PACE can be successfully delivered across multiple regions and to a large number of schools. Given the ongoing and scalable benefits of PACE, it is important that we continue to extend and improve this program while considering ways to reduce the associated cost.

SUBMITTER: Hall A

PROVIDER: S-EPMC10481546 | biostudies-literature | 2023 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evaluating the scaling up of an effective implementation intervention (PACE) to increase the delivery of a mandatory physical activity policy in primary schools.

Hall Alix A Lane Cassandra C Wolfenden Luke L Wiggers John J Sutherland Rachel R McCarthy Nicole N Jackson Rebecca R Shoesmith Adam A Lecathelinais Christophe C Reeves Penny P Bauman Adrian A Gillham Karen K Boyer James J Naylor Patti-Jean PJ Kerr Nicola N Kajons Nicole N Nathan Nicole N

The international journal of behavioral nutrition and physical activity 20230906 1

<h4>Background</h4>Physically Active Children in Education (PACE) is an effective implementation intervention for increasing the number of minutes classroom teachers schedule physical activity each week. To date, evaluations of PACE have included a smaller number of schools from only one region in New South Wales Australia. If PACE is to have population-wide benefits we must be able to deliver this support to a larger number of schools across multiple regions. This study aimed to evaluate the sc ...[more]

PMID: 37674213

Similar Datasets

Project description:BackgroundThe implementation of interventions at-scale is required to maximise population health benefits. 'Physical Activity 4 Everyone (PA4E1)' was a multi-component school-based program targeting adolescents attending secondary schools in low socio-economic areas. An efficacy trial of the intervention demonstrated an increase in students' mean minutes of moderate-to-vigorous physical activity (MVPA) per day and lower weight gain at low incremental cost. This study aims to assess the effectiveness and cost effectiveness of a multi-component implementation support intervention to improve implementation, at-scale, of the evidence based school physical activity (PA) practices of the PA4E1 program. Impact on student PA levels and adiposity will also be assessed, in addition to the cost of implementation.MethodsA cluster randomised controlled trial, utilising an effectiveness-implementation hybrid design, will be conducted in up to 76 secondary schools located in lower socio-economic areas across four health districts in New South Wales (NSW), Australia. Schools will be randomly allocated to a usual practice control arm or a multi-component implementation support intervention to embed the seven school PA practices of the PA4E1 program. The implementation support intervention incorporates seven strategies including executive support, in-School Champion, teacher training, resources, prompts, audit and feedback and access to an external Support Officer. The primary trial outcome will be the proportion of schools meeting at least four of the seven physical activity practices of the program, assessed via surveys with Head Physical Education teachers at 12 and 24-months. Secondary outcomes will be assessed via a nested evaluation of student PA and adiposity at 12-months (Grade 8 students) and 24 months (Grade 9 students) undertaken in 30 schools (15 per group). Resource use associated with the implementation intervention will be measured prospectively. Linear mixed effects regression models will assess program effects on the primary outcome at each follow-up period.DiscussionThis study is one of few evidence-based multi-component PA programs scaled-up to a large number of secondary schools and evaluated via randomised controlled trial. The use of implementation science theoretical frameworks to implement the evidence-based program and the rigorous evaluation design are strengths of the study.Trial registrationAustralian New Zealand Clinical Trials Registry ACTRN12617000681358 registered 12th May 2017. Protocol Version 1.

Project description:BackgroundCOVID-19 increased the demand for Remote Patient Monitoring (RPM) services as a rapid solution for safe patient follow-up in a lockdown context. Time and resource constraints resulted in unplanned scaled-up RPM pilot initiatives posing risks to the access and quality of care. Scalability and rapid implementation of RPM services require social change and active collaboration between stakeholders. Therefore, a participatory action research (PAR) approach is needed to support the collaborative development of the technological component while simultaneously implementing and evaluating the RPM service through critical action-reflection cycles.ObjectiveThis study aims to demonstrate how PAR can be used to guide the scalability design of RPM pilot initiatives and the implementation of RPM-based follow-up services.MethodsUsing a case study strategy, we described the PAR team's (nurses, physicians, developers, and researchers) activities within and across the four phases of the research process (problem definition, planning, action, and reflection). Team meetings were analyzed through content analysis and descriptive statistics. The PAR team selected ex-ante pilot initiatives to reflect upon features feedback and participatory level assessment. Pilot initiatives were investigated using semi-structured interviews transcribed and coded into themes following the principles of grounded theory and pilot meetings minutes and reports through content analysis. The PAR team used the MoSCoW prioritization method to define the set of features and descriptive statistics to reflect on the performance of the PAR approach.ResultsThe approach involved two action-reflection cycles. From the 15 features identified, the team classified 11 as must-haves in the scaled-up version. The participation was similar among researchers (52.9%), developers (47.5%), and physicians (46.7%), who focused on suggesting and planning actions. Nurses with the lowest participation (5.8%) focused on knowledge sharing and generation. The top three meeting outcomes were: improved research and development system (35.0%), socio-technical-economic constraints characterization (25.2%), and understanding of end-user technology utilization (22.0%).ConclusionThe scalability and implementation of RPM services must consider contextual factors, such as individuals' and organizations' interests and needs. The PAR approach supports simultaneously designing, developing, testing, and evaluating the RPM technological features, in a real-world context, with the participation of healthcare professionals, developers, and researchers.

Project description:BackgroundThe ATICA study was a Hybrid I type randomized effectiveness-implementation trial that demonstrated effectiveness of a multicomponent mHealth intervention (Up to four SMS messages sent to HPV-positive women, and one SMS message to CHWs to prompt a visit of women with no triage Pap 60 days after a positive-test), to increase adherence to triage of HPV positive women (ATICA Study). We report data on perceptions of health decision-makers and health-care providers regarding the intervention implementation and scaling-up.MethodsA qualitative study was carried out based on individual, semi-structured interviews with health decision-makers (n = 10) and health-care providers (n = 10). The themes explored were selected and analyzed using domains and constructs of the Consolidated Framework for Implementation Research (CFIR) and the maintenance dimension of the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework.ResultsBoth health-care providers and decision-makers had a positive assessment of the intervention through most included constructs: knowledge of the intervention, intervention source, design quality, adaptability, compatibility, access to knowledge and information, relative advantage, women's needs, and relative priority. However, some potential barriers were also identified including: complexity, leadership engagement, external policies, economic cost, women needs and maintenance. Stakeholders conditioned the strategy's sustainability to the political commitment of national and provincial health authorities to prioritize cervical cancer prevention, and to the establishment of the ATICA strategy as a programmatic line of work by health authorities. They also highlighted the need to ensure, above all, that there was staff to take Pap tests and carry out the HPV-lab work, and to guarantee a constant provision of HPV-tests.ConclusionHealth decision-makers and health-care providers had a positive perception regarding implementation of the multicomponent mHealth intervention designed to increase adherence to triage among women with HPV self-collected tests. This increases the potential for a successful scaling-up of the intervention, with great implications not only for Argentina but also for middle and low-income countries considering using mHealth interventions to enhance the cervical screening/follow-up/treatment process.

Project description:BackgroundDespite increased resources over the past few years the coverage of malaria control interventions is still inadequate to reach national and international targets and achieve the full potential of the interventions to improve population health. One of the reasons for this inadequate coverage of efficacious interventions is the limited understanding of the optimum delivery systems of the interventions in different contexts. Although there have been debates about how to deliver interventions, the methods for evaluating the effectiveness of different delivery systems have rarely been discussed. Delivery of interventions is relatively complex and a thorough evaluation would need to look holistically at multiple steps in the delivery process and at multiple factors influencing the process. A better understanding of the strength of the evidence on delivery system effectiveness is needed in order to optimise delivery of efficacious interventions.MethodsA literature review was conducted of methods used to evaluate delivery systems for insecticide treated nets, intermittent preventive treatment in pregnant women, and treatment for malaria in children.ResultsThe methodology of delivery system evaluations varied. There were inconsistencies between objectives and methods of the evaluations including inappropriate outcome measures and unnecessary controls. There were few examples where the delivery processes were adequately described, or measured. We propose a cross sectional observational study design with attribution of the outcomes to a specific delivery system as an appropriate method for evaluating delivery systems at scale.ConclusionsThe proposed evaluation framework is adaptable to natural experiments at scale, and can be applied using data from routine surveys such as the Demographic and Health Surveys, modified by the addition of one to two questions for each intervention. This framework has the potential to enable wider application of rigorous evaluations and thereby improve the evidence base on which decisions about delivery systems for malaria control and other public health interventions are taken.

Project description:BackgroundPhysically Active Children in Education (PACE) is composed of eight implementation strategies that improves schools' implementation of a government physical activity policy. A greater understanding of each discrete implementation strategy could inform improvements to PACE for delivery at-scale. This study aimed to: (A) measure the dose delivered, fidelity, adoption and acceptability of each strategy using quantitative data; (B) identify implementation barriers and facilitators using qualitative data; and (C) explore the importance of each strategy by integrating both data sets (mixed methods).MethodsThis study used data from a cluster randomised noninferiority trial comparing PACE with an adapted version (Adapted PACE) that was delivered with reduced in-person external support to reduce costs and increase scalability. Data were collected from both trials arms for between-group comparison. Descriptive statistics were produced using surveys of principals, in-school champions and teachers; and project records maintained by PACE project officers (objective A). Thematic analysis was performed using in-school champion and project officer interviews (objective B). Both data sets were integrated via a triangulation protocol and findings synthesized in the form of meta-inferences (objective C).ResultsEleven in-school champions and six project officers completed interviews; 33 principals, 51 in-school champions and 260 teachers completed surveys. Regardless of group allocation, implementation indicators were high for at least one component of each strategy: dose delivered =100%, fidelity ≥95%, adoption ≥83%, acceptability ≥50%; and several implementation barriers and facilitators were identified within three broad categories: external policy landscape, inner organizational structure/context of schools, and intervention characteristics and processes. All strategies were considered important as use varied by school, however support from a school executive and in-school champions' interest were suggested as especially important for optimal implementation.ConclusionThis study highlights the importance of both executive support and in-school champions for successful implementation of school physical activity policies. In particular, identifying and supporting an in-school champion to have high power and high interest is recommended for future implementation strategies. This may reduce the need for intensive external support, thus improving intervention scalability.

Project description:ObjectiveTo determine whether two specific criteria in Uniform Requirements for Manuscripts (URM) created by the International Committee of Medical Journal Editors (ICMJE)--namely, including the trial ID registration within manuscripts and timely registration of trials, are being followed.Materials and methodsObservational study using computerized analysis of publicly available Medline article data and clinical trial registry data. We analyzed a purposive set of five ICMJE founding journals looking at all trial articles published in those journals during 2010-2011, and data from the ClinicalTrials.gov (CTG) trial registry. We measured adherence to trial ID inclusion policy as the percentage of trial journal articles that contained a valid trial ID within the article (journal-based sample). Adherence to timely registration was measured as the percentage of trials that registered the trial before enrolling the first participant within a 60-day grace period. We also examined timely registration rates by year of all phase II and higher interventional trials in CTG (registry-based sample).ResultsTo determine trial ID inclusion, we analyzed 698 clinical trial articles in five journals. A total of 95.8% (661/690) of trial journal articles included the trial ID. In 88.3% the trial-article link is stored within a structured Medline field. To evaluate timely registration, we analyzed trials referenced by 451 articles from the selected five journals. A total of 60% (272/451) of articles were registered in a timely manner with an improving trend for trials initiated in later years (eg, 89% of trials that began in 2008 were registered in a timely manner). In the registry-based sample, the timely registration rates ranged from 56% for trials registered in 2006 to 72% for trials registered in 2011.DiscussionAdherence to URM requirements for registration and trial ID inclusion increases the utility of PubMed and links it in an important way to clinical trial repositories. This new integrated knowledge source can facilitate research prioritization, clinical guidelines creation, and precision medicine.ConclusionsThe five selected journals adhere well to the policy of mandatory trial registration and also outperform the registry in adherence to timely registration. ICMJE's URM policy represents a unique international mandate that may be providing a powerful incentive for sponsors and investigators to document clinical trials and trial result publications and thus fulfill important obligations to trial participants and society.

Dataset Information

Evaluating the scaling up of an effective implementation intervention (PACE) to increase the delivery of a mandatory physical activity policy in primary schools.

Background

Methods

Results

Conclusions

Publications

Evaluating the scaling up of an effective implementation intervention (PACE) to increase the delivery of a mandatory physical activity policy in primary schools.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets