Dataset Information

External validity in healthy public policy: application of the RE-AIM tool to the field of housing improvement.

ABSTRACT:

Background

Researchers and publishers have called for improved reporting of external validity items and for testing of existing tools designed to assess reporting of items relevant to external validity. Few tools are available and most of this work has been done within the field of health promotion.

Methods

We tested a tool assessing reporting of external validity items which was developed by Green & Glasgow on 39 studies assessing the health impacts of housing improvement. The tool was adapted to the topic area and criteria were developed to define the level of reporting, e.g. "some extent". Each study was assessed by two reviewers.

Results

The tool was applicable to the studies but some items required considerable editing to facilitate agreement between the two reviewers. Levels of reporting of the 17 external validity items were low (mean 6). The most commonly reported items related to outcomes. Details of the intervention were poorly reported. Study characteristics were not associated with variation in reporting.

Conclusions

The Green & Glasgow tool was useful to assess reporting of external validity items but required tailoring to the topic area. In some public health evaluations the hypothesised impact is dependent on the intervention effecting change, e.g. improving socio-economic conditions. In such studies data confirming the function of the intervention may be as important as details of the components and implementation of the intervention.

SUBMITTER: Thomson HJ

PROVIDER: S-EPMC3481477 | biostudies-literature | 2012 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

External validity in healthy public policy: application of the RE-AIM tool to the field of housing improvement.

Thomson Hilary J HJ Thomas Sian S

BMC public health 20120809

<h4>Background</h4>Researchers and publishers have called for improved reporting of external validity items and for testing of existing tools designed to assess reporting of items relevant to external validity. Few tools are available and most of this work has been done within the field of health promotion.<h4>Methods</h4>We tested a tool assessing reporting of external validity items which was developed by Green & Glasgow on 39 studies assessing the health impacts of housing improvement. The to ...[more]

PMID: 22877499

Similar Datasets

Project description:ObjectivesThe purpose of this review was to use RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) to assess the extent to which weight gain prevention studies targeting young adults reported on elements of external validity.DesignSystematic review.Eligibility criteriaArticles of interest included a lifestyle/behavioral intervention targeting weight gain prevention. Eligibility criteria included the following: study design of randomized controlled trials, quasi-randomized control trials, or natural experiments; average participant age between 18 and 35 years; study duration of at least 12 months; and published in English between January 2008 and May 2018. Studies had to report weight or body mass index as a measured outcome and were excluded if they were paired with smoking cessation programs, were conducted in specific groups (ie, pregnant women, breast cancer survivors), or were follow-ups to weight loss studies.Study selectionAfter removing duplicates, the search yielded 11426 articles. Titles and abstracts were screened by 1 reviewer; 144 articles were assessed in a full-text review by 2 reviewers. Discrepancies were resolved by consensus. Nine studies (13 articles) were included in the review.Main outcomes measuresReported elements of the RE-AIM framework.ResultsA total of 9 studies met the selection criteria. All studies lacked full reporting on external validity elements. Of the total of 60 RE-AIM reporting criteria, 8 were reported by all 9 studies, 26 criteria were reported by fewer than 4 studies, and 22 criteria were not reported by any of the studies.DiscussionThere remains inadequate reporting of elements of external validity and generalizability in weight gain prevention studies. This is a significant scientific constraint that limits the information required to disseminate and implement prevention of weight gain interventions for population impact. Standardized reporting may be needed to ensure results that demonstrate not only internal validity but also external validity and generalizability are needed to promote public health impact.

Project description:BackgroundSmoke-free housing policies in multiunit housing are increasingly widespread interventions to reduce smoking and secondhand smoke exposure. Little research has identified factors that impede compliance with smoke-free housing policies in low-income multiunit housing and test corresponding solutions.MethodsWe are using an experimental design to test two compliance support interventions: (A) a "compliance through reduction (via relocation and reduction in personal smoking) and cessation" intervention targets households with smokers and involves support to shift smoking practices to areas beyond the apartment or building setting, reduce personal smoking, and deliver in-residence smoking cessation support services via trained peer educators and (B) a "compliance through resident endorsement" intervention involving voluntary adoption of smoke-free living environments through personal pledges, visible door markers, and/or via social media. We will compare randomly sampled participants in buildings that receive A or B or A plus B to the NYCHA standard approach.DiscussionThis RCT addresses key gaps in knowledge and capitalizes on key scientific opportunities by (1) leveraging the federal mandate to ban smoking in a public housing system of more than sufficient size to conduct an adequately powered RCT; (2) expanding our understanding of smoke-free policy compliance beyond policy implementation by testing two novel treatments: (a) in-residence smoking cessation and (b) resident endorsement, while (3) addressing population and location-specific tobacco-related disparities. At the conclusion of the study, this RCT will have leveraged a monumental policy shift affecting nearly half a million NYC public housing residents, many of whom disproportionately experience chronic illness and are more likely to smoke and be exposed to secondhand smoke than other city residents. This first-ever RCT will test the effects of much-needed compliance strategies on resident smoking behavior and secondhand smoke exposure in multiunit housing.Trial registrationClinical Trials Registered, NCT05016505. Registered on August 23, 2021.

Project description:ImportanceSecondhand smoke (SHS) exposure is associated with many health conditions in children and adults. Millions of individuals in the US are currently exposed to SHS in their homes.ObjectiveTo investigate whether a federal ban on smoking in public housing settings was associated with a decrease in indoor SHS levels in New York City public housing developments 12 months after the policy's implementation.Design, setting, and participantsThis cohort study tracked indoor air quality longitudinally from April 2018 to September 2019 and used difference-in-differences analysis to examine SHS exposure before vs after implementation of the 2018 federal smoke-free housing (SFH) policy in 10 New York City Housing Authority (NYCHA) buildings vs 11 matched low-income buildings not subject to the SFH policy (ie, Section 8 buildings).ExposuresFederal SFH policy implementation, beginning July 30, 2018.Main outcomes and measuresComparison of nicotine concentration levels from passive, bisulfate-coated filters before vs 12 months after implementation of the federal SFH policy. Secondary outcomes included changes in particulate matter less than 2.5 μm in diameter, measured with low-cost particle monitors, and counts of cigarette butts in common areas.ResultsAir quality was measured repeatedly in a total of 153 NYCHA and 110 Section 8 nonsmoking households as well as in 91 stairwells and hallways. Before the SFH policy implementation, air nicotine was detectable in 19 of 20 stairwells (95.0%) in NYCHA buildings and 15 of 19 stairwells (78.9%) in Section 8 buildings (P = .19) and in 17 of 19 hallways (89.5%) in NYCHA buildings and 14 of 23 hallways (60.9%) in Section 8 buildings (P = .004). Nicotine was detected less frequently inside nonsmoking apartments overall (26 of 263 [9.9%]) but more frequently in NYCHA apartments (20 of 153 [13.1%]) than in Section 8 apartments (6 of 110 [5.5%]) (P = .04). One year after policy implementation, there was no differential change over time in nicotine concentrations measured in stairwells (DID, 0.03 μg/m3; 95% CI, -0.99 to 1.06 μg/m3) or inside nonsmoking households (DID, -0.04 μg/m3; 95% CI, -0.24 to 0.15 μg/m3). Larger decreases in nicotine concentration were found in NYCHA hallways than in Section 8 hallways (DID, -0.43 μg/m3; 95% CI, -1.26 to 0.40 μg/m3).Conclusions and relevanceThe findings suggest that there was no differential change in SHS in NYCHA buildings 12 months after SFH policy implementation. Additional support may be needed to ensure adherence to SFH policies.

Project description:BackgroundMuch has been written about how the medical home model can enhance patient-centeredness, care continuity, and follow-up, but few comprehensive aids or resources exist to help practices accomplish these aims. The complexity of primary care can overwhelm those concerned with quality improvement.MethodsThe RE-AIM planning and evaluation model was used to develop a multimedia, multiple-health behavior tool with psychosocial assessment and feedback features to facilitate and guide patient-centered communication, care, and follow-up related to prevention and self-management of the most common adult chronic illnesses seen in primary care.ResultsThe Connection to Health Patient Self-Management System, a web-based patient assessment and support resource, was developed using the RE-AIM factors of reach (e.g., allowing input and output via choice of different modalities), effectiveness (e.g., using evidence-based intervention strategies), adoption (e.g., assistance in integrating the system into practice workflows and permitting customization of the website and feedback materials by practice teams), implementation (e.g., identifying and targeting actionable priority behavioral and psychosocial issues for patients and teams), and maintenance/sustainability (e.g., integration with current National Committee for Quality Assurance recommendations and clinical pathways of care). Connection to Health can work on a variety of input and output platforms, and assesses and provides feedback on multiple health behaviors and multiple chronic conditions frequently managed in adult primary care. As such, it should help to make patient-healthcare team encounters more informed and patient-centered. Formative research with clinicians indicated that the program addressed a number of practical concerns and they appreciated the flexibility and how the Connection to Health program could be customized to their office.ConclusionsThis primary care practice tool based on an implementation science model has the potential to guide patients to more healthful behaviors and improved self-management of chronic conditions, while fostering effective and efficient communication between patients and their healthcare team. RE-AIM and similar models can help clinicians and media developers create practical products more likely to be widely adopted, feasible in busy medical practices, and able to produce public health impact.

Project description:Background: Explored the role of public health centers in the delivery of physical activity programs to older Brazilians. Methods: Total of 114 older adults (81% women) from public health centers across the city of Florianopolis, Brazil, were randomized into three groups: behavior change group (n = 36), traditional exercise group (n = 52), and control group (n = 26). The behavioral change group included 12 weekly meetings (2 h each). The traditional exercise group offered a 12-week exercise class. Individuals in the control group participated only in measurements. Program evaluation included a mixed-methods approach following the RE-AIM framework (reach, effectiveness, adoption, implementation, and maintenance). Trained interviewers conducted 12 focus groups and 32 interviews with participants in the program, professionals delivering the programs, community health workers, and local and city administrators overseeing public health centers. Participants completed health, quality of life, and fitness assessments at four time points. Results: The study reached 11.5% of the eligible population in the community. Older adults' resistance to change and limited understanding of behavior change science by public health center staff hindered program reach. Physician encouraging patient participation and personal invitations by community health workers were perceived as favorable factors. Results of program effectiveness and maintenance suggest that behavior change strategies may be better suited than traditional exercise classes for decreasing sedentary time and increasing moderate-to-vigorous physical activity, as well as improving participants' quality of life. Only 14% of public health centers in the city adopted the programs. Heavy workload of health educators delivering the programs and limited physical space for program delivery were barriers for adoption. The fidelity of program delivery was high and indicates that the programs are culturally-appropriate for the Brazilian context and feasible for implementation by local health educators. Conclusions: Our findings support the potential for dissemination of behavior change and traditional exercise programs to older adults through public health centers in Brazil. REBEC: RBR-9pkxn2 (retrospectively registered) Register April 20, 2019.

Dataset Information

External validity in healthy public policy: application of the RE-AIM tool to the field of housing improvement.

Background

Methods

Results

Conclusions

Publications

External validity in healthy public policy: application of the RE-AIM tool to the field of housing improvement.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets