Dataset Information

Alpha test results for a Housing First eLearning strategy: the value of multiple qualitative methods for intervention design.

ABSTRACT: Background:Detailed descriptions of implementation strategies are lacking, and there is a corresponding dearth of information regarding methods employed in implementation strategy development. This paper describes methods and findings related to the alpha testing of eLearning modules developed as part of the Housing First Technical Assistance and Training (HFTAT) program's development. Alpha testing is an approach for improving the quality of a product prior to beta (i.e., real world) testing with potential applications for intervention development. Methods:Ten participants in two cities tested the modules. We collected data through (1) a structured log where participants were asked to record their experiences as they worked through the modules; (2) a brief online questionnaire delivered at the end of each module; and (3) focus groups. Results:The alpha test provided useful data related to the acceptability and feasibility of eLearning as an implementation strategy, as well as identifying a number of technical issues and bugs. Each of the qualitative methods used provided unique and valuable information. In particular, logs were the most useful for identifying technical issues, and focus groups provided high quality data regarding how the intervention could best be used as an implementation strategy. Conclusions:Alpha testing was a valuable step in intervention development, providing us an understanding of issues that would have been more difficult to address at a later stage of the study. As a result, we were able to improve the modules prior to pilot testing of the entire HFTAT. Researchers wishing to alpha test interventions prior to piloting should balance the unique benefits of different data collection approaches with the need to minimize burdens for themselves and participants.

SUBMITTER: Ahonen EQ

PROVIDER: S-EPMC5663117 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Alpha test results for a Housing First eLearning strategy: the value of multiple qualitative methods for intervention design.

Ahonen Emily Q EQ Watson Dennis P DP Adams Erin L EL McGuire Alan A

Pilot and feasibility studies 20171031

<h4>Background</h4>Detailed descriptions of implementation strategies are lacking, and there is a corresponding dearth of information regarding methods employed in implementation strategy development. This paper describes methods and findings related to the alpha testing of eLearning modules developed as part of the Housing First Technical Assistance and Training (HFTAT) program's development. Alpha testing is an approach for improving the quality of a product prior to beta (i.e., real world) te ...[more]

PMID: 29093826

Similar Datasets

Project description:BackgroundThis paper discusses the initial testing of the Housing First Training and Technical Assistance (HFTAT) Program, a multifaceted, distance-based strategy for the implementation of the Housing First (HF) supportive housing model. HF is a complex housing intervention for serving people living with serious mental illness and a substance use disorder that requires significant individual- and structural-level changes to implement. As such, the HFTAT employs a combined training and consultation approach to target different levels of the organization. Training delivered to all organizational staff focuses on building individual knowledge and uses narrative storytelling to overcome attitudinal implementation barriers. Consultation seeks to build skills through technical assistance and fidelity audit and feedback.MethodWe employed a mixed method design to understand both individual-level (e.g., satisfaction with the HFTAT, HF knowledge acquisition and retention, and HF acceptability and appropriateness) and structural-level (e.g., fidelity) outcomes. Quantitative data were collected at various time points, and qualitative data were collected at the end of HFTAT activities. Staff and administrators (n =?113) from three programs across three states participated in the study.ResultsSatisfaction with both training and consultation was high, and discussions demonstrated both activities were necessary. Flexibility of training modality and narrative storytelling were particular strengths, while digital badging and the community of practice were perceived as less valuable because of incompatibilities with the work context. HF knowledge was high post training and retained after 3-month follow-up. Participants reported training helped them better understand the model. Attitudes toward evidence-based interventions improved over 6 months, with qualitative data supporting this but demonstrating some minor concerns related to acceptability and appropriateness. Fidelity scores for all programs improved over 9 months.ConclusionThe HFTAT was a well-liked and generally useful implementation strategy. Results support prior research pointing to the value of both (a) multifaceted strategies and (b) combined training and consultation approaches. The study also provides evidence for narrative storytelling as an approach for changing attitudinal implementation barriers. The need for compatibility between specific elements of an implementation strategy and the work environment was also observed.

Project description:BackgroundEmerging evidence at the international level suggests that the Housing First approach could improve the housing stability of young people experiencing homelessness. However, there is a dearth of literature in Canada on whether the Housing First intervention for young people experiencing homelessness can improve outcomes including housing stability, health and well-being, and access to complementary supports. Adapted from the original Housing First model, Housing First for Youth (HF4Y) was developed in Canada as a rights-based approach tailored specifically for young people aged 16 to 24 years who are experiencing or are at risk of homelessness.ObjectiveThe Making the Shift Youth Homelessness Social Innovation Lab is testing the effectiveness of the HF4Y intervention in Canada. The objective of this study is to determine whether the HF4Y model results in better participant-level outcomes than treatment-as-usual services for young people experiencing homelessness in 2 urban settings: Ottawa and Toronto, Ontario. Primary outcomes include housing stability, health and well-being, and complementary supports, and secondary outcomes include employment and educational attainment and social inclusion.MethodsThe HF4Y study used a multisite, mixed methods, randomized controlled trial research approach for data collection and analysis. Eligible participants included young people aged 16 to 24 years who were experiencing homelessness or housing precarity. The participants were randomly assigned to either the treatment-as-usual group or the housing first intervention group. Survey and interview data in Ottawa and Toronto, Ontario are being collected at multiple time points (3-6 months) over 4 years to capture a range of outcomes. Analytic strategies for quantitative data will include mixed-effects modeling for repeated measures and logistic models. A thematic analysis will be used to analyze qualitative data based on participants' narratives and life journeys through homelessness. Furthermore, program fidelity evaluations are conducted within each HF4Y program. These evaluations assess how well the intervention aligns with the HF4Y model and identify any areas that may require adjustments or additional support.ResultsThe HF4Y study has received human participant research ethics approval from the Office of Research Ethics at York University. Recruitment was conducted between February 2018 and March 2020. Data collection is expected to be completed at both sites by March 2024. A preliminary analysis of the quantitative and qualitative data collected between baseline and 24 months is underway.ConclusionsThis pilot randomized controlled trial is the first to test the effectiveness of the HF4Y intervention in Canada. The findings of this study will enhance our understanding of how to effectively deliver and scale up the HF4Y intervention, with the aim of continually improving the HF4Y model to promote better outcomes for youth.Trial registrationInternational Standard Randomized Controlled Trial Number (ISRCTN) ISRCTN10505930; https://www.isrctn.com/ISRCTN10505930.International registered report identifier (irrid)DERR1-10.2196/46690.

Project description:BackgroundHousing First has become a popular treatment model for homeless adults with mental illness, yet little is known about program participants' early experiences or trajectories. This study used a mixed methods design to examine participant changes in selected domains 6 months after enrollment in a Canadian field trial of Housing First.MethodsThe study sample included 301 participants receiving the Housing First intervention at the Toronto site of the At Home/Chez Soi project. This study used a pre-post design to compare quantitative 6-month outcome data to baseline values in key domains and multivariate regression to identify baseline demographic, clinical or service use variables associated with observed changes in these domains. In addition, qualitative data exploring participant and service provider perspectives and experiences was collected via stakeholder interviews and focus groups, and analyzed using thematic analysis.ResultsThe majority (60 to 72%) of participants followed the expected trajectory of improvement, with the remaining experiencing difficulties in community integration, mental health symptom severity, substance use, community functioning and quality of life 6 months after program enrollment. Diagnosis of psychotic disorder was associated with a reduction in quality of life from baseline to 6-months, while substance use disorders were associated with reduced mental illness symptoms and substance use related problems and an improvement in quality of life. Participants housed in independent housing at 6-months had greater improvements in community integration and quality of life, and greater reduction in mental illness symptoms, compared to those not independently housed. The quality of the working alliance was positively associated with improvements in physical and psychological community integration and quality of life. Qualitative data provided a unique window into the loneliness and isolation experienced by Housing First participants, as well as problems related to substance use and a need for life skills training and support.ConclusionsAdditional strategies can help support Housing First participants in the early stages of program participation and address potential causes of early difficulties, including lack of life skills and social isolation. This study highlights the importance of early and ongoing evaluation, monitoring and program adaptations to address consumer support needs.Trial registrationCurrent Controlled Trials ISRCTN42520374.

Project description:BackgroundDelivery of behavioral interventions is complex, as the majority of interventions consist of multiple components used either simultaneously, sequentially, or both. The importance of clearly delineating delivery strategies within these complex interventions-and furthermore understanding the impact of each strategy on effectiveness-has recently emerged as an important facet of intervention research. Yet, few methodologies exist to prospectively test the effectiveness of delivery strategies and how they impact implementation. In the current paper, we describe a study protocol for a large randomized controlled trial in which we will use the Multiphase Optimization Strategy (MOST), a novel framework developed to optimize interventions, i.e., to test the effectiveness of intervention delivery strategies using a factorial design. We apply this framework to delivery of Family Navigation (FN), an evidence-based care management strategy designed to reduce disparities and improve access to behavioral health services, and test four components related to its implementation.Methods/designThe MOST framework contains three distinct phases: Preparation, Optimization, and Evaluation. The Preparation phase for this study occurred previously. The current study consists of the Optimization and Evaluation phases. Children aged 3-to-12 years old who are detected as "at-risk" for behavioral health disorders (n = 304) at a large, urban federally qualified community health center will be referred to a Family Partner-a bicultural, bilingual member of the community with training in behavioral health and systems navigation-who will perform FN. Families will then be randomized to one of 16 possible combinations of FN delivery strategies (2 × 2 × 2× 2 factorial design). The primary outcome measure will be achieving a family-centered goal related to behavioral health services within 90 days of randomization. Implementation data on the fidelity, acceptability, feasibility, and cost of each strategy will also be collected. Results from the primary and secondary outcomes will be reviewed by our team of stakeholders to optimize FN delivery for implementation and dissemination based on effectiveness, efficiency, and cost.DiscussionIn this protocol paper, we describe how the MOST framework can be used to improve intervention delivery. These methods will be useful for future studies testing intervention delivery strategies and their impact on implementation.Trial registrationClinicalTrials.gov, NCT03569449. Registered on 26 June 2018.

Dataset Information

Alpha test results for a Housing First eLearning strategy: the value of multiple qualitative methods for intervention design.

Publications

Alpha test results for a Housing First eLearning strategy: the value of multiple qualitative methods for intervention design.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets