Dataset Information

Transparency about the outcomes of mental health services (IAPT approach): an analysis of public data.

ABSTRACT:

Background

Internationally, the clinical outcomes of routine mental health services are rarely recorded or reported; however, an exception is the English Improving Access to Psychological Therapies (IAPT) service, which delivers psychological therapies recommended by the National Institute for Health and Care Excellence for depression and anxiety disorders to more than 537 000 patients in the UK each year. A session-by-session outcome monitoring system ensures that IAPT obtains symptom scores before and after treatment for 98% of patients. Service outcomes can then be reported, along with contextual information, on public websites.

Methods

We used publicly available data to identify predictors of variability in clinical performance. Using β regression models, we analysed the outcome data released by National Health Service Digital and Public Health England for the 2014-15 financial year (April 1, 2014, to March 31, 2015) and developed a predictive model of reliable improvement and reliable recovery. We then tested whether these predictors were also associated with changes in service outcome between 2014-15 and 2015-16.

Findings

Five service organisation features predicted clinical outcomes in 2014-15. Percentage of cases with a problem descriptor, number of treatment sessions, and percentage of referrals treated were positively associated with outcome. The time waited to start treatment and percentage of appointments missed were negatively associated with outcome. Additive odd ratios suggest that moving from the lowest to highest level on an organisational factor could improve service outcomes by 11-42%, dependent on the factor. Consistent with a causal model, most organisational factors also predicted between-year changes in outcome, together accounting for 33% of variance in reliable improvement and 22% for reliable recovery. Social deprivation was negatively associated with some outcomes, but the effect was partly mitigated by the organisational factors.

Interpretation

Traditionally, efforts to improve mental health outcomes have largely focused on the development of new and more effective treatments. Our analyses show that the way psychological therapy services are implemented could be similarly important. Mental health services elsewhere in the UK and in other countries might benefit from adopting IAPT's approach to recording and publicly reporting clinical outcomes.

Funding

Wellcome Trust.

SUBMITTER: Clark DM

PROVIDER: S-EPMC5820411 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundAlthough national policies in China are comprehensive and instructive, a wide disparity exists between different cities. The current status of public mental health services by region in China remains unclear. This study aimed to investigate policies related to public mental health services, the contact coverage of public mental health services and outcomes of service users.MethodsA cross-sectional study was carried out in Southern China, between April 2021 and March 2022. Considering the geographical location, socioeconomic development levels, and prevalence of severe mental illness, four cities including Wuhan, Changsha, Guangzhou, and Shenzhen were selected. Relevant service providers were asked to report data on mental health policies and facility-related information, including mental health resources, registration rates of patients, management rates of patients, and medication rates of patients. Eligible patients were invited to report service user-related data, including contact coverage of public mental health services and their outcomes. SPSS 26.0 was used for data analysis.ResultsThe four cities in Southern China have made different efforts to develop public mental health services, primarily focusing on socio-economically disadvantaged individuals. Community health centers in Guangzhou and Shenzhen reported having more professional human resources on mental health and higher mental health budgets for patients. The contact coverage rates of most public mental services were higher than 80%. Patients in Changsha (B = 0.3; 95%CI: 0.1-0.5), Guangzhou (B = 0.2; 95%CI: 0.1-0.3), and Shenzhen (B = 0.3; 95%CI: 0.1-0.4) who received social medical assistance services reported higher levels of medication adherence. Patients in Wuhan (B = -6.5; 95%CI: -12.9--0.1), Guangzhou (B = -2.8; 95%CI: -5.5--0.1), and Shenzhen who received community-based rehabilitation services reported lower levels of disability (B = -2.6; 95%CI: -4.6--0.5).ConclusionsThere have been advances in public mental health services in the four Southern cities. The contact coverage rates of most public mental health services were higher than 80%. Patients' utilization of public mental services was associated with better health outcomes. To improve the quality of public mental health services, the government should try to engage service users, their family members, and supporters in the design, delivery, operationalization, and evaluation of these public mental health services in the future.

Project description:Background:The Children and Young People's Improving Access to Psychological Therapies (CYP-IAPT) programme was introduced to transform Child and Adolescent Mental Health Services (CAMHS) across England. The programme comprised a set of principles that local CAMHS partnerships were expected to operationalise and embed with the aim of increasing access to services and improving the quality of care. This study explored how the implementation of the CYP-IAPT programme was executed and experienced by CAMHS professionals in the county of Cambridgeshire (UK), and the extent to which the CYP-IAPT principles were perceived to be successfully embedded into everyday practice. Methods:We analysed 275 documents relating to the CYP-IAPT programme issued between 2011 and 2015. We also conducted a thematic analysis of 20 qualitative interviews, undertaken at two time points, with professionals from three CAMHS teams in Cambridgeshire. Analysis was informed by implementation science frameworks. Results:Document analysis suggested that the CYP-IAPT programme was initially not clearly defined and lacked guidance on how to operationalise key programme principles and apply them in everyday practice. There was also a degree of programme evolution over time, which made it difficult for local stakeholders to understand the scope and aims of CYP-IAPT. Interviews with staff showed low coherent understanding of the programme, variable levels of investment among stakeholders and difficulties in collaborative working. Barriers and facilitators to programme implementation were identified at individual, service and strategic levels. These in turn impacted the local implementation efforts and sustainability of the programme in Cambridgeshire. Conclusions:We identified factors relating to programme design and national and local implementation planning, as well as features of inner and outer context, which impacted on the delivery and sustainability of the programme. These findings can be drawn upon to inform the development and delivery of other local and national quality improvement (QI) initiatives relating to children and young people's mental health.

Project description:BackgroundPost-deinstitutionalisation, mental health supported accommodation services have been implemented widely. The available research evidence is heterogeneous in nature and resistant to synthesis attempts, leaving researchers and policy makers with no clear summary what works and for whom. In this context, we undertook a comprehensive systematic review of quantitative studies in order to synthesise the current evidence on mental health and psychosocial outcomes for individuals residing in mental health supported accommodation services.MethodsUsing a combination of electronic database searches, hand searches, forward-backward snowballing and article recommendations from an expert panel, 115 papers were identified for review. Data extraction and quality assessments were conducted, and 33 articles were excluded due to low quality, leaving 82 papers in the final review. Variation in terminology and service characteristics made the comparison of service models unfeasible. As such, findings were presented according to the following sub-groups: 'Homeless', 'Deinstitutionalisation' and 'General Severe Mental Illness (SMI)'.ResultsResults were mixed, reflecting the heterogeneity of the supported accommodation literature, in terms of research quality, experimental design, population, service types and outcomes assessed. There is some evidence that supported accommodation is effective across a range of psychosocial outcomes. The most robust evidence supports the effectiveness of the permanent supported accommodation model for homeless SMI in generating improvements in housing retention and stability, and appropriate use of clinical services over time, and for other forms of supported accommodation for deinstitutionalised populations in reducing hospitalisation rates and improving appropriate service use. The evidence base for general SMI populations is less developed, and requires further research.ConclusionsA lack of high-quality experimental studies, definitional inconsistency and poor reporting continue to stymie our ability to identify effective supported accommodation models and practices. The authors recommend improved reporting standards and the prioritisation of experimental studies that compare outcomes across different service models.

Project description:BACKGROUND:Prompt mental health care (PMHC) is a Norwegian initiative, inspired by the English 'Improving Access to Psychological Therapy' (IAPT), aimed to provide low-threshold access to primary care treatment for persons with symptoms of anxiety and depression. The objectives of the present study are to describe the PMHC service, to examine changes in symptoms of anxiety and depression following treatment and to identify predictors of change, using data from the 12 first pilot sites. METHODS:A prospective cohort design was used. All participants were asked to complete questionnaires at baseline, before each treatment session and at the end of treatment. Effect sizes (ES) for pre-post changes and recovery rates were calculated based on the Patient Health Questionnaire and the Generalized Anxiety Disorder scale. Multiple imputation (MI) was used in order to handle missing data. We examined predictors through latent difference score models and reported the contribution of each predictor level in terms of ES. RESULTS:In total, N =?2512 clients received treatment at PMHC between October 2014 and December 2016, whereof 61% consented to participate. The changes from pre- to post-treatment were large for symptoms of both depression (ES?=?1.1) and anxiety (ES?=?1.0), with an MI-based reliable recovery rate of 58%. The reliable recovery rate comparable to IAPT based on last-observation-carried-forward was 48%. The strongest predictors for less improvement were having immigrant background (ES change depression -?0.27, ES change anxiety -?0.26), being out of work at baseline (ES change depression -?0.18, ES change anxiety -?0.35), taking antidepressants (ES change anxiety -?0.36) and reporting bullying as cause of problems (ES change depression -?0.29). Taking sleep medication did on the other hand predict more improvement (ES change depression 0.23, ES change anxiety 0.45). CONCLUSIONS:Results in terms of clinical outcomes were promising, compared to both the IAPT pilots and other benchmark samples. Though all groups of clients showed substantial improvements, having immigrant background, being out of work, taking antidepressant medication and reporting bullying as cause stood out as predictors of poorer treatment response. Altogether, PMHC was successfully implemented in Norway. Areas for improvement of the service are discussed.

Project description:BackgroundOver the past decades, the deficient provision of evidence-based interventions for the prevention and treatment of mental health problems has become a global challenge across health care systems. In view of the ongoing diffusion of new media and mobile technologies into everyday life, Web-delivered electronic mental health (e-mental health) treatment services have been suggested to expand the access to professional help. However, the large-scale dissemination and adoption of innovative e-mental health services is progressing slowly. This discrepancy between potential and actual impact in public health makes it essential to explore public acceptability of e-mental health treatment services across health care systems.ObjectiveThis scoping review aimed to identify and evaluate recent empirical evidence for public acceptability, service preferences, and attitudes toward e-mental health treatments. On the basis of both frameworks for technology adoption and previous research, we defined (1) perceived helpfulness and (2) intentions to use e-mental health treatment services as indicators for public acceptability in the respective general population of reviewed studies. This mapping should reduce heterogeneity and help derive implications for systematic reviews and public health strategies.MethodsWe systematically searched electronic databases (MEDLINE/PubMed, PsycINFO, Psyndex, PsycARTICLES, and Cochrane Library, using reference management software for parallel searches) to identify surveys published in English in peer-reviewed journals between January 2010 and December 2015, focusing on public perceptions about e-mental health treatments outside the context of clinical, psychosocial, or diagnostic interventions. Both indicators were obtained from previous review. Exclusion criteria further involved studies targeting specific groups or programs.ResultsThe simultaneous database search identified 76 nonduplicate records. Four articles from Europe and Australia were included in this scoping review. Sample sizes ranged from 217 to 2411 participants of ages 14-95 years. All included studies used cross-sectional designs and self-developed measures for outcomes related to both defined indicators of public acceptability. Three surveys used observational study designs, whereas one study was conducted as an experiment investigating the impact of brief educational information on attitudes. Taken together, the findings of included surveys suggested that e-mental health treatment services were perceived as less helpful than traditional face-to-face interventions. Additionally, intentions to future use e-mental health treatments were overall smaller in comparison to face-to-face services. Professional support was essential for help-seeking intentions in case of psychological distress. Therapist-assisted e-mental health services were preferred over unguided programs. Unexpectedly, assumed associations between familiarity with Web-based self-help for health purposes or "e-awareness" and intentions to use e-mental health services were weak or inconsistent.ConclusionsConsidering the marginal amount and heterogeneity of pilot studies focusing on public acceptability of e-mental health treatments, further research using theory-led approaches and validated measures is required to understand psychological facilitator and barriers for the implementation of innovative services into health care.

Project description:BackgroundNumerous determinants have been linked to public mental health; however, they have not been brought together in a comprehensive conceptual framework. The goal of this work was to bring together academic research, practitioner expertise, and public perspectives to create a public mental health conceptual framework.MethodsThe development process proceeded in four stages. First, we identified a comprehensive list of potential determinants through a state-of-the-art academic literature review, grey literature review, and created mind maps created by peer researchers. Next, we conducted in-person workshops, consultations, and an online survey with academics, practitioners, policy makers, and members of the public to review the potential determinants, nominate additional determinants, and prioritise determinants by importance for understanding public mental health. This iterative process resulted in the final list of determinants contained in the framework. We then conducted rapid reviews to define each determinant and to identify key research, interventions, and resources. Finally, we worked with a design team to visualise the conceptual framework as an online tool and printable infographic.ResultsWe found substantial overlap between sources reflecting a shared understanding of the key drivers of public mental health. The unique determinants that emerged from each data source highlighted the importance of using multiple sources to create a comprehensive model. 72 potential determinants were prioritised through stakeholder consultations, resulting in a final list of 55 determinants and organised into four levels: individual, family, community, and structural.ConclusionsThis is the most complete conceptual framework for public mental health to date, bringing together academic research, policy and practitioner views, and lived experience perspectives. The co-production processes and tools we used provides a template for researchers looking to include multiple perspectives in their research. The conceptual framework draws together current knowledge on each determinant, but also highlights areas where further research is needed to better understand the relationship between each factor and mental health, which can inform the research agenda. This online tool and infographic can be used by practitioners to identify interventions for promoting mental health, and by the general public as a resource to increase awareness of the broad factors which shape public mental health.