Dataset Information

Assessing mental health service user and carer involvement in physical health care planning: The development and validation of a new patient-reported experience measure.

ABSTRACT:

Background

People living with serious mental health conditions experience increased morbidity due to physical health issues driven by medication side-effects and lifestyle factors. Coordinated mental and physical healthcare delivered in accordance with a care plan could help to reduce morbidity and mortality in this population. Efforts to develop new models of care are hampered by a lack of validated instruments to accurately assess the extent to which mental health services users and carers are involved in care planning for physical health.

Objective

To develop a brief and accurate patient-reported experience measure (PREM) capable of assessing involvement in physical health care planning for mental health service users and their carers.

Methods

We employed psychometric and statistical techniques to refine a bank of candidate questionnaire items, derived from qualitative interviews, into a valid and reliable measure involvement in physical health care planning. We assessed the psychometric performance of the item bank using modern psychometric analyses. We assessed unidimensionality, scalability, fit to the partial credit Rasch model, category threshold ordering, local dependency, differential item functioning, and test-retest reliability. Once purified of poorly performing and erroneous items, we simulated computerized adaptive testing (CAT) with 15, 10 and 5 items using the calibrated item bank.

Results

Issues with category threshold ordering, local dependency and differential item functioning were evident for a number of items in the nascent item bank and were resolved by removing problematic items. The final 19 item PREM had excellent fit to the Rasch model fit (x2 = 192.94, df = 1515, P = .02, RMSEA = .03 (95% CI = .01-.04). The 19-item bank had excellent reliability (marginal r = 0.87). The correlation between questionnaire scores at baseline and 2-week follow-up was high (r = .70, P < .01) and 94.9% of assessment pairs were within the Bland Altman limits of agreement. Simulated CAT demonstrated that assessments could be made using as few as 10 items (mean SE = .43).

Discussion

We developed a flexible patient reported outcome measure to quantify service user and carer involvement in physical health care planning. We demonstrate the potential to substantially reduce assessment length whilst maintaining reliability by utilizing CAT.

SUBMITTER: Sidey-Gibbons CJ

PROVIDER: S-EPMC6373938 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundIncreasing service user and carer involvement in mental health care planning is a key healthcare priority but one that is difficult to achieve in practice. To better understand and measure user and carer involvement, it is crucial to have measurement questionnaires that are both psychometrically robust and acceptable to the end user.MethodsWe conducted a systematic review using the terms "care plan$," "mental health," "user perspective$," and "user participation" and their linguistic variants as search terms. Databases were searched from inception to November 2012, with an update search at the end of September 2014. We included any articles that described the development, validation or use of a user and/or carer-reported outcome measures of involvement in mental health care planning. We assessed the psychometric quality of each instrument using the "Evaluating the Measurement of Patient-Reported Outcomes" (EMPRO) criteria. Acceptability of each instrument was assessed using novel criteria developed in consultation with a mental health service user and carer consultation group.ResultsWe identified eleven papers describing the use, development, and/or validation of nine user/carer-reported outcome measures. Psychometric properties were sparsely reported and the questionnaires met few service user/carer-nominated attributes for acceptability. Where reported, basic psychometric statistics were of good quality, indicating that some measures may perform well if subjected to more rigorous psychometric tests. The majority were deemed to be too long for use in practice.DiscussionMultiple instruments are available to measure user/carer involvement in mental health care planning but are either of poor quality or poorly described. Existing measures cannot be considered psychometrically robust by modern standards, and cannot currently be recommended for use. Our review has identified an important knowledge gap, and an urgent need to develop new user and carer measures of care-planning involvement.

Project description:It is essential to involve service users in efforts to expand access to mental health care in integrated primary care settings in low- and middle-income countries (LMICs). However, there is little evidence from LMICs to guide this process. The aim of this study was to explore barriers to, and facilitators of, service user/caregiver involvement in rural Ethiopia to inform the development of a scalable approach.Thirty nine semi-structured interviews were carried out with purposively selected mental health service users (n = 13), caregivers (n = 10), heads of primary care facilities (n = 8) and policy makers/planners/service developers (n = 8). The interviews were audio-recorded and transcribed in Amharic, and translated into English. Thematic analysis was applied.All groups of participants supported service user and caregiver involvement in mental health system strengthening. Potential benefits were identified as (i) improved appropriateness and quality of services, and (ii) greater protection against mistreatment and promotion of respect for service users. However, hardly any respondents had prior experience of service user involvement. Stigma was considered to be a pervasive barrier, operating within the health system, the local community and individuals. Competing priorities of service users included the need to obtain adequate individual care and to work for survival. Low recognition of the potential contribution of service users seemed linked to limited empowerment and mobilization of service users. Potential health system facilitators included a culture of community oversight of primary care services. All groups of respondents identified a need for awareness-raising and training to equip service users, caregivers, service providers and local community for involvement. Empowerment at the level of individual service users (information about mental health conditions, care and rights) and the group level (for advocacy and representation) were considered essential, alongside improved, accessible mental health care and livelihood interventions.As Ethiopia increases access to mental health care, a fundamental barrier to service user involvement is beginning to be addressed. Our study identified further barriers that need to be tackled, including a supportive political climate, and receptiveness amongst stakeholders. The findings will inform the development of a model of service user involvement, which will be piloted and evaluated.

Project description:Background: Delivering person-centered care is a key component of health care reform. Despite widespread endorsement, medical and behavioral health settings struggle to specify and measure person-centered care objectively. This study presents the validity and reliability of the Person-Centered Care Planning Assessment Measure (PCCP-AM), an objective measure of the extent to which service planning is person-centered. Methods: Based upon the recovery-oriented practice of person-centered care planning, the 10-item PCCP-AM tool rates service plans on the inclusion of service user strengths, personal life goals, natural supports, self-directed actions and the promotion of community integration. As part of a large randomized controlled trial of person-centered care planning, service plans completed by community mental health clinic providers were rated using the PCCP-AM. Reliability was tested by calculating inter-rater reliability across 168 plans and internal consistency across 798 plans. To test concurrent validity, PCCP-AM scores for 84 plans were compared to expert rater scores on a separate instrument. Results: Interrater reliability for each of the 10 PCCP-AM items as measured by Kendall's W ranged from W = 0.77 to W = 0.89 and percent of scores within ± 1 point of each other ranged from 85.7 to 100%. Overall internal consistency as measured by Cronbach's alpha across 798 plans was α = 0.72. Concurrent validity as measured by Kendall's W ranged from W = 0.55 to W = 0.74 and percent of item scores within ± 1 point of expert rater scores ranged from 73.8 to 86.8%. Conclusions: Findings demonstrated that the 10-item PCCP-AM was a valid and reliable objective measure of person-centered care. Using the service plan as an indicator of multiple domains of person-centered care, the measure provides a valuable tool to inform clinical supervision and quality improvement across programs. More psychometric testing is needed to strengthen the measure for research purposes.

Project description:BackgroundLong duration of untreated psychosis (DUP) is associated with poor outcomes and low quality of life at first contact with mental health services. However, long DUP is common. In order to inform initiatives to reduce DUP, we investigated service users' and carers' experiences of the onset of psychosis and help-seeking in two multicultural, inner London boroughs and the roles of participants' social networks in their pathways to care.MethodIn-depth interviews were conducted with service users and carers from an early intervention service in North London, purposively sampled to achieve diversity in sociodemographic characteristics and DUP and to include service users in contact with community organisations during illness onset. Interviews covered respondents' understanding of and reaction to the onset of psychosis, their help-seeking attempts and the reactions of social networks and health services. Thematic analysis of interview transcripts was conducted.ResultsMultiple barriers to prompt treatment included not attributing problems to psychosis, worries about the stigma of mental illness and service contact, not knowing where to get help and unhelpful service responses. Help was often not sought until crisis point, despite considerable prior distress. The person experiencing symptoms was often the last to recognise them as mental illness. In an urban UK setting, where involved, workers in non-health community organisations were frequently willing to assist help-seeking but often lacked skills, time or knowledge to do so.ConclusionEven modest periods of untreated psychosis cause distress and disruption to individuals and their families. Early intervention services should prioritise early detection. Initiatives aimed at reducing DUP may succeed not by promoting swift service response alone, but also by targeting delays in initial help-seeking. Our study suggests that strategies for doing this may include addressing the stigma associated with psychosis and community education regarding symptoms and services, targeting not only young people developing illness but also a range of people in their networks, including staff in educational and community organisations. Initiatives to enhance the effective involvement of staff in community organisations working with young people in promoting help-seeking merit research.

Project description:BackgroundIncreased service user involvement is recommended to improve weak mental health systems in low-and middle-income countries (LMICs). However, involvement is rarely implemented and interventions to support involvement are sparse. In this study we evaluated the acceptability, feasibility and perceived outcomes of an empowerment and training program for service users and health professionals to facilitate service user involvement in mental health system strengthening in rural Ethiopia.MethodsREducing Stigma among HealthcAreProvidErs (RESHAPE) is a training curriculum for service users, their caregivers and aspirational health workers, which uses PhotoVoice methodology, to prepare them in participation of mental health systems strengthening in LMICs. We delivered the RESHAPE training augmented with empowerment content developed in Ethiopia. The interactive face-to-face training was delivered to service users and caregivers (over 10 days), and health professionals (1 day) separately. The study was an uncontrolled, convergent mixed-methods design. The quantitative data consisted of process data, satisfaction questionnaire, and a retrospective pre-test survey. Qualitative data included exit and follow-up in-depth interviews with the service users. Descriptive statistics were performed for quantitative data, and qualitative data were thematically analysed. The findings were integrated through triangulation for convergent themes following analysis.ResultsTwelve service users, 12 caregivers and 18 health professionals were enrolled, and completed the training. Participants valued the content and delivery process; the standard of the training program met their expectations and participation led to positive gains in understanding about mental illness, stigma, service-user involvement and human rights. The qualitative findings identified positive impacts, including increased self-confidence, sense of empowerment, social - and perceived therapeutic benefits.ConclusionsWe found that the RESHAPE training with added content for Ethiopia, delivered using the PhotoVoice methodology, is feasible, acceptable and of value to develop and implement training programmes which can empower service users to be involved in mental health system strengthening in this setting. Further study to assess the impact on health systems strengthening is warranted.

Project description:Abstract Background We have previously described the development and content validity of a new patient-reported outcome measure (PRO) to assess patients’ subjective experience of cognitive impairment in schizophrenia: The Patient-Reported Experience of Cognitive Impairment in Schizophrenia (PRECIS). Here we assess the psychometric properties of the PRECIS PRO in patients with schizophrenia and healthy age-matched controls with the aim of developing a revised version for use in clinical studies. Methods The PRECIS PRO is a 35-item scale comprising eight concept domains (memory, communication, control, planning, handling problems, attention, sharp thinking and overall experience), each with multiple individual items. PRECIS was administered to psychiatrically-healthy controls (single visit), and a subset of patients in a large, clinical trial assessing patients with schizophrenia on stable antipsychotic treatment (NCT02281773) at baseline and Weeks 6, 9 and 12. Analysis of the original 35-item PRECIS PRO included factor structure, factor analysis (FA), internal consistency, test-retest reliability and discriminant (known groups) validity testing. FA was performed on all pre-treatment scores in the patient group (n=410) and patients and controls combined (n=498). Individual items with less than adequate reliability or validity were then identified and eliminated or modified. Results Questionnaire responses were collected from 410 patients with schizophrenia and 88 healthy controls. The mean (standard deviation [SD]) total PRECIS score was significantly lower for healthy controls (1.39 [0.7]) compared with patients (2.06 [1.2]; p<0.0001), as was overall experience domain score (1.41 [0.7] vs 2.35 [1.3]; p<0.0001). For each domain of patient experience, PRECIS mean scores were also significantly lower for healthy controls compared to patients with schizophrenia. The mean differences between groups ranged from -0.94 (overall experience domain) to -0.52 (control domain; p<0.0001, all domains). Patients with schizophrenia had wider response distributions compared with controls, while the control group had marked “floor effects” across most items. Initial exploratory FA of the 35-item PRECIS PRO identified a 6-domain solution that accounted for 62% of total item variance, and Cronbach’s alpha (0.959) indicated an extremely high level of internal consistency. Following analyses of the 35-item PRECIS PRO, a total of 11 items were eliminated based on pre-specified criteria (poor loading onto identified factors, marked floor effects in patient groups or <50% test-retest reliability). Confirmatory FA of the revised 24-item PRECIS PRO identified 1 primary domain (attention) and 3 secondary additional domains (memory, executive function, communication). An additional domain included items related to patient distress or bother related to cognitive impairment. There was a high level of internal consistency both for the overall 24-item PRECIS PRO (Cronbach’s alpha= 0.942) and individual domains (Cronbach’s alphas: 0.743–0.873). Intraclass correlation coefficients were 0.78 for the overall 24-item PRECIS PRO and ranged from 0.49–0.74 for individual domains. Finally, discriminant validity testing confirmed there were significant differences between the patient group and the control group in each of the 5 domains of the revised 24-item PRECIS PRO (p<0.0001). Discussion This large validation study demonstrated that the revised 24-item PRECIS PRO is a valid and reliable PRO measure with good internal consistency, adequate test-retest reliability and strong discriminant validity. PRECIS may therefore serve to define key patient-based endpoints for use in future clinical studies. Funding Boehringer Ingelheim (1289.20)