Dataset Information

Assessing mental health service user and carer involvement in physical health care planning: The development and validation of a new patient-reported experience measure.

ABSTRACT:

Background

People living with serious mental health conditions experience increased morbidity due to physical health issues driven by medication side-effects and lifestyle factors. Coordinated mental and physical healthcare delivered in accordance with a care plan could help to reduce morbidity and mortality in this population. Efforts to develop new models of care are hampered by a lack of validated instruments to accurately assess the extent to which mental health services users and carers are involved in care planning for physical health.

Objective

To develop a brief and accurate patient-reported experience measure (PREM) capable of assessing involvement in physical health care planning for mental health service users and their carers.

Methods

We employed psychometric and statistical techniques to refine a bank of candidate questionnaire items, derived from qualitative interviews, into a valid and reliable measure involvement in physical health care planning. We assessed the psychometric performance of the item bank using modern psychometric analyses. We assessed unidimensionality, scalability, fit to the partial credit Rasch model, category threshold ordering, local dependency, differential item functioning, and test-retest reliability. Once purified of poorly performing and erroneous items, we simulated computerized adaptive testing (CAT) with 15, 10 and 5 items using the calibrated item bank.

Results

Issues with category threshold ordering, local dependency and differential item functioning were evident for a number of items in the nascent item bank and were resolved by removing problematic items. The final 19 item PREM had excellent fit to the Rasch model fit (x2 = 192.94, df = 1515, P = .02, RMSEA = .03 (95% CI = .01-.04). The 19-item bank had excellent reliability (marginal r = 0.87). The correlation between questionnaire scores at baseline and 2-week follow-up was high (r = .70, P < .01) and 94.9% of assessment pairs were within the Bland Altman limits of agreement. Simulated CAT demonstrated that assessments could be made using as few as 10 items (mean SE = .43).

Discussion

We developed a flexible patient reported outcome measure to quantify service user and carer involvement in physical health care planning. We demonstrate the potential to substantially reduce assessment length whilst maintaining reliability by utilizing CAT.

SUBMITTER: Sidey-Gibbons CJ

PROVIDER: S-EPMC6373938 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundIncreasing service user and carer involvement in mental health care planning is a key healthcare priority but one that is difficult to achieve in practice. To better understand and measure user and carer involvement, it is crucial to have measurement questionnaires that are both psychometrically robust and acceptable to the end user.MethodsWe conducted a systematic review using the terms "care plan$," "mental health," "user perspective$," and "user participation" and their linguistic variants as search terms. Databases were searched from inception to November 2012, with an update search at the end of September 2014. We included any articles that described the development, validation or use of a user and/or carer-reported outcome measures of involvement in mental health care planning. We assessed the psychometric quality of each instrument using the "Evaluating the Measurement of Patient-Reported Outcomes" (EMPRO) criteria. Acceptability of each instrument was assessed using novel criteria developed in consultation with a mental health service user and carer consultation group.ResultsWe identified eleven papers describing the use, development, and/or validation of nine user/carer-reported outcome measures. Psychometric properties were sparsely reported and the questionnaires met few service user/carer-nominated attributes for acceptability. Where reported, basic psychometric statistics were of good quality, indicating that some measures may perform well if subjected to more rigorous psychometric tests. The majority were deemed to be too long for use in practice.DiscussionMultiple instruments are available to measure user/carer involvement in mental health care planning but are either of poor quality or poorly described. Existing measures cannot be considered psychometrically robust by modern standards, and cannot currently be recommended for use. Our review has identified an important knowledge gap, and an urgent need to develop new user and carer measures of care-planning involvement.

Project description:BackgroundIt is essential to involve service users in efforts to expand access to mental health care in integrated primary care settings in low- and middle-income countries (LMICs). However, there is little evidence from LMICs to guide this process. The aim of this study was to explore barriers to, and facilitators of, service user/caregiver involvement in rural Ethiopia to inform the development of a scalable approach.MethodsThirty nine semi-structured interviews were carried out with purposively selected mental health service users (n = 13), caregivers (n = 10), heads of primary care facilities (n = 8) and policy makers/planners/service developers (n = 8). The interviews were audio-recorded and transcribed in Amharic, and translated into English. Thematic analysis was applied.ResultsAll groups of participants supported service user and caregiver involvement in mental health system strengthening. Potential benefits were identified as (i) improved appropriateness and quality of services, and (ii) greater protection against mistreatment and promotion of respect for service users. However, hardly any respondents had prior experience of service user involvement. Stigma was considered to be a pervasive barrier, operating within the health system, the local community and individuals. Competing priorities of service users included the need to obtain adequate individual care and to work for survival. Low recognition of the potential contribution of service users seemed linked to limited empowerment and mobilization of service users. Potential health system facilitators included a culture of community oversight of primary care services. All groups of respondents identified a need for awareness-raising and training to equip service users, caregivers, service providers and local community for involvement. Empowerment at the level of individual service users (information about mental health conditions, care and rights) and the group level (for advocacy and representation) were considered essential, alongside improved, accessible mental health care and livelihood interventions.ConclusionAs Ethiopia increases access to mental health care, a fundamental barrier to service user involvement is beginning to be addressed. Our study identified further barriers that need to be tackled, including a supportive political climate, and receptiveness amongst stakeholders. The findings will inform the development of a model of service user involvement, which will be piloted and evaluated.

Project description:BackgroundRespiratory syncytial virus (RSV) causes significant morbidity and mortality in older adults. Despite a number of RSV vaccine candidates in clinical trials, there are no existing disease-specific, self-reported measures that assess the symptoms and severity of RSV infection from the perspective of adult patients with acute RSV. The objective of this study was to describe the initial conceptualization and development of the RSV Infection, Intensity and Impact Questionnaire (RSV-iiiQ), a new patient-reported outcome measure.MethodsA targeted review of the literature identified relevant existing measures, symptoms, and impacts of RSV. A draft version of the RSV-iiiQ was developed based on the Influenza Intensity and Impact Questionnaire (Flu-iiQ) with expert input. Qualitative interviews (N = 20) were conducted with participants to optimize the RSV-iiiQ conceptual model and confirm the content validity of the RSV-iiiQ. Interviews included concept elicitation and a cognitive debriefing assessment. A draft conceptual framework was developed, and the electronic clinical outcome assessment was piloted. All steps of instrument development followed Food and Drug Administration guidance for patient-reported outcomes.ResultsIn-depth concept elicitation interviews followed by cognitive debriefings demonstrated that the content of the items was comprehensive, covered the breadth of RSV symptoms and impacts, and was relevant to the experiences of individuals with RSV. Both the paper and electronic versions of the RSV-iiiQ were easily completed. Minor refinements were made to some items based on participant feedback, and the draft conceptual framework was refined.ConclusionsThe RSV-iiiQ was developed for use in clinical trials to measure the symptom intensity and impact of acute RSV infection from the perspective of adult patients. The tool was developed in accordance with current regulatory guidance and is useful to support patient-focused drug development.

Project description:Background: Delivering person-centered care is a key component of health care reform. Despite widespread endorsement, medical and behavioral health settings struggle to specify and measure person-centered care objectively. This study presents the validity and reliability of the Person-Centered Care Planning Assessment Measure (PCCP-AM), an objective measure of the extent to which service planning is person-centered. Methods: Based upon the recovery-oriented practice of person-centered care planning, the 10-item PCCP-AM tool rates service plans on the inclusion of service user strengths, personal life goals, natural supports, self-directed actions and the promotion of community integration. As part of a large randomized controlled trial of person-centered care planning, service plans completed by community mental health clinic providers were rated using the PCCP-AM. Reliability was tested by calculating inter-rater reliability across 168 plans and internal consistency across 798 plans. To test concurrent validity, PCCP-AM scores for 84 plans were compared to expert rater scores on a separate instrument. Results: Interrater reliability for each of the 10 PCCP-AM items as measured by Kendall's W ranged from W = 0.77 to W = 0.89 and percent of scores within ± 1 point of each other ranged from 85.7 to 100%. Overall internal consistency as measured by Cronbach's alpha across 798 plans was α = 0.72. Concurrent validity as measured by Kendall's W ranged from W = 0.55 to W = 0.74 and percent of item scores within ± 1 point of expert rater scores ranged from 73.8 to 86.8%. Conclusions: Findings demonstrated that the 10-item PCCP-AM was a valid and reliable objective measure of person-centered care. Using the service plan as an indicator of multiple domains of person-centered care, the measure provides a valuable tool to inform clinical supervision and quality improvement across programs. More psychometric testing is needed to strengthen the measure for research purposes.

Project description:BackgroundLong duration of untreated psychosis (DUP) is associated with poor outcomes and low quality of life at first contact with mental health services. However, long DUP is common. In order to inform initiatives to reduce DUP, we investigated service users' and carers' experiences of the onset of psychosis and help-seeking in two multicultural, inner London boroughs and the roles of participants' social networks in their pathways to care.MethodIn-depth interviews were conducted with service users and carers from an early intervention service in North London, purposively sampled to achieve diversity in sociodemographic characteristics and DUP and to include service users in contact with community organisations during illness onset. Interviews covered respondents' understanding of and reaction to the onset of psychosis, their help-seeking attempts and the reactions of social networks and health services. Thematic analysis of interview transcripts was conducted.ResultsMultiple barriers to prompt treatment included not attributing problems to psychosis, worries about the stigma of mental illness and service contact, not knowing where to get help and unhelpful service responses. Help was often not sought until crisis point, despite considerable prior distress. The person experiencing symptoms was often the last to recognise them as mental illness. In an urban UK setting, where involved, workers in non-health community organisations were frequently willing to assist help-seeking but often lacked skills, time or knowledge to do so.ConclusionEven modest periods of untreated psychosis cause distress and disruption to individuals and their families. Early intervention services should prioritise early detection. Initiatives aimed at reducing DUP may succeed not by promoting swift service response alone, but also by targeting delays in initial help-seeking. Our study suggests that strategies for doing this may include addressing the stigma associated with psychosis and community education regarding symptoms and services, targeting not only young people developing illness but also a range of people in their networks, including staff in educational and community organisations. Initiatives to enhance the effective involvement of staff in community organisations working with young people in promoting help-seeking merit research.

Project description:BackgroundIncreased service user involvement is recommended to improve weak mental health systems in low-and middle-income countries (LMICs). However, involvement is rarely implemented and interventions to support involvement are sparse. In this study we evaluated the acceptability, feasibility and perceived outcomes of an empowerment and training program for service users and health professionals to facilitate service user involvement in mental health system strengthening in rural Ethiopia.MethodsREducing Stigma among HealthcAreProvidErs (RESHAPE) is a training curriculum for service users, their caregivers and aspirational health workers, which uses PhotoVoice methodology, to prepare them in participation of mental health systems strengthening in LMICs. We delivered the RESHAPE training augmented with empowerment content developed in Ethiopia. The interactive face-to-face training was delivered to service users and caregivers (over 10 days), and health professionals (1 day) separately. The study was an uncontrolled, convergent mixed-methods design. The quantitative data consisted of process data, satisfaction questionnaire, and a retrospective pre-test survey. Qualitative data included exit and follow-up in-depth interviews with the service users. Descriptive statistics were performed for quantitative data, and qualitative data were thematically analysed. The findings were integrated through triangulation for convergent themes following analysis.ResultsTwelve service users, 12 caregivers and 18 health professionals were enrolled, and completed the training. Participants valued the content and delivery process; the standard of the training program met their expectations and participation led to positive gains in understanding about mental illness, stigma, service-user involvement and human rights. The qualitative findings identified positive impacts, including increased self-confidence, sense of empowerment, social - and perceived therapeutic benefits.ConclusionsWe found that the RESHAPE training with added content for Ethiopia, delivered using the PhotoVoice methodology, is feasible, acceptable and of value to develop and implement training programmes which can empower service users to be involved in mental health system strengthening in this setting. Further study to assess the impact on health systems strengthening is warranted.