Dataset Information

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ).

ABSTRACT:

Background

The Psychiatric Out-Patient Experiences Questionnaire (POPEQ) is an 11-item core measure of psychiatric out-patients experiences of the perceived outcome of the treatment, the quality of interaction with the clinician, and the quality of information provision. The POPEQ was found to have evidence for reliability and validity following the application of classical test theory but has not previously been assessed by Rasch analysis.

Methods

Two national postal surveys of psychiatric outpatients took place in Norway in 2004 and 2007. The performance of the POPEQ, including item functioning and differential item functioning, was assessed by Rasch analysis. Principal component analysis of item residuals was used to assess the presence of subdimensions.

Results

6,677 (43.3%) and 11,085 (35.2%) psychiatric out patients responded to the questionnaire in 2004 and 2007, respectively. All items in the scale were retained after the Rasch analysis. The resulting scale had reasonably good fit to the Rasch model. The items performed the same for the two survey years and there was no differential item functioning relating to patient characteristics. Principal component analysis of the residuals confirmed that the measure to a high degree is unidimensional. However, the data also reflects three potential subscales, each relating to one of the three included aspects of health care.

Conclusions

The POPEQ had excellent psychometric properties and Rasch analysis further supported the construct validity of the scale by also identifying the three subdimensions originally included as components in the instrument development. The 11-item instrument is recommended in future research on psychiatric out-patient experiences. Future development may lead to the construction of more precise measures of the three subdomains that the POPEQ is based on.

SUBMITTER: Olsen RV

PROVIDER: S-EPMC2955020 | biostudies-literature | 2010 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ).

Olsen Rolf V RV Garratt Andrew M AM Iversen Hilde H HH Bjertnaes Oyvind A OA

BMC health services research 20100928

<h4>Background</h4>The Psychiatric Out-Patient Experiences Questionnaire (POPEQ) is an 11-item core measure of psychiatric out-patients experiences of the perceived outcome of the treatment, the quality of interaction with the clinician, and the quality of information provision. The POPEQ was found to have evidence for reliability and validity following the application of classical test theory but has not previously been assessed by Rasch analysis.<h4>Methods</h4>Two national postal surveys of p ...[more]

PMID: 20920164

Similar Datasets

Project description:Background:The Patient-Rated Wrist Evaluation (PRWE) was developed as a wrist joint specific measure of pain and disability and evidence of sound validity has been accumulated through classical psychometric methods. Rasch analysis (RA) has been endorsed as a newer method for analyzing the clinical measurement properties of self-report outcome measures. The purpose of this study was to evaluate the PRWE using Rasch modeling. Methods:We employed the Rasch model to assess overall fit, response scaling, individual item fit, differential item functioning (DIF), local dependency, unidimensionality and person separation index (PSI). A convenience sample of 382 patients with distal radius fracture was recruited from the hand and upper limb clinic at large academic healthcare organization, London, Ontario, Canada, 6-month post-injury scores of the PRWE was used. RA was conducted on the 3 subscales (pain, specific activities, and usual activities) of the PRWE separately. Results:The pain subscale adequately fit the Rasch model when item 4 "Pain - When it is at its worst" was deleted to eliminate non-uniform DIF by age group, and item 5 "How often do you have pain" was rescored by collapsing into 8 intervals to eliminate disordered thresholds. Uniform DIF for "Use my affected hand to push up from the chair" (by work status) and "Use bathroom tissue with my affected hand" (by injured hand) was addressed by splitting the items for analysis. After background rescoring of 2 items in pain subscale, 2 items in specific activities and 3 items in usual activities, all three subscales of the PRWE were well targeted and had high reliability (PSI?=?0.86). These changes provided a unidimensional, interval-level scaled measure. Conclusion:Like a previous analysis of the Patient-Rated Wrist and Hand Evaluation, this study found the PRWE could be fit to the Rasch model with rescoring of multiple items. However, the modifications required to achieve fit were not the same across studies, our fit statistics also suggested one of the pain items should be deleted. This study adds to the pool of evidence supporting the PRWE, but cannot confidently provide a Rasch-based scoring algorithm.

Project description:BackgroundMeasuring patient experiences at psychiatric inpatient departments for the elderly need measurements adapted to the situation and challenges of the age group. We did not find any such instrument. The aim of this study then was to develop and document the measurement properties of a reliable and valid questionnaire about experiences of patients without severe neurocognitive disturbances at psychiatric inpatient departments for the elderly, which can be used in quality improvement and research.MethodsAiming for good content validity, we developed a questionnaire with 37 questions based on a review of the literature on important aspects for the elderly in psychiatric inpatient departments and on feedback from elderly patients from other questionnaires developed for use in psychiatric departments for adults. Using this first questionnaire, we collected data from 151 patients in psychiatric departments for the elderly in nine health trusts. We then revised the questionnaire based on comments from patients and interviewers on the questions, and we decided which questions we would keep and which we needed to adjust to improve clarity. This resulted in a final questionnaire of 20 questions. We analyzed the internal structure (factors and their internal consistency) of this final questionnaire based on data collected from a new sample of 96 patients. To test the construct validity of the questionnaire, a sample of 26 service user representatives, clinicians and researchers were asked to sort the questions based on identified factors.ResultsThe final questionnaire consisted of 20 questions giving a valid and reliable measurement tool with four subscales: Patient-centered Interaction, Outcome, Care and Safety, and Information on Rights. Very few unanswered questions indicate that the questionnaire is feasible, as patients seemed to understand the questions and the response scales well. It is desirable that structural validity is confirmed with a larger sample.ConclusionOur final questionnaire "Patient Experiences in Psychiatric Departments for the Elderly" (PEPDE) has adequate measurement properties and seems to be well understood. It can be used as a questionnaire or an interview for quality improvement and research.

Project description:BACKGROUND: Approximately 40 percent of individuals using out-of-network physicians experience involuntary out-of-network care, leading to unexpected and sometimes burdensome financial charges. Despite its prevalence, research on patient experiences with involuntary out-of-network care is limited. Greater understanding of patient experiences may inform policy solutions to address this issue. OBJECTIVE: To characterize the experiences of patients who encountered involuntary out-of-network physician charges. METHODS: Qualitative study using 26 in-depth telephone interviews with a semi-structured interview guide. Participants were a purposeful sample of privately insured adults from across the United States who experienced involuntary out-of-network care. They were diverse with regard to income level, education, and health status. Recurrent themes were generated using the constant comparison method of data analysis by a multidisciplinary team. RESULTS: Four themes characterize the perspective of individuals who experienced involuntary out-of-network physician charges: (1) responsibilities and mechanisms for determining network participation are not transparent; (2) physician procedures for billing and disclosure of physician out-of-network status are inconsistent; (3) serious illness requiring emergency care or hospitalization precludes ability to choose a physician or confirm network participation; and (4) resources for mediation of involuntary charges once they occur are not available. CONCLUSIONS: Our data reveal that patient education may not be sufficient to reduce the prevalence and financial burden of involuntary out-of-network care. Participants described experiencing involuntary out-of-network health care charges due to system-level failures. As policy makers seek solutions, our findings suggest several potential areas of further consideration such as standardization of processes to disclose that a physician is out-of-network, holding patients harmless not only for out-of-network emergency room care but also for non-elective hospitalization, and designation of a mediator for involuntary charges.

Project description:BACKGROUND:Person-centred care is the bedrock of modern dementia services, yet the evidence-base to support its implementation is not firmly established. Research is hindered by a need for more robust measurement instruments. The 14-item Person-Centred Climate Questionnaire - Staff version (PCQ-S) is one of the most established scales and has promising measurement properties. However, its construction under classical test theory methods leaves question marks over its rigour and the need for evaluation under more modern testing procedures. METHODS:The PCQ-S was self-completed by nurses and other care staff working across nursing homes in 35 Swedish municipalities in 2013/14. A Rasch analysis was undertaken in RUMM2030 using a partial credit model suited to the Likert-type items. Three subscales of the PCQ-S were evaluated against common thresholds for overall fit to the Rasch model; ordering of category thresholds; unidimensionality; local dependency; targeting; and Differential Item Functioning. Three subscales were evaluated separately as unidimensional models and then combined as subtests into a single measure. Due to large number of respondents (n?=?4381), two random sub-samples were drawn, with a satisfactory model established in the first ('evaluation') and confirmed in the second ('validation'). Final item locations and a table converting raw scores to Rasch-transformed values were created using the full sample. RESULTS:All three subscales had disordered thresholds for some items, which were resolved by collapsing categories. The three subscales fit the assumptions of the Rasch model after the removal of two items, except for subscale 3, where there was evidence of local dependence between two items. By forming subtests, the 3 subscales were combined into a single Rasch model which had satisfactory fit statistics. The Rasch form of the instrument (PCQ-S-R) had an adequate but modest Person Separation Index (<?0.80) and some evidence of mistargeting due to a low number of 'difficult-to-endorse' items. CONCLUSIONS:The PCQ-S-R has 12 items and can be used as a unidimensional scale with interval level properties, using the nomogram presented within this paper. The scale is reliable but has some inefficiencies due to too few high-end thresholds inhibiting discrimination amongst populations who already perceive that person-centred care is very good in their environment.

Dataset Information

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ).

Background

Methods

Results

Conclusions

Publications

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets