Dataset Information

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ).

ABSTRACT:

Background

The Psychiatric Out-Patient Experiences Questionnaire (POPEQ) is an 11-item core measure of psychiatric out-patients experiences of the perceived outcome of the treatment, the quality of interaction with the clinician, and the quality of information provision. The POPEQ was found to have evidence for reliability and validity following the application of classical test theory but has not previously been assessed by Rasch analysis.

Methods

Two national postal surveys of psychiatric outpatients took place in Norway in 2004 and 2007. The performance of the POPEQ, including item functioning and differential item functioning, was assessed by Rasch analysis. Principal component analysis of item residuals was used to assess the presence of subdimensions.

Results

6,677 (43.3%) and 11,085 (35.2%) psychiatric out patients responded to the questionnaire in 2004 and 2007, respectively. All items in the scale were retained after the Rasch analysis. The resulting scale had reasonably good fit to the Rasch model. The items performed the same for the two survey years and there was no differential item functioning relating to patient characteristics. Principal component analysis of the residuals confirmed that the measure to a high degree is unidimensional. However, the data also reflects three potential subscales, each relating to one of the three included aspects of health care.

Conclusions

The POPEQ had excellent psychometric properties and Rasch analysis further supported the construct validity of the scale by also identifying the three subdimensions originally included as components in the instrument development. The 11-item instrument is recommended in future research on psychiatric out-patient experiences. Future development may lead to the construction of more precise measures of the three subdomains that the POPEQ is based on.

SUBMITTER: Olsen RV

PROVIDER: S-EPMC2955020 | biostudies-literature | 2010 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ).

Olsen Rolf V RV Garratt Andrew M AM Iversen Hilde H HH Bjertnaes Oyvind A OA

BMC health services research 20100928

<h4>Background</h4>The Psychiatric Out-Patient Experiences Questionnaire (POPEQ) is an 11-item core measure of psychiatric out-patients experiences of the perceived outcome of the treatment, the quality of interaction with the clinician, and the quality of information provision. The POPEQ was found to have evidence for reliability and validity following the application of classical test theory but has not previously been assessed by Rasch analysis.<h4>Methods</h4>Two national postal surveys of p ...[more]

PMID: 20920164

Similar Datasets

Project description:Background:The Patient-Rated Wrist Evaluation (PRWE) was developed as a wrist joint specific measure of pain and disability and evidence of sound validity has been accumulated through classical psychometric methods. Rasch analysis (RA) has been endorsed as a newer method for analyzing the clinical measurement properties of self-report outcome measures. The purpose of this study was to evaluate the PRWE using Rasch modeling. Methods:We employed the Rasch model to assess overall fit, response scaling, individual item fit, differential item functioning (DIF), local dependency, unidimensionality and person separation index (PSI). A convenience sample of 382 patients with distal radius fracture was recruited from the hand and upper limb clinic at large academic healthcare organization, London, Ontario, Canada, 6-month post-injury scores of the PRWE was used. RA was conducted on the 3 subscales (pain, specific activities, and usual activities) of the PRWE separately. Results:The pain subscale adequately fit the Rasch model when item 4 "Pain - When it is at its worst" was deleted to eliminate non-uniform DIF by age group, and item 5 "How often do you have pain" was rescored by collapsing into 8 intervals to eliminate disordered thresholds. Uniform DIF for "Use my affected hand to push up from the chair" (by work status) and "Use bathroom tissue with my affected hand" (by injured hand) was addressed by splitting the items for analysis. After background rescoring of 2 items in pain subscale, 2 items in specific activities and 3 items in usual activities, all three subscales of the PRWE were well targeted and had high reliability (PSI?=?0.86). These changes provided a unidimensional, interval-level scaled measure. Conclusion:Like a previous analysis of the Patient-Rated Wrist and Hand Evaluation, this study found the PRWE could be fit to the Rasch model with rescoring of multiple items. However, the modifications required to achieve fit were not the same across studies, our fit statistics also suggested one of the pain items should be deleted. This study adds to the pool of evidence supporting the PRWE, but cannot confidently provide a Rasch-based scoring algorithm.

Project description:BACKGROUND: Approximately 40 percent of individuals using out-of-network physicians experience involuntary out-of-network care, leading to unexpected and sometimes burdensome financial charges. Despite its prevalence, research on patient experiences with involuntary out-of-network care is limited. Greater understanding of patient experiences may inform policy solutions to address this issue. OBJECTIVE: To characterize the experiences of patients who encountered involuntary out-of-network physician charges. METHODS: Qualitative study using 26 in-depth telephone interviews with a semi-structured interview guide. Participants were a purposeful sample of privately insured adults from across the United States who experienced involuntary out-of-network care. They were diverse with regard to income level, education, and health status. Recurrent themes were generated using the constant comparison method of data analysis by a multidisciplinary team. RESULTS: Four themes characterize the perspective of individuals who experienced involuntary out-of-network physician charges: (1) responsibilities and mechanisms for determining network participation are not transparent; (2) physician procedures for billing and disclosure of physician out-of-network status are inconsistent; (3) serious illness requiring emergency care or hospitalization precludes ability to choose a physician or confirm network participation; and (4) resources for mediation of involuntary charges once they occur are not available. CONCLUSIONS: Our data reveal that patient education may not be sufficient to reduce the prevalence and financial burden of involuntary out-of-network care. Participants described experiencing involuntary out-of-network health care charges due to system-level failures. As policy makers seek solutions, our findings suggest several potential areas of further consideration such as standardization of processes to disclose that a physician is out-of-network, holding patients harmless not only for out-of-network emergency room care but also for non-elective hospitalization, and designation of a mediator for involuntary charges.

Project description:BACKGROUND:Person-centred care is the bedrock of modern dementia services, yet the evidence-base to support its implementation is not firmly established. Research is hindered by a need for more robust measurement instruments. The 14-item Person-Centred Climate Questionnaire - Staff version (PCQ-S) is one of the most established scales and has promising measurement properties. However, its construction under classical test theory methods leaves question marks over its rigour and the need for evaluation under more modern testing procedures. METHODS:The PCQ-S was self-completed by nurses and other care staff working across nursing homes in 35 Swedish municipalities in 2013/14. A Rasch analysis was undertaken in RUMM2030 using a partial credit model suited to the Likert-type items. Three subscales of the PCQ-S were evaluated against common thresholds for overall fit to the Rasch model; ordering of category thresholds; unidimensionality; local dependency; targeting; and Differential Item Functioning. Three subscales were evaluated separately as unidimensional models and then combined as subtests into a single measure. Due to large number of respondents (n?=?4381), two random sub-samples were drawn, with a satisfactory model established in the first ('evaluation') and confirmed in the second ('validation'). Final item locations and a table converting raw scores to Rasch-transformed values were created using the full sample. RESULTS:All three subscales had disordered thresholds for some items, which were resolved by collapsing categories. The three subscales fit the assumptions of the Rasch model after the removal of two items, except for subscale 3, where there was evidence of local dependence between two items. By forming subtests, the 3 subscales were combined into a single Rasch model which had satisfactory fit statistics. The Rasch form of the instrument (PCQ-S-R) had an adequate but modest Person Separation Index (<?0.80) and some evidence of mistargeting due to a low number of 'difficult-to-endorse' items. CONCLUSIONS:The PCQ-S-R has 12 items and can be used as a unidimensional scale with interval level properties, using the nomogram presented within this paper. The scale is reliable but has some inefficiencies due to too few high-end thresholds inhibiting discrimination amongst populations who already perceive that person-centred care is very good in their environment.

Project description:Clinical teaching evaluations are common in health profession education programs to ensure students are receiving a quality clinical education experience. Questionnaires students use to evaluate their clinical teachers have been developed in professions such as medicine and nursing. The development of a questionnaire that is specifically for the osteopathy on-campus, student-led clinic environment is warranted. Previous work developed the 30-item Osteopathy Clinical Teaching Questionnaire. The current study utilised Rasch analysis to investigate the construct validity of the Osteopathy Clinical Teaching Questionnaire and provide evidence for the validity argument through fit to the Rasch model.Senior osteopathy students at four institutions in Australia, New Zealand and the United Kingdom rated their clinical teachers using the Osteopathy Clinical Teaching Questionnaire. Three hundred and ninety-nine valid responses were received and the data were evaluated for fit to the Rasch model. Reliability estimations (Cronbach's alpha and McDonald's omega) were also evaluated for the final model.The initial analysis demonstrated the data did not fit the Rasch model. Accordingly, modifications to the questionnaire were made including removing items, removing person responses, and rescoring one item. The final model contained 12 items and fit to the Rasch model was adequate. Support for unidimensionality was demonstrated through both the Principal Components Analysis/t-test, and the Cronbach's alpha and McDonald's omega reliability estimates. Analysis of the questionnaire using McDonald's omega hierarchical supported a general factor (quality of clinical teaching in osteopathy).The evidence for unidimensionality and the presence of a general factor support the calculation of a total score for the questionnaire as a sufficient statistic. Further work is now required to investigate the reliability of the 12-item Osteopathy Clinical Teaching Questionnaire to provide evidence for the validity argument.

Project description:BackgroundThe aim of this study was to develop, together with the Lung Foundation Netherlands and Dutch Kidney Patients Association, patients and clinicians, a measure to evaluate patient experiences with the orphan drugs pirfenidone (for idiopathic pulmonary fibrosis [IPF]) and eculizumab (for atypical haemolytic uraemic syndrome [aHUS]), as well as a generic measure of patient experiences and satisfaction with medications.MethodsDevelopment of the Patient Experiences and Satisfaction with Medications (PESaM) questionnaire consisted of four phases: literature review (phase I); focus groups and individual patient interviews (phase II); item generation (phase III); and face and content validity testing (phase IV). Literature review aimed to identify existing disease-specific and generic patient experience measures to provide guidance on the domains of medication use relevant to patients, the number of items and type of response categories, and to generate an initial pool of items. Subsequent focus groups and patient interviews were conducted to gain insight into the perceived effectiveness of the therapies, the burden of side effects, and how the medication impacted on a patient's daily life. Focus groups and interviews were recorded and transcribed verbatim. Coding was carried out by highlighting passages in the text and assigning each passage a code representing the following predefined categories: (1) perceived effectiveness; (2) side effects; (3) ease of use; and (4) impact of medication. Using data from phase I and II, a panel of experts selected items relevant for inclusion in the questionnaire. Individual patient interviews with IPF and aHUS patients (n = 18), using a retrospective verbal probing technique, were conducted to assess face validity, time needed to fill out the questionnaire, and content validity.ResultsThe PESaM questionnaire that was developed consisted of two disease-specific modules that assessed patient experiences with pirfenidone for the treatment of IPF, and eculizumab for the treatment of aHUS, a generic module, applicable to any medication, and a module to assess patient expectations. Review of the literature identified multiple disease- or medication-specific questionnaires and two generic patient satisfaction questionnaires. Common domains across most questionnaires were effectiveness, side effects, ease of use and overall satisfaction. Patient interviews revealed the social impact (e.g. unable to go outside) of side effects such as photosensitivity associated with pirfenidone and the risk of infection associated with eculizumab. Each PESaM module focuses on patients' perceived effectiveness of the medication, side effects, and ease of use, and the impact these aspects have on physical and emotional health and daily life. The generic module additionally includes items related to satisfaction with the medication. Individual interviews with patients in phase IV confirmed, in general, that questions and response options of the modules were clear and content validity was good. The mean time to complete the modules ranged from 6 min for the disease-specific (aHUS) module to 9 min for the generic module.ConclusionsWe developed the PESaM questionnaire to quantitatively assess patient experiences and satisfaction with medications. A validation study is currently underway to examine the psychometric properties of the PESaM questionnaire.

Dataset Information

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ).

Background

Methods

Results

Conclusions

Publications

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure