Dataset Information

Exploring the measurement properties of the osteopathy clinical teaching questionnaire using Rasch analysis.

ABSTRACT: Clinical teaching evaluations are common in health profession education programs to ensure students are receiving a quality clinical education experience. Questionnaires students use to evaluate their clinical teachers have been developed in professions such as medicine and nursing. The development of a questionnaire that is specifically for the osteopathy on-campus, student-led clinic environment is warranted. Previous work developed the 30-item Osteopathy Clinical Teaching Questionnaire. The current study utilised Rasch analysis to investigate the construct validity of the Osteopathy Clinical Teaching Questionnaire and provide evidence for the validity argument through fit to the Rasch model.Senior osteopathy students at four institutions in Australia, New Zealand and the United Kingdom rated their clinical teachers using the Osteopathy Clinical Teaching Questionnaire. Three hundred and ninety-nine valid responses were received and the data were evaluated for fit to the Rasch model. Reliability estimations (Cronbach's alpha and McDonald's omega) were also evaluated for the final model.The initial analysis demonstrated the data did not fit the Rasch model. Accordingly, modifications to the questionnaire were made including removing items, removing person responses, and rescoring one item. The final model contained 12 items and fit to the Rasch model was adequate. Support for unidimensionality was demonstrated through both the Principal Components Analysis/t-test, and the Cronbach's alpha and McDonald's omega reliability estimates. Analysis of the questionnaire using McDonald's omega hierarchical supported a general factor (quality of clinical teaching in osteopathy).The evidence for unidimensionality and the presence of a general factor support the calculation of a total score for the questionnaire as a sufficient statistic. Further work is now required to investigate the reliability of the 12-item Osteopathy Clinical Teaching Questionnaire to provide evidence for the validity argument.

SUBMITTER: Vaughan B

PROVIDER: S-EPMC5932865 | biostudies-other | 2018

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Exploring the measurement properties of the osteopathy clinical teaching questionnaire using Rasch analysis.

Vaughan Brett B

Chiropractic & manual therapies 20180503

<h4>Background</h4>Clinical teaching evaluations are common in health profession education programs to ensure students are receiving a quality clinical education experience. Questionnaires students use to evaluate their clinical teachers have been developed in professions such as medicine and nursing. The development of a questionnaire that is specifically for the osteopathy on-campus, student-led clinic environment is warranted. Previous work developed the 30-item Osteopathy Clinical Teaching Q ...[more]

PMID: 29744031

Similar Datasets

Project description:BackgroundMobile health (mHealth) apps offer great opportunities to deliver large-scale, cost-efficient digital solutions for implementing lifestyle changes. Furthermore, many mHealth apps act as medical devices. Yet, there is little research on how to assess user satisfaction with an mHealth solution.ObjectiveThis study presents the development of the mHealth Satisfaction Questionnaire and evaluates its measurement properties.MethodsRespondents who took part in the Health Integrator Study and were randomized to use the Health Integrator smartphone app for lifestyle changes (n=112), with and without additional telephone coaching, rated their satisfaction with the app using the new 14-item mHealth Satisfaction Questionnaire. The ratings were given on a 5-point Likert scale and measurement properties were evaluated using Rasch measurement theory (RMT).ResultsOptimal scoring was reached when response options 2, 3, and 4 were collapsed, giving three response categories. After omitting two items that did not fit into the scale, fit residuals were within, or close to, the recommended range of ±2.5. There was no differential item functioning between intervention group, age group, or sex. The Person Separation Index was 0.79, indicating that the scale's ability to discriminate correctly between person leniency was acceptable for group comparisons but not for individual evaluations. The scale did not meet the criterion of unidimensionality; 16.1% (18/112) of the respondents were outside the desired range of -1.96 to 1.96. In addition, several items showed local dependency and three underlying dimensions emerged: negative experiences, positive experiences, and lifestyle consequences of using the mHealth solution.ConclusionsIn times where mHealth apps and digital solutions are given more attention, the mHealth Satisfaction Questionnaire provides a new possibility to measure user satisfaction to ensure usability and improve development of new apps. Our study is one of only a few cases where RMT has been used to evaluate the usability of such an instrument. There is, though, a need for further development of the mHealth Satisfaction Questionnaire, including the addition of more items and consideration of further response options. The mHealth Satisfaction Questionnaire should also be evaluated in a larger sample and with other mHealth apps and in other contexts.Trial registrationClinicalTrials.gov NCT03579342; http://clinicaltrials.gov/ct2/show/NCT03579342.

Project description:BACKGROUND:Birth satisfaction represents a complex construct of implicit and profound relevance to a woman's perceived birth experience. It correlates with the childbearing woman's experience of the quality of care received and stress during labor. This study aimed to examine the psychometric properties of the Malay language version of the Women's Views of Birth Labour Satisfaction Questionnaire (WOMBLSQ) on labor satisfaction using the Rasch rating scale model. METHODS:A cross-sectional study was conducted. The translated Malay version of the WOMBLSQ was completed by 200 postpartum women in a tertiary hospital. The Rasch model was applied to investigate the statistics, unidimensionality, item polarity and misfit, person misfit and person item distribution map. RESULTS:The Rasch analysis showed that the 27 items, in nine dimensions, had high item reliability and item separation at 0.98 and 7.65 respectively, while good person reliability and person separation were at 0.78 and 1.90, respectively. Item 6 ('My birth partner/husband couldn't have supported me any better') (outfit MnSq?=?1.74, outfit z-std?=?6.9, PtMea Corr?=?-?0.02) and Item 5 ('My birth partner/husband helped me to understand what was going on when I was in labor') (outfit MnSq?=?1.65, outfit z-std?=?2.9, PtMea Corr?=?0.13) are misfit. Item 6 needs to be re-examined for removal or rephrasing, while Item 5 correlates poorly with the construct. Eight persons have the most misfitting response strings based on Item 6 but extremely trivial differences were found in the parameter estimates after refitting the model. Ten items easily endorse satisfaction from the respondents. CONCLUSION:The WOMBLSQ tested among postpartum women has been shown to have a good person reliability index and a high item reliability index. Items 5 and 6 do not contribute in the construction of scale but not degrading and suggested for refining. The spread of item difficulty should be improved in the future modification of items.

Project description:INTRODUCTION:Colorectal cancer (CRC) is one of the most common cancer diagnoses among both sexes. Sweden has not yet implemented any CRC screening programme, but a study, Screening of Swedish Colons (SCREESCO), is ongoing. The movement within the health care sector towards a more participatory perspective has led to the increased importance of shared decision making (SDM), and this is suggestively applied when deciding upon screening participation. There is no Swedish questionnaire for assessing the level of SDM in relation to CRC screening. Therefore, the CRC screening module of the National Survey of Medical Decisions was translated and culturally adapted into a Swedish context: the SCREESCO questionnaire. AIM:The SCREESCO questionnaire requires further evaluation, and therefore, the aim, by using the Rasch approach, was to evaluate the psychometric properties of the SCREESCO questionnaire. METHODS:A Rasch partial credit model was chosen to investigate the psychometric properties. The sample consisted of individuals invited to the SCREESCO programme, who have answered the SCREESCO questionnaire. RESULTS:Rating scale structures indicated stability for the response structure used. Satisfactory evidence for validity of internal structure was also shown for the whole questionnaire and two of three concepts/subscales, after deletion of a few items. Validity in response processes indicated acceptable, or close to acceptable, findings, while the results for unidimensionality and differential item functioning (DIF) were somewhat mixed. Separation index revealed less satisfactory results, both for the whole questionnaire and the concepts/subscales. CONCLUSION:This Rasch analysis of the SCREESCO questionnaire revealed that the questionnaire in its current form has difficulties to assess the level of SDM in relation to CRC screening. The achieved results will guide further evaluation and development with the long-term goal of having a Swedish questionnaire, to be used in the health care sector, assessing the level of SDM in relation to CRC screening.

Project description:BackgroundMultimorbidity is a burden for the individual and to the healthcare sector worldwide, leading to a rising number of intervention studies towards this patient group. To measure a possible effect of such interventions, an adequate patient-reported outcome measure (PROM) is essential. The aim of this study was to assess the draft MultiMorbidity Questionnaire (MMQ), a PROM measuring needs-based quality of life and self-perceived inequity in patients with multimorbidity, for its psychometric properties and to adjust it accordingly to create a content- and construct valid measure.MethodsThe draft MMQ was sent to 1198 eligible respondents with multimorbidity. Modern test theory and classical test theory were used to analyse data. Dimensionality of the suggested domains and invariance of the items were assessed through item analysis, examining the fit to a psychometric model.ResultsThe psychometric analyses were based on responses from 390 patients with multimorbidity. In the MMQ1, measuring needs-based QoL, evidence of six unidimensional scales was confirmed: physical ability (6 items), worries (6 items), limitations in everyday life (10 items), my social life (6 items), self-image (6 items), and personal finances (3 items). The psychometric analyses of the MMQ2 outlined four unidimensional scales measuring the feeling of Self-perceived inequity in patients with multimorbidity: experiences of being stigmatised (4-5 items), Experiences of insufficient understanding of the burden of disease (3 items), Experiences of not being seen and heard (4 items), Experience of powerlessness (5 items). These scales are relevant for patients' with multimorbidity encounters with (1) their general pratitioner, (2) staff at their general practitioner's surgery, (3) healthcare professionals, (4) staff at the local authorities and (5) friends, family, and others.ConclusionThe MMQ, a QoL measure for patients living with multimorbidity has been validated: the MMQ1 is a condition-specific PROM with adequate psychometric properties designed to measure needs-based QoL. The MMQ2 measuring Self-perceived inequity, has also been found to possess adequate measurement properties; however due to the risk of type 2 error a revalidation of MMQ2 is suggested.

Project description:Background:The Patient-Rated Wrist Evaluation (PRWE) was developed as a wrist joint specific measure of pain and disability and evidence of sound validity has been accumulated through classical psychometric methods. Rasch analysis (RA) has been endorsed as a newer method for analyzing the clinical measurement properties of self-report outcome measures. The purpose of this study was to evaluate the PRWE using Rasch modeling. Methods:We employed the Rasch model to assess overall fit, response scaling, individual item fit, differential item functioning (DIF), local dependency, unidimensionality and person separation index (PSI). A convenience sample of 382 patients with distal radius fracture was recruited from the hand and upper limb clinic at large academic healthcare organization, London, Ontario, Canada, 6-month post-injury scores of the PRWE was used. RA was conducted on the 3 subscales (pain, specific activities, and usual activities) of the PRWE separately. Results:The pain subscale adequately fit the Rasch model when item 4 "Pain - When it is at its worst" was deleted to eliminate non-uniform DIF by age group, and item 5 "How often do you have pain" was rescored by collapsing into 8 intervals to eliminate disordered thresholds. Uniform DIF for "Use my affected hand to push up from the chair" (by work status) and "Use bathroom tissue with my affected hand" (by injured hand) was addressed by splitting the items for analysis. After background rescoring of 2 items in pain subscale, 2 items in specific activities and 3 items in usual activities, all three subscales of the PRWE were well targeted and had high reliability (PSI?=?0.86). These changes provided a unidimensional, interval-level scaled measure. Conclusion:Like a previous analysis of the Patient-Rated Wrist and Hand Evaluation, this study found the PRWE could be fit to the Rasch model with rescoring of multiple items. However, the modifications required to achieve fit were not the same across studies, our fit statistics also suggested one of the pain items should be deleted. This study adds to the pool of evidence supporting the PRWE, but cannot confidently provide a Rasch-based scoring algorithm.

Dataset Information

Exploring the measurement properties of the osteopathy clinical teaching questionnaire using Rasch analysis.

Publications

Exploring the measurement properties of the osteopathy clinical teaching questionnaire using Rasch analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets