Dataset Information

Optimizing the ULV-VFQ for Clinical Use Through Item Set Reduction: Psychometric Properties and Trade-Offs.

ABSTRACT:

Purpose

We examine the dimensionality of the 150-item visual functioning questionnaire for individuals with ultralow vision (ULV-VFQ) and develop representative abbreviated versions, facilitating clinical use, while retaining compatibility with a 17-item performance assessment.

Methods

Subsets with 50 and 23 items covering the full difficulty range were selected, with evenly spaced item measures (IMs) and good representation of visual aspects and functional domains. Person measures (PMs) for the anchored subsets were derived through Rasch analysis of data from 80 respondents.

Results

Fit statistics for the reduced item sets were similar to those for the full set, with reliabilities at or above 95%. Mean PMs in the reduced sets were within 0.8 standard errors (SEs) of those in the full set. SEs of the PMs increased from the SE for 150 items, roughly in inverse proportion with the square root of the set size. Unexplained variance levels (24%-27%) and variance of the first unexplained factor (3.3%-3.9%) were close to those (30% and 2.6%) for 150 items. Differential item functions for omitted items were negligible. Aspects and domains are adequately represented in the reduced sets.

Conclusions

Self-reported visual ability can be measured accurately using appropriately chosen anchored subsets of the ULV-VFQ. Functional ability of individuals with ULV is characterized adequately by a single dimension.

Translational relevance

The ULV-VFQ50 and ULV-VFQ23, using anchored IMs from the 150-item ULV-VFQ, provide an efficient and reliable self-report assessment of visual ability in individuals whose visual impairment is too severe for assessment with VFQs currently in use.

SUBMITTER: Dagnelie G

PROVIDER: S-EPMC5450924 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundTo evaluate the reliability and construct validity of a Greek version of the NEI-VFQ-25 in patients with chronic ophthalmic diseases.MethodsWe developed the Greek version of the instrument using forward and backward translation. One hundred-eighty-six patients responded to the questionnaire. To examine reliability, Cronbach's alpha for each subscale was used as an index of internal consistency. Test-retest reliability was evaluated with intraclass correlation coefficients. Regarding construct validity, both convergent and discriminant validities were calculated by means of multi-trait analysis. Rasch analysis was used to estimate the visual ability required by each item for a particular response, and each patient's visual ability. Correspondingly, instrument validity was evaluated by estimating the distribution of residuals for item and subject measures.ResultsFour patient groups were studied, each including participants with a single cause of visual impairment. Group 1 consisted of 84 glaucoma subjects. Group 2 included 30 subjects with age-related macular degeneration (ARMD); group 3 included 25 subjects with dry-eye syndrome, whereas group 4 included 18 cataract patients. Twenty-nine healthy individuals comprised the control group. NEI-VFQ scores (mean +/- SD) for the glaucoma, ARMD, dry-eye, cataract and control groups were: 76.9 +/- 20.2, 70.9 +/- 20.2, 81.6 +/- 16.5, 73.5 +/- 24.0 and 93.7 +/- 8.9 respectively. Item analysis revealed no significant data skewing. Cronbach's alpha ranged from 0.678 to 0.926, with most subscales having high internal consistency. Intraclass correlation coefficient ranged from 0.717 to 0.910 for all subscales. All items passed the convergent and discriminant validity tests. Strong correlations were detected between visual acuity and "general vision", "distant activities" and "near activities" subscales. Significant correlations were also detected between visual field deficits and the "peripheral vision" and "general vision" subscales. Rasch analysis revealed potential weaknesses of the instrument that are associated with the assumptions of the model itself. Specifically, low precision of the "agreement" items was detected in the estimation of visual ability. Twenty-three percent of the subjects had fit statistics that fell outside the tolerance box.ConclusionAlthough traditional validation methods indicated that the Greek version of the NEI-VFQ-25 is a valid and reliable instrument for VS-QoL assessment, Rasch analysis detected significant misfits to the model, especially of the "agreement" items. This means that results of the corresponding subscales should be interpreted with extreme caution.

Project description:BackgroundUndergraduates' workplace learning is an important part of health sciences education. Educational psychology research considers many different aspects of self-regulated learning at the workplace, including cognition, motivation, emotions, and context. Multivariate longitudinal and diary studies in this field require fewer items than alternatives or even a single item per construct and can reveal the sub-processes of workplace learning and contribute to a better understanding of students' learning. Short instruments are necessary for application in workplace settings, especially stressful ones, to mitigate survey fatigue. The present study aimed to assess the psychometric properties of single items measuring various aspects of workplace learning.MethodsTwenty-nine single items selected from the Workplace Learning Inventory in Health Sciences Education were analyzed for reliability, information reproduction, and relationships within the nomological network. The authors additionally analyzed four generally formulated single items' relationships with the full Workplace Learning Inventory scales and external criteria within the nomological network. Participants were 214 ninth- or tenth-semester veterinary medicine students in Austria and Germany who were learning at varied workplaces during the winter semester of 2021/2022.ResultsOf the 29 single items selected from existing scales, 27 showed sufficient reliability, but mixed results were obtained regarding validity. Although the items' relationships within the nomological network were similar to those of the full scales, information reproduction was insufficient for most items. The four general single items showed acceptable validity, but the reliability of these measures of states could not be assessed.ConclusionsThis paper reported findings on the psychometric properties of single items for undergraduates' workplace learning in health science education. The findings are crucial for deciding whether to use scales versus single-item measures in future studies. By applying the findings, researchers can be more economical in their workplace learning data collection and can include more constructs.