Health behavior inventory – short form: a Chinese validation study using classical test theory and item response theory
Ontology highlight
ABSTRACT:
SUBMITTER: Tong L
PROVIDER: S-EPMC11340048 | biostudies-literature | 2024 Jan
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundThere is currently no dedicated measurement for assessing nursing students' study interest in China. Considering the good reliability, validity, and widespread applicability of the Study Interest Questionnaire-Short Form (SIQ-SF), the objective of this study was to validate its usage among Chinese nursing students.MethodsThe translation and cross-cultural adaptation rigorously followed the modified Brislin model. A cross-sectional survey was conducted using the Chinese version of the SIQ-SF and convenience sampling was employed to select nursing students. The Psychometric evaluation of the Chinese version of the SIQ-SF was conducted based on Classical Test Theory and Item Response Theory.ResultsA total of 1158 participants were included in the analysis. The item-level content validity index (CVI) ranged from 0.9 to 1.0, and the scale-level CVI was 0.98. In the Exploratory factor analysis, three factors with eigenvalues above 1 were identified, accounting for 62.554% of the cumulative variance. In the confirmatory factor analysis, the CMIN\DF was 5.639, the GFI was 0.953, the CFI was 0.902, and the IFI was 0.904. The Cronbach's α coefficient of the Chinese version of the SIQ-SF was 0.70. Thirty-one participants were invited to sign the scale after two weeks. The intraclass correlation coefficient was 0.784, and that of items ranged from 0.70 to 0.819. The infit MnSQ values ranged between 0.76 and 1.51, and the outfit MnSQ values ranged between 0.72 and 1.76. The point-measure correlation value ranged between 0.30 and 0.68. The item difficulty measures ranged from - 0.66 to 1.44 logit and the individual learning interest estimations ranged from - 4.22 to 4.97 logit. DIF contrast ranged from 0.00 to 0.33 logits, with all p values greater than 0.05.ConclusionsThe Chinese version of the SIQ-SF demonstrated acceptable reliability and validity among Chinese nursing students and could be used to assess nursing students' study interest in China. With the aid of this scale, teachers can gain a better understanding of nursing students' study interests, thereby maximizing their learning effects through appropriate content and methods.
| S-EPMC11459697 | biostudies-literature
Project description:BackgroundHigh-fidelity simulation (HFS) has become a widely used and established pedagogy for teaching clinical nursing skills. Nevertheless, there are few evidence-based instruments that validate the effectiveness of simulation learning in mainland China.MethodsThe Simulation Learning Effectiveness Inventory (SLEI) was adapted and validated for use in this study. Psychometric evaluation, incorporating classical test theory and item response theory (IRT) methods, was performed with 533 third-year undergraduate nursing students who were recruited from May 2017 to July 2018.ResultsThe findings of exploratory and confirmatory factor analyses revealed that the simplified Chinese version of the SLEI (SLEI-SC) was composed of six factors, namely, course arrangement, equipment resource, debriefing, clinical ability, problem solving, and confidence, which explained 60.84% of the total variance. The Cronbach's α, MIIC, marginal reliability, and test-retest reliability values obtained for the total scale were 0.88, 0.38, 0.96, and 0.88, respectively. Furthermore, the difference between the total scores for learning effectiveness pre- and post-course was statistically significant (t = 2.59, p < 0.05, Cohen's d = 0.60). IRT analysis showed that the SLEI-SC discriminates well between students with high and low levels of learning effectiveness and offers information about a broad range of learning effectiveness measures. The relationship between final course grade and total score on the SLEI-SC was statistically significant (r = 0.63, p < 0.05).ConclusionWe demonstrated initial psychometric evidence and support for the 31-item SLEI-SC as a developmentally appropriate instrument for assessing the learning effectiveness of all phases of HFS use with nursing students.
| S-EPMC7042430 | biostudies-literature
Project description:PURPOSE:The association of chronic lymphocytic leukemia (CLL) with health-related quality of life (HRQoL) is rarely studied globally. This study evaluated the psychometric properties of the EORTC-Chronic Lymphocytic Leukaemia (CLL17 [phase III]) module, a newly developed assessment on CLL patients' HRQoL, among Chinese CLL patients. METHODS:The Chinese CLL17, comprised of three subscales (symptom burden [SB], physical condition [PC] and worries/fears [WF]), was provided by the developer team through EORTC. A cross-sectional online survey was conducted to collect data. The classical traditional theory (CTT) and the item response theory (IRT) were used to evaluate the psychometric properties of CLL17. Internal consistency reliability was determined by the Cronbach's alpha and item-total correlation. Dimensionality was verified through confirmatory factor analysis (CFA). Convergent validity was also assessed. The generalized partial credit model was used for the IRT. The difficulty, discrimination, item fit, and differential item functioning (DIF) were calculated to assess the instrument's psychometric properties. RESULTS:In all, 318 patients, aged between 26 and 82 years, completed the questionnaire. A good level of internal reliability was achieved (Cronbach's alpha = 0.92). The item-total correlation coefficient ranged from 0.46 to 0.72. There was a mid-to-high correlation between CLL17 and domains of EQ-5D and QLQ-C30. The IRT model showed a satisfactory homogeneity, item fit and good discrimination of items, except for item 4, 6 and 16 (< 1.0). low information provided by item 16 and 17. SB and PC provided more information with theta > 0, whereas WF provided more information with theta < 0. Item 17 perform inconsistently for respondents from different age groups (DIF). CONCLUSION:The EORTC-CLL17 Chinese version shows acceptable reliability and validity, making it a valuable instrument to evaluate the impact on the HRQoL of Chinese CLL patients.
| S-EPMC7137502 | biostudies-literature
Project description:Obesity has become a serious social problem in industrialized countries in recent years. Clinically, although the evaluation of dietary behavior abnormalities is as important as any method of risk assessment for obesity, almost all the existing scales with many items may have numerous practical clinical difficulties. In this study, we aimed to prepare a short questionnaire to assess the dietary behavior abnormalities related to obesity. A total of 1032 individuals aged 20 to 59 years participated in the present study. Using item response theory (IRT), we selected the items for a short version from among 30 items of Sakata Eating Behavior Scale (EBS), which is widely used in Japan. As a result of the IRT-based analysis on the original 30-item version, 7 items were adopted as the short version. The correlation between the total score of the original EBS and the EBS short form was extremely high (r?=?0.93, P?=?.001). In examining the criterion validity, for all participants (n?=?1032), male (n?=?516), and female (n?=?516), the correlation coefficients between the total score of the EBS short form and body mass index (BMI) were r?=?0.26, r?=?0.28, and r?=?0.28, respectively. The results of the receiver operating characteristic analysis was performed with obesity BMI?>?25?kg/m as a dependent variable, the value of the area under the curve in the ROC was significantly higher in the 7-item version than in the total score of the original items (P?=?.0005). In conclusion, the 7-item EBS short form was created. Furthermore, it was found that the EBS short form is a reliable and valid measure that can be used as an indicator of obesity in both clinical and research settings.
| S-EPMC5662414 | biostudies-literature
Project description:BackgroundThe Neuropsychiatric Inventory (NPI) is a widely used scale for the assessment of the behavioral and psychological symptoms of dementia (BPSD). We previously developed a novel dementia scale, the ABC dementia scale, in the TRIAD1412 trial and we compared the BPSD domain scores with the NPI scores. We, therefore, considered that we should investigate the quality of the NPI items using statistical approaches.ObjectiveWe investigated the statistical characteristics of the 12 questions or items in the Japanese version of the NPI using the item response theory. This theory is the standard approach for the development of a new assessment scale and we used it to evaluate the quality of the items in the NPI.MethodsFirst, we performed factor analysis with Promax rotation to identify latent constructs in the data from 312 patients obtained in TRIAD1412. Second, following the result of the factor analysis, we divided the 12 items into domains and then investigated the characteristics of the sub-syndromes in each domain using item response category characteristic curves.ResultsWe found three latent constructs or domains: "hyperactivity," "psychosis and apathy," and "affect" (Cronbach's α= 0.68) in the 12 items. Further, the items on euphoria, apathy, and appetite and eating abnormalities did not provide sufficient information to estimate BPSD severity.ConclusionThe NPI item characteristics indicate that while the scale can distinguish whether patients have severe BPSD or not, it cannot estimate the degree of severity in a suspected case with a mild or unknown level of BPSD.
| S-EPMC7306920 | biostudies-literature
Project description:Clinical psychologists are advised to assess clinical and statistical significance when assessing change in individual patients. Individual change assessment can be conducted using either the methodologies of classical test theory (CTT) or item response theory (IRT). Researchers have been optimistic about the possible advantages of using IRT rather than CTT in change assessment. However, little empirical evidence is available to support the alleged superiority of IRT in the context of individual change assessment. In this study, the authors compared the CTT and IRT methods with respect to their Type I error and detection rates. Preliminary results revealed that IRT is indeed superior to CTT in individual change detection, provided that the tests consist of at least 20 items. For shorter tests, however, CTT is generally better at correctly detecting change in individuals. The results and their implications are discussed.
| S-EPMC5978722 | biostudies-literature
Project description:BackgroundThis study aimed to evaluate the reliability and validity of short form of the Core Seven Emotions Inventory (CSEI-s) scale.MethodsThe participants were third-grade Korean Medicine University students As with the original CSEI, the scales in the short form (CSEI-s) were composed of seven factors and consisted of 28 items in total. The internal consistency coefficient was calculated, and a confirmatory factor analysis was conducted to verify the reliability of the short form scale. Finally, to verify the validity of the abbreviated scale, a correlation analysis with the abbreviated scale and the CSEI-s scale was conducted.ResultsA 178 among 200 initial participants were included in the analysis (mean age: 24.5 years). The results of the exploratory factor analysis made from the 28 items of the seven factors of the CSEI-s showed that the factor loadings were as high as 0.64-0.89, excluding the tenth item of fear (0.52), and the model fit also had a good confirmatory factor with the analysis result. The results of the reliability verification showed that the Cronbach α values of all seven subscales of the short-form CSEI scale were 0.7 or higher, and the overall reliability was 0.83. A factor analysis revealed that the factor loadings were adequate, and their reliability and validity were confirmed for the CSEI-s scale, making it applicable to measuring the core seven emotions of patients in clinical practice.ConclusionCSEI-s scale may apply to measure core emotions of the patient in a clinical setting.
| S-EPMC6536744 | biostudies-literature
Project description:BackgroundThis study aims to validate the Chinese version of the Short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS) by employing both Classical Test Theory (CTT) and Item Response Theory (IRT) approaches.MethodsData were gathered through a population-based, cross-sectional health survey using an online self-reported questionnaire. The scale underwent Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). Measurement invariance by gender was assessed using standard procedures. The Grade Response Model (GRM) of the IRT analysis was applied to the data, estimating the discrimination and difficulty parameters at different thresholds. The results were analyzed both graphically and through parameter values.ResultsFactor analyses confirmed that a single-factor model of the scale fit the data well, with an overall Eigenvalue of 4.55, explaining 65.0% of the total variance. Model fit statistics were slightly better for males than for females. Measurement invariance examinations also yielded satisfactory Goodness-of-Fit statistics (CFI = 0.940, TFI = 0.910, RMSEA < 0.001) with minimal changes in item loadings and indicator threshold patterns across groups. The IRT results demonstrated high discrimination parameters, ranging from 2.17 to 3.67, and nearly evenly distributed difficulty parameters, ranging from -2.23 to 1.77. Graphical examinations indicated good performance of the scale across the latent trait continuum.ConclusionsThe results indicated that, as a single-factor scale, the instrument exhibits good quality at both the scale and item levels. It has high discriminative power and an adequate response set for assessing a full range of the latent trait, namely mental well-being.
| S-EPMC11897500 | biostudies-literature
Project description:BackgroundDespite the availability of a wide range of critical thinking instruments, there was no original design for nurses that has been translated into Chinese. However, only instruments designed specifically for the nursing discipline would be reliable. This study aimed to translate, culturally adapt, and validate the Yoon Critical Thinking Disposition Instrument in the Chinese context.MethodsA four-step translation process was implemented according to Word Health Organization guidelines, which included forward translation, expert panel review, backward translation, and pre-testing. Experts and nursing students participated in testing the validity and reliability of the Chinese version.ResultsThe translation of the instrument went smoothly. According to a confirmatory factor analysis, there was an acceptable fit for the seven-factor model. Content validity indices ranged from 0.6 to 1 at item level, and 0.94 at scale level. In addition, there was extremely high internal consistency and test-retest reliability in the translated instrument. There was a good fit for the items with both person and item reliabilities greater than 0.6 and a separation index of 2.19, respectively. The item location was identified from the wright map as not covering person ability, but the scale did not have a gender-related differential item functioning.ConclusionsIn this study, a critical thinking disposition instrument for nursing students was translated into Chinese for the first time. This translated instrument is a reliable tool with satisfactory validity and reliability. It could provide opportunities for building a cross-cultural understanding of critical thinking disposition.
| S-EPMC10559418 | biostudies-literature
Project description:BackgroundThe International Classification of Functioning, Disability and Health (ICF) proposes three main health outcomes, Impairment (I), Activity Limitation (A) and Participation Restriction (P), but good measures of these constructs are needed The aim of this study was to use both Classical Test Theory (CTT) and Item Response Theory (IRT) methods to carry out an item analysis to improve measurement of these three components in patients having joint replacement surgery mainly for osteoarthritis (OA).MethodsA geographical cohort of patients about to undergo lower limb joint replacement was invited to participate. Five hundred and twenty four patients completed ICF items that had been previously identified as measuring only a single ICF construct in patients with osteoarthritis. There were 13 I, 26 A and 20 P items. The SF-36 was used to explore the construct validity of the resultant I, A and P measures. The CTT and IRT analyses were run separately to identify items for inclusion or exclusion in the measurement of each construct. The results from both analyses were compared and contrasted.ResultsOverall, the item analysis resulted in the removal of 4 I items, 9 A items and 11 P items. CTT and IRT identified the same 14 items for removal, with CTT additionally excluding 3 items, and IRT a further 7 items. In a preliminary exploration of reliability and validity, the new measures appeared acceptable.ConclusionNew measures were developed that reflect the ICF components of Impairment, Activity Limitation and Participation Restriction for patients with advanced arthritis. The resulting Aberdeen IAP measures (Ab-IAP) comprising I (Ab-I, 9 items), A (Ab-A, 17 items), and P (Ab-P, 9 items) met the criteria of conventional psychometric (CTT) analyses and the additional criteria (information and discrimination) of IRT. The use of both methods was more informative than the use of only one of these methods. Thus combining CTT and IRT appears to be a valuable tool in the development of measures.
| S-EPMC2696439 | biostudies-literature