Dataset Information

Necessary but Insufficient: Why Measurement Invariance Tests Need Online Probing as a Complementary Tool.

ABSTRACT: Cross-national data production in social science research has increased dramatically in recent decades. Assessing the comparability of data is necessary before drawing substantive conclusions that are based on cross-national data. Researchers assessing data comparability typically use either quantitative methods such as multigroup confirmatory factor analysis or qualitative methods such as online probing. Because both methods have complementary strengths and weaknesses, this study applies both multigroup confirmatory factor analysis and online probing in a mixed-methods approach to assess the comparability of constructive patriotism and nationalism, two important concepts in the study of national identity. Previous measurement invariance tests failed to achieve scalar measurement invariance, which prohibits a cross-national comparison of latent means (Davidov 2009). The arrival of the 2013 ISSP Module on National Identity has encouraged a reassessment of both constructs and a push to understand why scalar invariance cannot be achieved. Using the example of constructive patriotism and nationalism, this study demonstrates how the combination of multigroup confirmatory factor analysis and online probing can uncover and explain issues related to cross-national comparability.

SUBMITTER: Meitinger K

PROVIDER: S-EPMC5452432 | biostudies-literature | 2017 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Necessary but Insufficient: Why Measurement Invariance Tests Need Online Probing as a Complementary Tool.

Meitinger Katharina K

Public opinion quarterly 20170519 2

Cross-national data production in social science research has increased dramatically in recent decades. Assessing the comparability of data is necessary before drawing substantive conclusions that are based on cross-national data. Researchers assessing data comparability typically use either quantitative methods such as multigroup confirmatory factor analysis or qualitative methods such as online probing. Because both methods have complementary strengths and weaknesses, this study applies both m ...[more]

PMID: 28579643

Similar Datasets

Project description:BackgroundBased on the self-determination theory, the psychological requirements for competence, autonomy, and relatedness boost beneficial exercise behaviour for healthy living. However, there is no valid, reliable Malay version scale to investigate the extent to which these psychological needs are met. The main purpose of this study was to examine the psychometric properties of a Malay version of the Psychological Need Satisfaction in Exercise (PNSE-M) scale. In addition, the purpose of this study was to confirm the measurement and structural invariance of the PNSE-M across gender.MethodsThe study participants included 919 students (male: 49.6%, female: 50.4%), with a mean age of 20.4 years (standard deviation = 1.5). The participants were selected through convenience sampling. The 18-item PNSE-M was used to measure psychological need satisfaction in exercise. The English version of the PNSE was translated into Malay using standard forward-backward translation. Confirmatory factor analysis (CFA) and invariance tests were performed on the three domains of the PNSE-M model. Composite reliability (CR), average variance extracted (AVE), internal consistency based on Cronbach's alpha, and test-retest reliabilities using intraclass correlation coefficient (ICC) were also computed.ResultsAfter some model re-specification, the CFA findings based on the hypothesised measurement model of three factors and 18 items indicated acceptable factor structure (CFI = .936, TLI = .923, SRMR = .054, RMSEA = .059). The CR and AVE values were .864-.902 and .573-.617, respectively. Cronbach's alpha was .891-.908, and the ICC was .980-.985. The findings supported the full measurement and structural invariance of the PNSE-M for both male and female participants. The CFA model matched the data well for both male (CFI = .926, SRMR = .057, RMSEA = .066) and female (CFI = .926, SRMR = .060, RMSEA = .065) participants.ConclusionThe PNSE-M with three factors and 18 items is considered to be a valid, reliable instrument for university students in Malaysia. It is valid for use to make meaningful comparisons across gender.

Dataset Information

Necessary but Insufficient: Why Measurement Invariance Tests Need Online Probing as a Complementary Tool.

Publications

Necessary but Insufficient: Why Measurement Invariance Tests Need Online Probing as a Complementary Tool.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets