Dataset Information

Measuring a Broad Spectrum of eHealth Skills in the Web 3.0 Context Using an eHealth Literacy Scale: Development and Validation Study.

ABSTRACT:

Background

eHealth literacy (EHL) refers to a variety of capabilities that enable individuals to obtain health information from electronic resources and apply it to solve health problems. With the digitization of health care and the wide availability of health apps, a more diverse range of eHealth skills is required to properly use such health facilities. Existing EHL measurements focus mainly on the skill of obtaining health information (Web 1.0), whereas skills for web-based interactions (Web 2.0) and self-managing health data and applying information (Web 3.0) have not been well measured.

Objective

This study aims to develop an EHL scale (eHLS) termed eHLS-Web3.0 comprising a comprehensive spectrum of Web 1.0, 2.0, and 3.0 skills to measure EHL, and evaluate its validity and reliability along with the measurement invariance among college students.

Methods

In study 1, 421 Chinese college students (mean age 20.5, SD 1.4 years; 51.8% female) and 8 health experts (mean age 38.3, SD 5.9 years; 87.5% female) were involved to develop the eHLS-Web3.0. The scale development included three steps: item pool generation, content validation, and exploratory factor analysis. In study 2, 741 college students (mean age 21.3, SD 1.4 years; 52.2% female) were recruited from 4 Chinese cities to validate the newly developed eHLS-Web3.0. The construct validity, convergent validity, concurrent validity, internal consistency reliability, test-retest reliability, and measurement invariance across genders, majors, and regions were examined by a series of statistical analyses, including confirmatory factor analysis (CFA) and multigroup CFAs using SPSS and Mplus software packages.

Results

Based on the item pool of 374 statements collected during the conceptual development, 24 items (4-10 items per subscale) were generated and adjusted after cognitive testing and content validity examination. Through exploratory factor analysis, a 3-factor eHLS-Web3.0 was finally developed, and it included acquisition (8 items), verification (6 items), and application (10 items). In study 2, CFAs supported the construct validity of the 24-item 3D eHLS-Web3.0 (χ²₂₄₄=903.076, χ²₂₄₄=3.701, comparative fit index=0.924, Tucker-Lewis index=0.914, root mean square error of approximation [RMSEA]=0.06, and standardized root mean residual [SRMR]=0.051). The average variance extracted (AVE) value of 0.58 and high correlation between eHLS-Web3.0 subscales and the eHealth Literacy Scale (r=0.725-0.880, P<.001) indicated the convergent validity and concurrent validity of the eHLS-Web3.0. The results also indicated satisfactory internal consistency reliability (α=.976, ρ=0.934-0.956) and test-retest reliability (r=0.858, P<.001) of the scale. Multigroup CFA demonstrated the 24-item eHLS-Web3.0 to be invariant at all configural, metric, strength, and structural levels across genders (female and male), majors (sport-related, medical, and general), and regions (Yinchuan, Kunming, Xiamen, and Beijing).

Conclusions

The 24-item 3D eHLS-Web3.0 proved to be a reliable and valid measurement tool for EHL in the Web 3.0 context among Chinese college students.

SUBMITTER: Liu HX

PROVIDER: S-EPMC8498898 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundWith the digitization of health care and the wide availability of Web-based applications, a broad set of skills is essential to properly use such facilities; these skills are called digital health literacy or eHealth literacy. Current instruments to measure digital health literacy focus only on information gathering (Health 1.0 skills) and do not pay attention to interactivity on the Web (Health 2.0). To measure the complete spectrum of Health 1.0 and Health 2.0 skills, including actual competencies, we developed a new instrument. The Digital Health Literacy Instrument (DHLI) measures operational skills, navigation skills, information searching, evaluating reliability, determining relevance, adding self-generated content, and protecting privacy.ObjectiveOur objective was to study the distributional properties, reliability, content validity, and construct validity of the DHLI's self-report scale (21 items) and to explore the feasibility of an additional set of performance-based items (7 items).MethodsWe used a paper-and-pencil survey among a sample of the general Dutch population, stratified by age, sex, and educational level (T1; N=200). The survey consisted of the DHLI, sociodemographics, Internet use, health status, health literacy and the eHealth Literacy Scale (eHEALS). After 2 weeks, we asked participants to complete the DHLI again (T2; n=67). Cronbach alpha and intraclass correlation analysis between T1 and T2 were used to investigate reliability. Principal component analysis was performed to determine content validity. Correlation analyses were used to determine the construct validity.ResultsRespondents (107 female and 93 male) ranged in age from 18 to 84 years (mean 46.4, SD 19.0); 23.0% (46/200) had a lower educational level. Internal consistencies of the total scale (alpha=.87) and the subscales (alpha range .70-.89) were satisfactory, except for protecting privacy (alpha=.57). Distributional properties showed an approximately normal distribution. Test-retest analysis was satisfactory overall (total scale intraclass correlation coefficient=.77; subscale intraclass correlation coefficient range .49-.81). The performance-based items did not together form a single construct (alpha=.47) and should be interpreted individually. Results showed that more complex skills were reflected in a lower number of correct responses. Principal component analysis confirmed the theoretical structure of the self-report scale (76% explained variance). Correlations were as expected, showing significant relations with age (ρ=-.41, P<.001), education (ρ=.14, P=.047), Internet use (ρ=.39, P<.001), health-related Internet use (ρ=.27, P<.001), health status (ρ range .17-.27, P<.001), health literacy (ρ=.31, P<.001), and the eHEALS (ρ=.51, P<.001).ConclusionsThis instrument can be accepted as a new self-report measure to assess digital health literacy, using multiple subscales. Its performance-based items provide an indication of actual skills but should be studied and adapted further. Future research should examine the acceptability of this instrument in other languages and among different populations.

Project description:BackgroundThe eHealth Literacy Scale (eHEALS) is a tool for the self-assessment of perceived comfort and skills in using the internet as a source for health-related information. Although evidence exists of the reliability and construct and structural validity of the scale, there is a lack of evidence in relation to what is proposed by Norman and Skinner in their theoretical lily model of eHealth literacy; in particular it is not clear whether having a higher level of health literacy can positively influence electronic health (eHealth) literacy as measured by the eHEALS.ObjectiveOur study aim was to assess whether real-life experiences from studying or working in the health field, as a proxy of higher functional health literacy, correlate with self-referred eHealth literacy as measured by the eHEALS.MethodsA Web-based survey was conducted among adults living in Northeast Italy using an Italian version of the eHEALS (IT-eHEALS). In order to be able to measure the effect of higher functional health literacy on eHealth literacy, we divided our sample into two groups, respectively characterized by studying or working experience in the health sector and by lack thereof. Mean differences between eHEALS were calculated using t test and effect size evaluated using Cohen d. To ensure the validity of the IT-eHEALS, we evaluated its psychometric properties (internal consistency and dimensionality) and construct validity (by evaluating its correlation with respondents age, gender, educational attainment, self-rated health, use of internet for health-related purposes, and working status).ResultsA total of 868 respondents that completed the IT-eHEALS were included for analysis, of which 259 had working or studying experience in the health field. Mean (SD) eHEALS total score was 28.2 (6.2) for the whole sample, with statistically significant differences (P<.001) between the two groups, with the higher health literate group scoring significantly better (31.9 (5.9) vs 26.7 (5.6), respectively), with a standardized mean difference (Cohen d) of 0.9. Interestingly, we found a weak, yet significant, correlation between eHealth literacy and respondent characteristics for the higher health literate group only, as measured by positive Spearman correlation coefficients for age (0.11, P=.001), educational attainment (0.19, P=.002) and self-rated health (0.14, P=.024). Also, in line with current literature, correlation of eHEALS score with frequency of internet use for health-related purposes was significant for both groups (0.32, P<.001 and 0.15, P<.001 for higher and lower health literacy group, respectively). In our study we could not find any difference related to gender, while a significant difference for working status was only present when considering the sample as a whole (P=.03).ConclusionsOur study demonstrates a sizeable effect of higher levels of functional health literacy on the eHEALS score, corroborating what was initially proposed by Norman and Skinner in the lily model of eHealth literacy.

Project description:BackgroundThe World Wide Web has become an essential source of health information. Nevertheless, the amount and quality of information provided may lead to information overload. Therefore, people need certain skills to search for, identify, and evaluate information from the internet. In the context of health information, these competencies are summarized as the construct of eHealth literacy. Previous research has highlighted the relevance of eHealth literacy in terms of health-related outcomes. However, the existing instrument assessing eHealth literacy in the German language reveals methodological limitations regarding test development and validation. The development and validation of a revised scale for this important construct is highly relevant.ObjectiveThe objective of this study was the development and validation of a revised German eHealth literacy scale. In particular, this study aimed to focus on high methodological and psychometric standards to provide a valid and reliable instrument for measuring eHealth literacy in the German language.MethodsTwo internationally validated instruments were merged to cover a wide scope of the construct of eHealth literacy and create a revised eHealth literacy scale. Translation into the German language followed scientific guidelines and recommendations to ensure content validity. Data from German-speaking people (n=470) were collected in a convenience sample from October to November 2020. Validation was performed by factor analyses. Further, correlations were performed to examine convergent, discriminant, and criterion validity. Additionally, analyses of measurement invariance of gender, age, and educational level were conducted.ResultsAnalyses revealed a 2-factorial model of eHealth literacy. By item-reduction, the 2 factors information seeking and information appraisal were measured with 8 items reaching acceptable-to-good model fits (comparative fit index [CFI]: 0.942, Tucker Lewis index [TLI]: 0.915, root mean square error of approximation [RMSEA]: 0.127, and standardized root mean square residual [SRMR]: 0.055). Convergent validity was comprehensively confirmed by significant correlations of information seeking and information appraisal with health literacy, internet confidence, and internet anxiety. Discriminant and criterion validity were examined by correlation analyses with various scales and could partly be confirmed. Scalar level of measurement invariance for gender (CFI: 0.932, TLI: 0.923, RMSEA: 0.122, and SRMR: 0.068) and educational level (CFI: 0.937, TLI: 0.934, RMSEA: 0.112, and SRMR: 0.063) were confirmed. Measurement invariance of age was rejected.ConclusionsFollowing scientific guidelines for translation and test validation, we developed a revised German eHealth Literacy Scale (GR-eHEALS). Our factor analyses confirmed an acceptable-to-good model fit. Construct validation in terms of convergent, discriminant, and criterion validity could mainly be confirmed. Our findings provide evidence for measurement invariance of the instrument regarding gender and educational level. The newly revised GR-eHEALS questionnaire represents a valid instrument to measure the important health-related construct eHealth literacy.

Project description:BackgroundeHealth literacy is emerging as a crucial concept for promoting patient self-management in an overloaded hospital system. However, to the best of our knowledge, no tool currently exists to measure the level of eHealth literacy among French-speaking people. The eHealth Literacy Scale (eHEALS) is an easy-to-administer 8-item questionnaire (5-point Likert scale, ranging from strongly disagree to strongly agree) that has already been translated into many languages. Currently, it is the most cited questionnaire in the literature.ObjectiveThe aim of this study was to translate eHEALS to French and validate the French version of eHEALS (F-eHEALS).MethodsThe validation of the F-eHEALS scale followed the 5 steps of the transcultural validation method: double reverse translation, validation by a committee of experts (n=4), pretest measurement to check the clarity of the items (n=22), administration of the scale in French via a web-based quantitative study combined with two other questionnaires (Health Literacy Survey-Europe-16 and Patient Activation Measure-13; N=328 students), and finally test-retest (n=78) to check the temporal stability of the measurements obtained from the scale.ResultsThe results obtained for the measurement of factor structure, internal consistency, and temporal stability (intraclass correlation coefficient=0.84; 95% CI 0.76-0.9; F77,77=6.416; P<.001) prove the validity and fidelity of the proposed scale. The internal consistency of F-eHEALS was estimated by Cronbach α of .89. The factor analysis with varimax rotation used to validate the construct showed a 2-factor scale. The effect of the construct was analyzed using 3 hypotheses related to the theory. The F-eHEALS score was correlated with the Health Literacy Survey-Europe-16 score (r=0.34; P<.001) and the Patient Activation Measure-13 score (r=0.31; P<.001).ConclusionsF-eHEALS is consistent with the original version. It presents adequate levels of validity and fidelity. This 2D scale will need to be generalized to other populations in a French-speaking context. Finally, a version taking into account collaborative applications (ie, Health 2.0; eg, Digital Health Literacy Instrument scale) should be considered on the basis of this study.

Project description:BACKGROUND:Parents often use digital media to search for information related to their children's health. As the quantity and quality of digital sources meant specifically for parents expand, parents' digital health literacy is increasingly important to process the information they retrieve. One of the earliest developed and widely used instruments to assess digital health literacy is the self-reported eHealth Literacy Scale (eHEALS). However, the eHEALS has not been psychometrically validated in a sample of parents. Given the inconsistency of the eHEALS underlying factor structure across previous reports, it is particularly important for validation to occur. OBJECTIVE:This study aimed to determine the factor structure of the German eHEALS measure in a sample of parents by adopting classic and modern psychometric approaches. In particular, this study sought to identify the eHEALS validity as a unidimensional index as well as the viability for potential subscales. METHODS:A cross-sectional design was used across two purposive sampling frames: online and paper administrations. Responses were collected between January 2018 and May 2018 from 703 Swiss-German parents. In addition to determining the sampling characteristics, we conducted exploratory factor analysis of the eHEALS by considering its ordinal structure using polychoric correlations. This analysis was performed separately for online-based and paper-based responses to examine the general factor strength of the eHEALS as a unidimensional index. Furthermore, item response theory (IRT) analyses were conducted by fitting eHEALS to a bifactor model to further inspect its unidimensionality and subscale viability. RESULTS:Parents in both samples were predominantly mothers (622/703, 88.5%), highly educated (538/703, 76.9%), of Swiss nationality (489/703, 71.8%), and living with a partner (692/703, 98.4%). Factor analyses of the eHEALS indicated the presence of a strong general factor across both paper and online samples, and the Wilcoxon rank-sum test indicated that the eHEALS total sum score was not significantly different between the paper and online samples (P=.12). Finally, the IRT analyses indicated negligible multidimensionality, insufficient subscale reliability after accounting for the eHEALS general factor, and a reduced subset of items that could serve as a unidimensional index of the eHEALS across the paper and online samples. CONCLUSIONS:The German eHEALS evidenced good psychometric properties in a parent-specific study sample. Factor analyses indicated a strong general factor across purposively distinct sample frames (online and paper). IRT analyses validated the eHEALS as a unidimensional index while failing to find support for subscale usage.

Project description:IntroductionElectronic health (eHealth) strategies are evolving making it important to have valid scales to assess eHealth and health literacy. Item response theory methods, such as the Rasch measurement model, are increasingly used for the psychometric evaluation of scales. This paper aims to examine the internal construct validity of an eHealth and health literacy scale using Rasch analysis in a population with moderate to high cardiovascular disease risk.MethodsThe first 397 participants of the CONNECT study completed the electronic health Literacy Scale (eHEALS) and the Health Literacy Questionnaire (HLQ). Overall Rasch model fit as well as five key psychometric properties were analysed: unidimensionality, response thresholds, targeting, differential item functioning and internal consistency.ResultsThe eHEALS had good overall model fit (χ2 = 54.8, p = 0.06), ordered response thresholds, reasonable targeting and good internal consistency (person separation index (PSI) 0.90). It did, however, appear to measure two constructs of eHealth literacy. The HLQ subscales (except subscale 5) did not fit the Rasch model (χ2: 18.18-60.60, p: 0.00-0.58) and had suboptimal targeting for most subscales. Subscales 6 to 9 displayed disordered thresholds indicating participants had difficulty distinguishing between response options. All subscales did, nonetheless, demonstrate moderate to good internal consistency (PSI: 0.62-0.82).ConclusionRasch analyses demonstrated that the eHEALS has good measures of internal construct validity although it appears to capture different aspects of eHealth literacy (e.g. using eHealth and understanding eHealth). Whilst further studies are required to confirm this finding, it may be necessary for these constructs of the eHEALS to be scored separately. The nine HLQ subscales were shown to measure a single construct of health literacy. However, participants' scores may not represent their actual level of ability, as distinction between response categories was unclear for the last four subscales. Reducing the response categories of these subscales may improve the ability of the HLQ to distinguish between different levels of health literacy.