Dataset Information

Testing the Digital Health Literacy Instrument for Adolescents: Cognitive Interviews.

ABSTRACT:

Background

Despite the increasing number of youth seeking health information on the internet, few studies have been conducted to measure digital health literacy in this population. The digital health literacy instrument (DHLI) is defined as a scale that measures the ability to operate digital devices and read and write in web-based modes, and it assesses seven subconstructs: operational skills, navigation skills, information searching, evaluating reliability, determining relevance, adding self-generated content to a web-based app, and protecting privacy. Currently, there is no validation process of this instrument among adolescents.

Objective

This study aims to explore the usability and content validity of DHLI.

Methods

Upon the approval of institutional review board protocol, cognitive interviews were conducted. A total of 34 adolescents aged 10-18 years (n=17, 50% female) participated in individual cognitive interviews. Two rounds of concurrent cognitive interviews were conducted to assess the content validity of DHLI using the thinking aloud method and probing questions.

Results

Clarity related to unclear wording, undefined technical terms, vague terms, and difficult vocabularies was a major issue identified. Problems related to potentially inappropriate assumptions were also identified. In addition, concerns related to recall bias and socially sensitive phenomena were raised. No issues regarding response options or instrument instructions were noted.

Conclusions

The initial round of interviews provided a potential resolution to the problems identified with comprehension and communication, whereas the second round prompted improvement in content validity. Dual rounds of cognitive interviews provided substantial insights into survey interpretation when introduced to US adolescents. This study examined the validity of the DHLI and suggests revision points for assessing adolescent digital health literacy.

SUBMITTER: Park E

PROVIDER: S-EPMC8074835 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundIn Germany, there are no measurement tools to assess the general health literacy of adolescents. The aim of the study "Measurement of Health Literacy Among Adolescents" (MOHLAA) is to develop such a tool for use among adolescents aged 14-17. The German version of the European Health Literacy Survey Questionnaire (HLS-EU-Q47-GER) served as a blueprint for the development of the tool. The present study examined the extent to which the HLS-EU-Q47-GER can be applied to the measurement of general health literacy in adolescents.MethodsThe applicability of the HLS-EU-Q47-GER for adolescents was tested qualitatively using cognitive interviewing (CI). Purposive sampling was used to achieve an equal distribution of participants regarding age groups, educational backgrounds and gender. CI was standardized on the basis of an interview guide. Verbal probing and the retrospective think-aloud technique were applied. The interviews were audio-recorded, transcribed and analyzed using the criteria of theory-based analysis, which were derived from the model of cognitive processes. The analysis focused on identifying terms and questions that were difficult to understand and on scrutinizing the extent to which the content of the items is appropriate for assessing adolescents' health literacy.ResultsAdolescent respondents were unfamiliar with some terms of the HLS-EU-Q47-GER or provided heterogeneous interpretations of the terms. They had limited or no experience regarding some health-related tasks in health care and disease prevention that are addressed by HLS-EU-Q-items. A few items seemed to be too "difficult" to answer due to a high abstraction level or because they lacked any reference to the everyday lives of youth. Despite comprehension problems with some of the HLS-EU items, the respondents assessed the covered health-related tasks as "very easy" or "fairly easy". CI stressed the importance of interpersonal agents, especially parents, in helping adolescents understand and judge the reliability of health information.ConclusionsThe results of CI indicated that the applicability of the HLS-EU-Q47-GER to the measurement of general health literacy among adolescents aged 14-17 is limited. In order to prevent biased data, some items of the questionnaire should be adjusted to adolescents' state of development and experiences with health care and disease prevention.

Project description:BackgroundWith the digitization of health care and the wide availability of Web-based applications, a broad set of skills is essential to properly use such facilities; these skills are called digital health literacy or eHealth literacy. Current instruments to measure digital health literacy focus only on information gathering (Health 1.0 skills) and do not pay attention to interactivity on the Web (Health 2.0). To measure the complete spectrum of Health 1.0 and Health 2.0 skills, including actual competencies, we developed a new instrument. The Digital Health Literacy Instrument (DHLI) measures operational skills, navigation skills, information searching, evaluating reliability, determining relevance, adding self-generated content, and protecting privacy.ObjectiveOur objective was to study the distributional properties, reliability, content validity, and construct validity of the DHLI's self-report scale (21 items) and to explore the feasibility of an additional set of performance-based items (7 items).MethodsWe used a paper-and-pencil survey among a sample of the general Dutch population, stratified by age, sex, and educational level (T1; N=200). The survey consisted of the DHLI, sociodemographics, Internet use, health status, health literacy and the eHealth Literacy Scale (eHEALS). After 2 weeks, we asked participants to complete the DHLI again (T2; n=67). Cronbach alpha and intraclass correlation analysis between T1 and T2 were used to investigate reliability. Principal component analysis was performed to determine content validity. Correlation analyses were used to determine the construct validity.ResultsRespondents (107 female and 93 male) ranged in age from 18 to 84 years (mean 46.4, SD 19.0); 23.0% (46/200) had a lower educational level. Internal consistencies of the total scale (alpha=.87) and the subscales (alpha range .70-.89) were satisfactory, except for protecting privacy (alpha=.57). Distributional properties showed an approximately normal distribution. Test-retest analysis was satisfactory overall (total scale intraclass correlation coefficient=.77; subscale intraclass correlation coefficient range .49-.81). The performance-based items did not together form a single construct (alpha=.47) and should be interpreted individually. Results showed that more complex skills were reflected in a lower number of correct responses. Principal component analysis confirmed the theoretical structure of the self-report scale (76% explained variance). Correlations were as expected, showing significant relations with age (ρ=-.41, P<.001), education (ρ=.14, P=.047), Internet use (ρ=.39, P<.001), health-related Internet use (ρ=.27, P<.001), health status (ρ range .17-.27, P<.001), health literacy (ρ=.31, P<.001), and the eHEALS (ρ=.51, P<.001).ConclusionsThis instrument can be accepted as a new self-report measure to assess digital health literacy, using multiple subscales. Its performance-based items provide an indication of actual skills but should be studied and adapted further. Future research should examine the acceptability of this instrument in other languages and among different populations.

Project description:BackgroundThe need for digital literacy in aging populations is increasing in the digitalizing society. Digital literacy involves the identification, evaluation, and communication of information through various digital devices or relevant programs.ObjectiveThe aims of this study were to develop an Everyday Digital Literacy Questionnaire (EDLQ), a digital literacy assessment scale, and subsequently evaluate its psychometric properties using a population of community-dwelling older adults in South Korea.MethodsThe EDLQ was developed using an instrument development design. A nationwide survey was conducted, and the study included 1016 community-dwelling older adults (age ≥60 years). To evaluate the psychometric properties, the participants were randomly divided into 2 groups (n=508 each), and the internal consistency (Cronbach α and McDonald ω), structural validity (exploratory factor analysis and confirmatory factor analysis), hypothesis-testing construct validity using the eHealth Literacy Scale (eHEALS), and measurement invariance were analyzed.ResultsAmong the initial 30 items of the EDLQ, 22 items with a 3-factor solution had a total explained variance of 77%. The domains included "information and communication" (9 items), "content creation and management" (4 items), and "safety and security" (9 items). Confirmatory factor analysis was conducted with this 3-factor solution (χ2206=345.1; normed χ2206=1.7; comparative fit index=0.997; Tucker-Lewis index=0.997; root-mean-square error of approximation=0.036; standardized root-mean-square residual=0.050; composite reliability=0.903-0.959; average variance extracted=0.699-0.724; R2=0.616-0.773). Hypothesis-testing construct validity with the eHEALS revealed a strong correlation (r=0.75). Cronbach α and McDonald ω coefficients were .98 and 0.98, respectively. The fit indices for measurement invariance, including the configural, metric, and scalar invariance models, demonstrated a satisfactory fit to the data. Our findings suggest that the psychometric properties of the 22-item EDLQ are valid and reliable for assessing digital literacy among older Korean adults.ConclusionsIn this study, we developed a digital literacy measure with strong psychometric properties that made it suitable for assessing the digital literacy of community-dwelling older adults in Korea. To broaden its applicability, however, further assessment of its feasibility for use with different languages and cultures is necessary. Moreover, more empirical research on digital literacy and related factors in older adults can facilitate the development of personalized digital health care services and educational interventions in the digital society.

Project description:IntroductionDigital health intervention offers the potential to enhance health literacy, which is crucial for effective diabetes management, especially among adolescents. Diabetes is a major global public health issue, leading to devastating complications and increasing mortality rates. The incidence of type 1 diabetes mellitus (T1DM) is also on the rise, particularly among adolescents, necessitating multisectoral strategies to combat this disease. This study explores the perceptions of adolescents with T1DM in Germany regarding digital health interventions, with the aim of improving healthcare by addressing specific needs and guiding future research.MethodologyThis study employed a qualitative approach using semi-structured individual interviews with adolescents with T1DM (n = 20) aged 14 to 18 years old in Germany to explore their perspectives on digital interventions for health literacy promotion. The study adopted content analysis according to Kuckartz et al. and the research followed the Consolidated Criteria for Reporting Qualitative Research (COREQ) checklist. Ethical considerations were paramount and data were rigorously analyzed using coding and iterative processes to ensure data quality and reliability.ResultsThe findings indicate that within three prominent domains, namely the utilization of digital health intervention for accessing and comprehending information, facilitating peer-to-peer interactions, and enhancing physician-patient communication and interaction, digital health interventions are either underutilized or insufficiently deployed. In addition, a notable observation is the apparent lack of patient-centered approaches for adolescents with T1DM in relation to digital health interventions and health literacy.ConclusionIn order to enhance the utilization of digital health interventions and enhance health literacy it is essential to focus on capacity building through a patient-centered approach, to promote digital health literacy, and foster the cultivation of a participatory culture. The outcomes of this study offer valuable insights that can inform practical applications, further research endeavors, and influence policymaking.

Project description:BACKGROUND:Health literacy is the ability to access to, understand, evaluate and use of essential health information to make basic health decisions. This study aimed to develop and psychometrically evaluate an instrument for measuring health literacy among adults (the Health Literacy Instrument for Adults - HELIA). METHODS:In addition to a literature review, a panel of specialists from different disciplines was formed to generate an item pool. Then, a framework was defined to develop the initial questionnaire based on a definition of health literacy and the most important global public health issues. The initial questionnaire contained 66 items. Next, 15 experts in public health were approached to assess content validity. Consequently, 19 items were removed and a provisional version of the questionnaire with 47 items was provided. Finally, a random sample of adults completed the questionnaire and psychometric properties of the instrument were assessed. RESULTS:Overall, 323 adults aged 18 to 65?years old completed the questionnaire. When the exploratory factor analysis was performed, 33 items were loaded, which indicated a 5-factor solution for the questionnaire that jointly explained 52.9% of the variance observed. The factors were as follows: access to information (6 items), reading (4 items), understanding (7 items), appraisal (4 items), and decision making/behavioral intention (12 items). Confirmatory factory analysis also indicated a good fit to the data for the five-latent structure (?2/df?=?1.60, SRMR?=?0.049; RMSEA?=?0.043; CFI?=?0.98; NFI?=?0.95; NNFI?=?0.98 and GFI?=?0.87). Additional analysis for internal consistency showed satisfactory results with Cronbach's alpha coefficients ranging from 0.72 to 0.89. Intraclass correlation coefficient (test-retest analysis) also showed acceptable stability for the questionnaire (ICC?=?0.84). The mean score for health literacy as measured by the HELIA was 76.3 (SD?=?15.1) out of 100 for the study sample. CONCLUSION:The findings suggest that the Health Literacy Instrument for Adults (HELIA) is a valid and reliable instrument for measuring health literacy. It is a short and easy-to-use instrument that could be applied in different settings.

Project description:ObjectiveWithin the digital society, the limited proficiency in digital health behaviors among rural residents has emerged as a significant factor intensifying health disparities between urban and rural areas. Addressing this issue, enhancing the digital literacy and health literacy of rural residents stands out as a crucial strategy. This study aims to investigate the relationship between digital literacy, health literacy, and the digital health behaviors of rural residents.MethodsInitially, we developed measurement instruments aimed at assessing the levels of digital literacy and health literacy among rural residents. Subsequently, leveraging micro survey data, we conducted assessments on the digital literacy and health literacy of 968 residents in five administrative villages in Zhejiang Province, China. Building upon this foundation, we employed Probit and Poisson models to empirically scrutinize the influence of digital literacy, health literacy, and their interaction on the manifestation of digital health behaviors within the rural population. This analysis was conducted from a dual perspective, evaluating the participation of digital health behaviors among rural residents and the diversity to which they participate in such behaviors.ResultsDigital literacy exhibited a notably positive influence on both the participation and diversity of digital health behaviors among rural residents. While health literacy did not emerge as a predictor for the occurrence of digital health behavior, it exerted a substantial positive impact on the diversity of digital health behaviors in the rural population. There were significant interaction effects between digital literacy and health literacy concerning the participation and diversity of digital health behaviors among rural residents. These findings remained robust even after implementing the instrumental variable method to address endogeneity issues. Furthermore, the outcomes of robust analysis and heterogeneity analysis further fortify the steadfastness of the aforementioned conclusions.ConclusionThe findings suggest that policymakers should implement targeted measures aimed at enhancing digital literacy and health literacy among rural residents. This approach is crucial for improving rural residents' access to digital health services, thereby mitigating urban-rural health inequality.