Dataset Information

Initial Validation of the MAKE Framework: A Comprehensive Instrument for Evaluating the Efficacy of Game-Based Learning and Gamification in Adolescent Sexual Health Literacy.

ABSTRACT:

Objectives

When evaluating the effectiveness of a method for instructing adolescents in sexual health literacy, it is essential to consider how the method motivates learning, promotes a change of attitude, increases knowledge gain, and engages students (MAKE). This article reports on the development and validation of a unified, comprehensive framework for evaluating the efficacy of games in teaching sexual health behaviors for curbing unhealthy sexual outcomes to secondary school adolescents in low resource settings.

Methods

The initial validation of the MAKE framework was administered to 120 students using quantitative data collection and analysis. It was then subjected to factor analysis tests to investigate the items' structure, and Cronbach's alpha was applied to measure the scale reliability using SPSS Version 24.

Results

Data analyses demonstrate that the MAKE framework is a comprehensive instrument to evaluate teaching methods with four powerful constructs, each of which has two to four components. For each construct, the following data were obtained: for motivation, standardized alpha = 0.92, Kaiser-Meyer-Olkin (KMO) = 0.88, and p = 0.001; for attitude, standardized Cronbach's alpha = 0.90, KMO = 0.88, and p = 0.001; for knowledge, standardized alpha = 0.92, KMO = 0.86, and p = 0.001; and finally, for engagement, standardized alpha = 0.90, KMO = 0.87, and p = 0.001. Cronbach's alpha for each component was above the cut-off point (0.65).

Conclusions

This study shows that the MAKE framework is a satisfactory instrument for assessing the efficacy of teaching methods for sexual health literacy in a variety of teaching environments. The method may also have value for assessing the effectiveness of other methods in adolescent sexual health education.

SUBMITTER: Haruna H

PROVIDER: S-EPMC7052344 | biostudies-literature | 2019 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Initial Validation of the MAKE Framework: A Comprehensive Instrument for Evaluating the Efficacy of Game-Based Learning and Gamification in Adolescent Sexual Health Literacy.

Haruna Hussein H Hu Xiao X Chu Samuel Kai Wah SKW Mellecker Robin R RR

Annals of global health 20190228 1

<h4>Objectives</h4>When evaluating the effectiveness of a method for instructing adolescents in sexual health literacy, it is essential to consider how the method motivates learning, promotes a change of attitude, increases knowledge gain, and engages students (MAKE). This article reports on the development and validation of a unified, comprehensive framework for evaluating the efficacy of games in teaching sexual health behaviors for curbing unhealthy sexual outcomes to secondary school adolesc ...[more]

PMID: 30873788

Similar Datasets

Project description:BackgroundGames, when used as interventional tools, can influence behavior change by incentivizing, reinforcing, educating, providing feedback loops, prompting, persuading, or providing meaning, fun, and community. However, not all game elements will appeal to all consumers equally, and different elements might work for different people and in different contexts.ObjectiveThe aim of this study was to conduct a realist review of tabletop games targeting behavior change and to propose a framework for designing effective behavior change games.MethodsA realist review was conducted to inform program theory in the development of tabletop games for health behavior change. The context, mechanisms used to change behavior, and outcomes of included studies were reviewed through a realist lens.ResultsThirty-one papers met the eligibility criteria and were included in the review. Several design methods were identified that enhanced the efficacy of the games to change behavior. These included design by local teams, pilot testing, clearly defined targets of behavior change, conscious attention to all aspects of game design, including game mechanics, dynamics, aesthetics, and the elicitation of emotions. Delivery with other mediums, leveraging behavioral insights, prior training for delivery, and repeated play were also important. Some design elements that were found to reduce efficacy included limited replayability or lack of fun for immersive engagement.ConclusionsGame designers need to consider all aspects of the context and the mechanisms to achieve the desired behavior change outcomes. Careful design thinking should include consideration of the game mechanics, dynamics, aesthetics, emotions, and contexts of the game and the players. People who know the players and the contexts well should design the games or have significant input. Testing in real-world settings is likely to lead to better outcomes. Careful selection and purposeful design of the behavior change mechanisms at play is essential. Fun and enjoyment of the player should be considered, as without engagement, there will be no desired intervention effect.

Project description:BACKGROUND:For people to be able to access, understand, and benefit from the increasing digitalization of health services, it is critical that services are provided in a way that meets the user's needs, resources, and competence. OBJECTIVE:The objective of the study was to develop a questionnaire that captures the 7-dimensional eHealth Literacy Framework (eHLF). METHODS:Draft items were created in parallel in English and Danish. The items were generated from 450 statements collected during the conceptual development of eHLF. In all, 57 items (7 to 9 items per scale) were generated and adjusted after cognitive testing. Items were tested in 475 people recruited from settings in which the scale was intended to be used (community and health care settings) and including people with a range of chronic conditions. Measurement properties were assessed using approaches from item response theory (IRT) and classical test theory (CTT) such as confirmatory factor analysis (CFA) and reliability using composite scale reliability (CSR); potential bias due to age and sex was evaluated using differential item functioning (DIF). RESULTS:CFA confirmed the presence of the 7 a priori dimensions of eHLF. Following item analysis, a 35-item 7-scale questionnaire was constructed, covering (1) using technology to process health information (5 items, CSR=.84), (2) understanding of health concepts and language (5 items, CSR=.75), (3) ability to actively engage with digital services (5 items, CSR=.86), (4) feel safe and in control (5 items, CSR=.87), (5) motivated to engage with digital services (5 items, CSR=.84), (6) access to digital services that work (6 items, CSR=.77), and (7) digital services that suit individual needs (4 items, CSR=.85). A 7-factor CFA model, using small-variance priors for cross-loadings and residual correlations, had a satisfactory fit (posterior productive P value: .27, 95% CI for the difference between the observed and replicated chi-square values: -63.7 to 133.8). The CFA showed that all items loaded strongly on their respective factors. The IRT analysis showed that no items were found to have disordered thresholds. For most scales, discriminant validity was acceptable; however, 2 pairs of dimensions were highly correlated; dimensions 1 and 5 (r=.95), and dimensions 6 and 7 (r=.96). All dimensions were retained because of strong content differentiation and potential causal relationships between these dimensions. There is no evidence of DIF. CONCLUSIONS:The eHealth Literacy Questionnaire (eHLQ) is a multidimensional tool based on a well-defined a priori eHLF framework with robust properties. It has satisfactory evidence of construct validity and reliable measurement across a broad range of concepts (using both CTT and IRT traditions) in various groups. It is designed to be used to understand and evaluate people's interaction with digital health services.

Project description:BACKGROUND:Health literacy is the ability to access to, understand, evaluate and use of essential health information to make basic health decisions. This study aimed to develop and psychometrically evaluate an instrument for measuring health literacy among adults (the Health Literacy Instrument for Adults - HELIA). METHODS:In addition to a literature review, a panel of specialists from different disciplines was formed to generate an item pool. Then, a framework was defined to develop the initial questionnaire based on a definition of health literacy and the most important global public health issues. The initial questionnaire contained 66 items. Next, 15 experts in public health were approached to assess content validity. Consequently, 19 items were removed and a provisional version of the questionnaire with 47 items was provided. Finally, a random sample of adults completed the questionnaire and psychometric properties of the instrument were assessed. RESULTS:Overall, 323 adults aged 18 to 65?years old completed the questionnaire. When the exploratory factor analysis was performed, 33 items were loaded, which indicated a 5-factor solution for the questionnaire that jointly explained 52.9% of the variance observed. The factors were as follows: access to information (6 items), reading (4 items), understanding (7 items), appraisal (4 items), and decision making/behavioral intention (12 items). Confirmatory factory analysis also indicated a good fit to the data for the five-latent structure (?2/df?=?1.60, SRMR?=?0.049; RMSEA?=?0.043; CFI?=?0.98; NFI?=?0.95; NNFI?=?0.98 and GFI?=?0.87). Additional analysis for internal consistency showed satisfactory results with Cronbach's alpha coefficients ranging from 0.72 to 0.89. Intraclass correlation coefficient (test-retest analysis) also showed acceptable stability for the questionnaire (ICC?=?0.84). The mean score for health literacy as measured by the HELIA was 76.3 (SD?=?15.1) out of 100 for the study sample. CONCLUSION:The findings suggest that the Health Literacy Instrument for Adults (HELIA) is a valid and reliable instrument for measuring health literacy. It is a short and easy-to-use instrument that could be applied in different settings.

Project description:BackgroundCognitive tasks designed to measure or train cognition are often repetitive and presented in a monotonous manner, features that lead to participant boredom and disengagement. In this situation, participants do not put forth their best effort to do these tasks well. As a result, neuropsychologists cannot draw accurate conclusions about the data collected, and intervention effects are reduced. It is assumed that greater engagement and motivation will manifest as improved data quality. Gamification, the use of game elements in nongame settings, has been heralded as a potential mechanism for increasing participant engagement in cognitive tasks. Some studies have reported a positive effect of gamification on participant performance, although most studies have shown mixed results. One reason for these contrasting findings is that most studies have applied poor and heterogeneous design techniques to gamify cognitive tasks. Therefore, an appropriate gamification design framework is needed in these tasks.ObjectiveThis study aimed to propose a framework to guide the design of gamification in cognitive tasks.MethodsWe employed a design science research (DSR) approach to provide a framework for gamifying cognitive assessments and training by synthesizing current gamification design frameworks and gamification works in cognitive assessment and training, as well as incorporating field experiences. The prototypes of the framework were iteratively evaluated with 17 relevant experts.ResultsWe proposed a framework consisting of 7 phases: (1) preparation; (2) knowing users; (3) exploring existing tools for assessing or training a targeted cognitive context and determining the suitability of game-up and mapping techniques; (4) ideation; (5) prototyping using the Objects, Mechanics, Dynamics, Emotions (OMDE) design guideline; (6) development; and (7) disseminating and monitoring.ConclusionsWe found that (1) an intermediate design framework is needed to gamify cognitive tasks, which means that game elements should be selected by considering current cognitive assessment or training context characteristics since game elements may impose an irrelevant cognitive load that, in turn, can jeopardize data quality; (2) in addition to developing a new gamified cognitive task from scratch, 2 gamification techniques are widely used (first, adding game elements to an existing cognitive task and second, mapping an existing game to a cognitive function or impairment to assess or train it); and (3) further research is required to investigate the interplay of cognitive processes and game mechanics.

Project description:BACKGROUND:Oral health literacy is an important construct for both clinical and public health outcomes research. The need to quantify and test OHL has led to the development of measurement instruments and has generated a substantial body of recent literature. A commonly used OHL instrument is REALD-30, a word recognition scale that has been adapted for use in several languages. The objective of this study was the development and testing of the Greek language oral health literacy measurement instrument (GROHL). METHODS:Data from 282 adult patients of two private dental clinics in Athens, Greece were collected via in-person interviews. Forty-four words were initially considered and tested for inclusion. Item response theory analysis (IRT) and 2-parameter logistic models assessing difficulty and discriminatory ability were used to identify an optimal scale composition. Internal consistency was examined using Cronbach's alpha and test-retest reliability was measured using intraclass correlation coefficient (ICC) in a subset of 20 participants over a two-week period. Convergent validity was tested against functional health literacy screening (HLS) items, dental knowledge (DK), oral health behaviors (OHBs), oral health-related quality of life (OHRQoL; OHIP-14 index), as well as self-reported oral and general health status. RESULTS:From an initial item pool of 44 items that were carried forward to IRT, 12 were excluded due to no or little variance, 10 were excluded due to low item-test correlation, and 2 due to insignificant contribution to the scale, i.e., difficulty parameter estimate with p?>?0.05. The twenty remaining items composed the final index which showed favorable internal consistency (alpha?=?0.80) and test-retest reliability (ICC?=?0.95). The summary score distribution did not depart from normality (p?=?0.32; mean?=?11.5; median?=?12; range?=?1-20). GROHL scores were positively correlated with favorable oral hygiene behaviors and dental attendance, as well as HLS, DK and education level. CONCLUSION:The GROHL demonstrated good psychometric properties and can be used for outcomes research in clinical and public health settings.

Dataset Information

Initial Validation of the MAKE Framework: A Comprehensive Instrument for Evaluating the Efficacy of Game-Based Learning and Gamification in Adolescent Sexual Health Literacy.

Objectives

Methods

Results

Conclusions

Publications

Initial Validation of the MAKE Framework: A Comprehensive Instrument for Evaluating the Efficacy of Game-Based Learning and Gamification in Adolescent Sexual Health Literacy.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure