Evaluation Tool Development for Food Literacy Programs.
Ontology highlight
ABSTRACT:
SUBMITTER: Begley A
PROVIDER: S-EPMC6267114 | biostudies-literature | 2018 Nov
REPOSITORIES: biostudies-literature
Publications
Evaluation Tool Development for Food Literacy Programs.
Begley Andrea A Paynter Ellen E Dhaliwal Satvinder S SS
Nutrients 20181102 11
Food literacy is described as the behaviours involved in planning, purchasing, preparing, and eating food and is critical for achieving healthy dietary intakes. Food literacy programs require valid and reliable evaluation measures. The aim of this paper is to describe the development and validation of a self-administered questionnaire to measure food literacy behaviours targeted by the <i>Food Sensations<sup>®</sup> for Adults</i> program in Western Australia. Validity and reliability tests were ...[more]
Similar Datasets
Project description:The concept of food literacy is evolving and expanding, increasing the need for a comprehensive measurement tool for food literacy. This study aimed to develop a validated food literacy questionnaire based on an expanded conceptual framework for food literacy. A literature review of existing frameworks and questionnaires for food literacy and focus group interviews (n = 12) were conducted to develop a conceptual framework and candidate questions. A Delphi study (n = 15) and pilot survey (n = 10) to test the preliminary questionnaire's content and face validity were conducted, which were followed by the main survey (n = 200). Construct validity and reliability were assessed using exploratory factor analysis (EFA) and Cronbach's alpha, respectively. Criterion validity was assessed by comparing food literacy scores with food knowledge scores (FN-score) and nutrient quotient scores (NQ-score). By integrating and revising the six existing conceptual frameworks and focus group interview results, we proposed a two-dimensional conceptual framework comprising a literacy dimension and a food system dimension. After reviewing 560 items and categorizing them into 18 domains (3 in the literacy dimension × 6 in the food system dimension), 32 questions were selected. As a result of the Delphi study, two items were deleted, and content validity was confirmed for the remaining 30 items (content validity ratio (CVR) = 0.92). Ten items were revised during the face validation process, and five items were excluded as a result of the EFA. The final food literacy questionnaire comprised 25 questions related to five factors: production, selection, preparation and cooking, intake, and disposal. Food literacy scores were positively associated with FN- and NQ-scores, confirming the reliability and criterion validity of the final questionnaire. The two-dimensional food literacy conceptual framework developed in this study systematically encompasses complex food literacy concepts by adding a food systems dimension (production, selection, preparation and cooking, intake, and disposal domain) to the existing literacy dimension (functional, interactive, and critical literacy domain). Based on this integrated conceptual framework, a 25-item food literacy questionnaire was developed and validated for practical use.
| S-EPMC7692683 | biostudies-literature
Project description:BackgroundOne of the factors affecting self-care in diabetic patients is food literacy, which helps said patients in following a healthy diet. Thus, it is crucial to analyze food literacy in diabetic patients through suitable and reliable instruments. OBJECTIVE: The current study aimed to design a questionnaire for food literacy assessment in diabetic patients and analyze its psychometric features.MethodThe present study was a cross-sectional descriptive analysis carried out in 2021. Firstly, the concepts of food literacy in diabetic patients were identified and the questionnaire was deigned based on them. Secondly, its face and content validities and its reliability were analyzed. Finally, the construct validity was analyzed by exploratory factor analysis. The study was carried out on 300 diabetic participants chosen at random via stratified cluster sampling from Health service centers. The exploratory factor analysis was carried out by extracting the main factors and using varimax rotation with eigenvalue values more than 1.ResultsA five-pronged structure accounted for 52.745% of food literacy variance. This included the ability to read food facts, practical ability to group foods, the ability to identify the caloric content of different foods, the ability to understand the effect of food on health, and the ability to prepare a healthy meal. Items with an impact score below 1.5 were discarded. Additionally, items with CVR scores below 0.62 and CVI scores below 0.79 were deleted too. The Kaiser-Meyer-Okin measurement was 0.836 (p < 0.001). Alpha Cronbach Scale dimension was 0.610-0.951.ConclusionThe results of this study showed that the exploratory dimensions of the current study were consistent with health literacy measurements, such as functional, interactive, and critical food literacy. This scale has acceptable reliability and validity. Health professionals can use this scale to analyze and improve food literacy in diabetic patients. This is a new instrument and thus far no questionnaire has been made to evaluate food literacy in diabetic patients.
| S-EPMC9666971 | biostudies-literature
Project description:Background: The term "food literacy" is increasingly used to describe the knowledge, skills and behaviours needed to meet food needs. The aim of this research was to determine content validity for an International Food Literacy Survey. Methods: The literature was searched for existing items to form an item pool to measure the eleven components of food literacy. Expert consensus was investigated through two related online surveys. Round 1 participants were researchers who had been involved in the development of a food literacy measure (n = 18). Round 2 participants were authors of papers who had used the term (n = 85). Level of agreement was determined quantitatively using the Content Validity Index and compared to open ended qualitative comments. Results: Consensus was achieved on 119 items. Components varied in the ease with which existing validated items could be found and the number of items achieving consensus. Items related to food prepared within the home were more likely to achieve consensus. Additional issues included limited shared understanding of the scope of the term, the validity of items varying according to context and a limited health focus. Conclusions: This study provides a valuable basis upon which to progress the development of a measure.
| S-EPMC7908320 | biostudies-literature
Project description:It is important to identify children who are struggling with emergent literacy skills as early as possible to provide them with the support they need to prevent future academic failure. Screening tools administered in groups are more cost-effective than those administered individually, but few are available in Portugal. The goal of this study was to explore the psychometric properties (difficulty, reliability, and validity) of a group emergent literacy screening test for Portuguese-speaking children. The test includes two phonological awareness tasks, one vocabulary task, and one concepts of print task. The sample comprised 1379 children from pre-K (n = 314), kindergarten (n = 579), and first grade of primary education (n = 486). Measures of emergent literacy, reading and writing skills, and academic achievement were used to test the validity of the screening test. The Rasch model results suggest that the tasks were suitably difficult for the kindergarten group, but had varying levels of difficulty for pre-K and first grade. Reliability was adequate for the tasks with an appropriate level of difficulty. Scores for the screening test were highly correlated with measures of literacy and with academic achievement. These findings suggest that the presented emergent literacy screening test is valid and reliable, making it a useful tool for practice and research.
| S-EPMC9955426 | biostudies-literature
Project description:Physical literacy is becoming increasingly popular in sport, recreation, physical education and physical activity settings and programming. We developed an environmental assessment tool to evaluate the extent child and youth activity programs implement physical literacy across four domains: environment, programming, leaders and staff, and values and goals. The Physical Literacy Environmental Assessment (PLEA) tool was developed in 3 phases. First, the PLEA tool was created, content validity established, and physical literacy leaders were consulted. In the second phase, the PLEA tool was completed and tested by 83 child and youth programs and it was validated with individual physical literacy assessments completed on children in programs that scored in the top 10% and bottom 10% on the PLEA tool. Third, a National consultation was conducted, and program leaders provided feedback on the PLEA tool. In Phase 1, the PLEA tool was modified and shortened from 41 to 29 indicators, based on feedback from physical literacy content leaders. In Phase 2, participants in programs that scored in the top 10% had significantly higher scores on the upper body object control domain of PLAYfun (p = 0.018), and significantly higher PLAYself scores (p = 0.04) than participants in programs that scored in the bottom 10%. In Phase 3, over 80% of program leaders identified the PLEA tool was useful, and relevant to their areas of practice. The completed PLEA tool is a 20-item environmental assessment tool to evaluate to what degree child and youth programming implement physical literacy across four domains: environment, programming, leaders and staff, and values and goals. The application and validity of the PLEA tool beyond child and youth physical education, sport, dance and recreation sectors, such as in early years programs, should be investigated.
| S-EPMC7077881 | biostudies-literature
Project description:ObjectiveFood literacy is the knowledge, skills and behaviours needed to meet food needs and determine intake and is conceptualised as eleven components under four domains of planning and managing, selecting, preparing, and eating. Previous measures of food literacy vary in their adherence to the conceptualisation and ability to capture totality of eating. This study aimed to determine items for inclusion and exclusion in a food literacy item pool and capture the general public's interpretation of everyday food literacy practices.DesignBeginning with an item pool from previous studies, cognitive interviews were conducted using think-aloud and verbal probing methods. Data were first analysed for applicability, clarity, ambiguity and logic, then for emergent themes to ensure items captured the totality of the participant's eating.SettingAustralia.ParticipantsAustralian residents over 18 years of age recruited via Facebook residential groups (n 20).ResultsOf the original 116 items, 11 items had limited applicability; 13 items had unclear references; 32 items had lexical problems and 11 items had logical problems. In total, 29 items were deleted, 31 retained and 56 revised. Thematic analysis revealed participants limited their responses to consider only conventional practices such as grocery shopping, cooking and planned meals rather than the totality of their eating. An additional eighty-four items were developed to address eating out, incidental eating occasions and inconsistencies between participants assumed correct knowledge and that of public health guidelines. This resulted in a refined 171-item pool.ConclusionsThis study progresses the development towards a comprehensive, validated food literacy questionnaire.
| S-EPMC9991617 | biostudies-literature
Project description:Food literacy interventions are widely implemented to improve the food security and health of low-socioeconomic adults. The purpose of this study was to conduct an inquiry into the value of OzHarvest's six-week NEST (Nutrition Education and Skills Training) program in promoting food security and food literacy, and to identify the barriers and enablers that participants experienced in sustaining food security, and in utilising their food literacy skills beyond the program. A descriptive evaluation study with pre-post surveys (n = 21) and post-program interviews (n = 17) was conducted, with a convenience sample of NEST program participants living in Sydney, Newcastle, and Melbourne, Australia. Participants demonstrated improvements in food security status (p = 0.030), cooking confidence (p = 0.001), food preparation behaviours (p = 0.006), nutrition knowledge (p = 0.033), vegetable consumption (p = 0.043), and a reduction in intake of sugar-sweetened beverages (p = 0.017), and salty snack foods (p = 0.011). The interviews revealed that participants learned to stretch their food budgets and make meaningful changes to their food utilisation (a key dimension of food security). Interviews also identified enablers (e.g., social support) and barriers (e.g., health conditions) to achieving food security. Acknowledging the need for a multi-faceted approach that also addresses upstream determinants, interventions like NEST may play a role in promoting food security and food literacy.
| S-EPMC7468773 | biostudies-literature
Project description:PurposeFor clients to understand social insurance decisions and processes, information from authorities needs to be comprehensible, and clients need sufficient individual abilities. These dimensions are captured by the concept social insurance literacy, which has been operationalized into a measure, the Social Insurance Literacy Questionnaire (SILQ). The aim of this study was to describe the development of the SILQ and evaluate its psychometric properties using Rasch measurement theory.MethodsThe development of the SILQ included a Delphi study and cognitive interviews. A preliminary version, divided on four scales corresponding to the domains of the concept (obtaining information, understanding information, acting on information, and system comprehensibility) was psychometrically evaluated according to Rasch measurement theory, in a survey to a stratified random sample of people on sick leave (n = 1151) sent out in the fall of 2020.ResultsOverall, the items in the final version of the SILQ demonstrated good fit to the Rasch model, and the response scale worked as intended. Unidimensionality was supported for all scales, but minor problems with local dependency was detected for three items. The person separation was 0.80 for the Obtain scale, 0.82 for the Understand scale, 0.68 for the Act scale, and 0.81 for the System scale. Corresponding ordinal alpha values were 0.91, 0.91, 0.86, and 0.91, respectively.ConclusionThis study is a first step toward exploring literacy in the social insurance field. The SILQ covers individual abilities and systems' comprehensibility, and the results show that it has acceptable psychometric properties.
| S-EPMC11364705 | biostudies-literature
Project description:BACKGROUND:For people to be able to access, understand, and benefit from the increasing digitalization of health services, it is critical that services are provided in a way that meets the user's needs, resources, and competence. OBJECTIVE:The objective of the study was to develop a questionnaire that captures the 7-dimensional eHealth Literacy Framework (eHLF). METHODS:Draft items were created in parallel in English and Danish. The items were generated from 450 statements collected during the conceptual development of eHLF. In all, 57 items (7 to 9 items per scale) were generated and adjusted after cognitive testing. Items were tested in 475 people recruited from settings in which the scale was intended to be used (community and health care settings) and including people with a range of chronic conditions. Measurement properties were assessed using approaches from item response theory (IRT) and classical test theory (CTT) such as confirmatory factor analysis (CFA) and reliability using composite scale reliability (CSR); potential bias due to age and sex was evaluated using differential item functioning (DIF). RESULTS:CFA confirmed the presence of the 7 a priori dimensions of eHLF. Following item analysis, a 35-item 7-scale questionnaire was constructed, covering (1) using technology to process health information (5 items, CSR=.84), (2) understanding of health concepts and language (5 items, CSR=.75), (3) ability to actively engage with digital services (5 items, CSR=.86), (4) feel safe and in control (5 items, CSR=.87), (5) motivated to engage with digital services (5 items, CSR=.84), (6) access to digital services that work (6 items, CSR=.77), and (7) digital services that suit individual needs (4 items, CSR=.85). A 7-factor CFA model, using small-variance priors for cross-loadings and residual correlations, had a satisfactory fit (posterior productive P value: .27, 95% CI for the difference between the observed and replicated chi-square values: -63.7 to 133.8). The CFA showed that all items loaded strongly on their respective factors. The IRT analysis showed that no items were found to have disordered thresholds. For most scales, discriminant validity was acceptable; however, 2 pairs of dimensions were highly correlated; dimensions 1 and 5 (r=.95), and dimensions 6 and 7 (r=.96). All dimensions were retained because of strong content differentiation and potential causal relationships between these dimensions. There is no evidence of DIF. CONCLUSIONS:The eHealth Literacy Questionnaire (eHLQ) is a multidimensional tool based on a well-defined a priori eHLF framework with robust properties. It has satisfactory evidence of construct validity and reliable measurement across a broad range of concepts (using both CTT and IRT traditions) in various groups. It is designed to be used to understand and evaluate people's interaction with digital health services.
| S-EPMC5826975 | biostudies-literature
Project description:BackgroundThe World Health Organization describes health literacy as a critical determinant of health and driver of citizen empowerment and health equity. Several studies have shown that health literacy is associated with a range of socioeconomic factors including educational attainment, financial position and ethnicity. The complexity of the health system influences how well a person is able to engage with information and services. Health organisations can empower the populations they serve and address inequity by ensuring they are health literacy responsive. The aim of this study was to develop the Organisational Health Literacy Responsiveness self-assessment tool (Org-HLR Tool), and an assessment process to support organisations with application of the tool.MethodsA co-design workshop with health and social service professionals was undertaken to inform the structure of the tool and assessment process. Participants critiqued existing self-assessment tools and discussed the likely utility of the data they generate. A review of widely used organisational performance assessment tools informed the structure and self-assessment process. The Organisational Health Literacy Responsiveness (Org-HLR) Framework (with seven domains/24 sub-domains) provided the structure for the assessment dimensions of the tool. The performance indicators were drawn from raw data collected during development of the Org-HLR Framework.ResultsTwenty-two professionals participated in the workshop. Based on the feedback provided and a review of existing tools, a multi-stage, group-based assessment process for implementing the Org-HLR Tool was developed. The assessment process was divided into three parts; i) reflection; ii) self-rating; and iii) priority setting, each supported by a corresponding tool. The self-rating tool, consistent with the Org-HLR Framework, was divided into: External policy and funding environment; Leadership and culture; Systems, processes and policies; Access to services and programs; Community engagement and partnerships; Communication practices and standards; Workforce. Each of these had 1 to 5 sub-dimensions (24 in total), and 135 performance indicators.ConclusionsThe Org-HLR Tool and assessment process were developed to address a gap in available tools to support organisations to assess their health literacy responsiveness, and prioritise and plan their quality improvement activities. The tool is currently in the field for further utility and acceptability testing.
| S-EPMC6128002 | biostudies-literature