Dataset Information

Portuguese Physical Literacy Assessment Questionnaire (PPLA-Q) for adolescents (15-18 years) from grades 10-12: development, content validation and pilot testing.

ABSTRACT:

Background

The Portuguese Physical Literacy Assessment (PPLA) is a novel tool to assess high-school students' (grade 10-12; 15-18 years) Physical Literacy (PL) in Physical Education (PE); inspired by the four domains of the Australian Physical Literacy Framework (APLF), and the Portuguese PE syllabus. This paper describes the development, content validation, and pilot testing of the PPLA-Questionnaire (PPLA-Q), one of two instruments in the PPLA, comprised of modules to assess the psychological, social, and part of the cognitive domain of PL.

Methods

Development was supported by previous work, analysis of the APLF, and literature review. We iteratively gathered evidence on content validity through two rounds of qualitative and quantitative expert validation (n = 11); three rounds of cognitive interviews with high-school students (n = 12); and multiple instances of expert advisor input. A pilot study in two grade 10 classes (n = 41) assessed feasibility, preliminary reliability, item difficulty and discrimination.

Results

Initial versions of the PPLA-Q gathered evidence in favor of adequate content validity at item level: most items had an Item-Content Validity Index ≥.78 and Cohen's κ ≥ .76. At module-level, S-CVI/Ave and UA were .87/.60, .98/.93 and .96/.84 for the cognitive, psychological, and social modules, respectively. Through the pilot study, we found evidence for feasibility, preliminary subscale and item reliability, difficulty, and discrimination. Items were reviewed through qualitative methods until saturation. Current PPLA-Q consists of 3 modules: cognitive (knowledge test with 10 items), psychological (46 Likert-type items) and social (43 Likert-type items).

Conclusion

Results of this study provide evidence for content validity, feasibility within PE setting and preliminary reliability of the PPLA-Q as an instrument to assess the psychological, social, and part of the cognitive domain of PL in grade 10 to 12 adolescents. Further validation and development are needed to establish construct validity and reliability, and study PPLA-Q's integration with the PPLA-Observation (an instrument in development to assess the remaining domains of PL) within the PPLA framework.

SUBMITTER: Mota J

PROVIDER: S-EPMC8628133 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionAims of these studies were to develop the Portuguese Physical Literacy Assessment Observation instrument (PPLA-O) to assess the physical and part of the cognitive domain of Physical Literacy (PL) through data collected routinely by Physical Education (PE) teachers; and to assess the construct validity (dimensionality, measurement invariance, and convergent and discriminant validity) and score reliability of one of its modules [Movement Competence, Rules, and Tactics (MCRT)].MethodsContent analysis of the Portuguese PE syllabus and literature review were used for PPLA-O domain identification. Multidimensional Item Response Theory (MIRT) models were used to assess construct validity and reliability, along with bivariate correlations in a sample of 515 Portuguese grade 10-12 students (M age = 16, SD = 1).ResultsPPLA-O development resulted in an instrument with two modules: MCRT (22 physical activities) and Health-Related Fitness (HRF; 5 protocols); both assessed with teacher-reported data entered in a spreadsheet. A two correlated dimensions Graded Response Model (Manipulative-based Activities [MA], and Stability-based Activities [SA]) showed best fit to the MCRT data, suggesting measurement invariance across sexes, and adequate to good score reliabilities (MA = .89, and SA = .73). There was a moderate to high correlation (r = .68) between dimensions, and boys had higher scores in both dimensions. Correlations among MCRT scores and HRF variables were similar in magnitude to previous reports in meta-analysis and systematic reviews.ConclusionsPPLA-O is composed of two modules that integrate observational data collected by PE teachers into a common frame of criterion-referenced PL assessment. The HRF module uses data collected through widely validated FITescola® assessment protocols. The MCRT makes use of teacher-reported data collected in a wide range of activities and movement pursuits to measure movement competence and inherent cognitive skills (Tactics and Rules). We also gathered initial evidence supporting construct validity and score reliability of the MCRT module. This highly feasible instrument can provide Portuguese grade 10-12 (15-18 years) PE students with feedback on their PL journey, along with the other instrument of PPLA (PPLA-Questionnaire). Further studies should assess inter and intra-rater reliability and criterion-related validity of its two modules.

Project description:BackgroundPhysical literacy is defined as the motivation, confidence, physical competence, and knowledge and understanding to engage in physical activity for life. Physical literacy knowledge and understanding encompasses movement (how to move), performance (evaluation of movement), and health and fitness (value of exercise, need for relaxation and sleep, etc.). This paper describes the development and evaluation of a standardized assessment of physical literacy knowledge and understanding for Canadian children in grades 4, 5, and 6.MethodsProposed Physical Literacy Knowledge Questionnaire (PLKQ) content was identified through expert consultation and a review of provincial/territorial physical education curricula for grades 4 to 6. Open-ended questions verified language and generated response options. Feasibility was assessed via completion time and error frequency. Item validity assessed scores by age, gender, and teacher ratings of student knowledge. Test-retest reliability was assessed over short (2-day) and long (7-day) intervals.ResultsSubsets of 678 children (54% girls, 10.1?±?1.0 years of age) completed the feasibility and validity assessments. Response errors (missing or duplicate responses, etc.) were minimal (2% or less) except for one question (7% error) about the use of safety gear during physical activity. A Delphi process among experts in children's physical activity and fitness achieved consensus on the core content and supported an item analysis to finalize item selection. As expected, knowledge scores increased with age (partial eta2?=?0.07) but were not related to gender (p?=?0.63). Teacher ratings of children's knowledge of physical activity behaviour (r?=?0.13, p?=?0.01) and fitness (r?=?0.12, p?=?0.03), but not movement skill (r?=?0.07, p?=?0.19) were associated with PLKQ scores. Test-retest reliability for PLKQ score and individual questions was substantial to excellent for 71% of comparisons over a 2-day interval, but lower over a 7-day interval (53% substantial or excellent). Items with low reliability had high or low proportions of correct responses.ConclusionsThis study provides feasibility and validity evidence for the Physical Literacy Knowledge Questionnaire as an assessment of physical literacy knowledge for Canadian children in grades 4, 5, and 6. Completion rates were high and knowledge scores increased with age. Streamlining of the content in accordance with Delphi panel recommendations would further enhance feasibility, but would also focus the content on items with limited reliability. Future studies of alternative item wording and responses are recommended to enhance test-retest reliability.