Dataset Information

Validation of the modified Fresno test: assessing physical therapists' evidence based practice knowledge and skills.

ABSTRACT:

Background

Health care educators need valid and reliable tools to assess evidence based practice (EBP) knowledge and skills. Such instruments have yet to be developed for use among physical therapists. The Fresno Test (FT) has been validated only among general practitioners and occupational therapists and does not assess integration of research evidence with patient perspectives and clinical expertise. The purpose of this study was to develop and validate a modified FT to assess EBP knowledge and skills relevant to physical therapist (PT) practice.

Methods

The FT was modified to include PT-specific content and two new questions to assess integration of patient perspectives and clinical expertise with research evidence. An expert panel reviewed the test for content validity. A cross-sectional cohort representing three training levels (EBP-novice students, EBP-trained students, EBP-expert faculty) completed the test. Two blinded raters, not involved in test development, independently scored each test. Construct validity was assessed through analysis of variance for linear trends among known groups. Inter and intra-rater reliability, internal consistency, item discrimination index, item total correlation, and difficulty were analyzed.

Results

Among 108 participants (31 EBP-novice students, 50 EBP-trained students, and 27 EBP-expert faculty), there was a statistically significant (p < 0.0001) difference in total score corresponding to training level. Total score reliability and psychometric properties of items modified for discipline-specific content were excellent [inter-rater (ICC (2,1)] = 0.91); intra-rater (ICC (2,1)] = 0.95, 0.96)]. Cronbach's alpha was 0.78. Of the two new items, only one had strong psychometric properties.

Conclusions

The 13-item modified FT presented here is a valid, reliable assessment of physical therapists' EBP knowledge and skills. One new item assesses integration of patient perspective as part of the EBP model. Educators and researchers may use the 13-item modified FT to evaluate PT EBP curricula and physical therapists' EBP knowledge and skills.

SUBMITTER: Tilson JK

PROVIDER: S-EPMC2896364 | biostudies-literature | 2010 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validation of the modified Fresno test: assessing physical therapists' evidence based practice knowledge and skills.

Tilson Julie K JK

BMC medical education 20100525

<h4>Background</h4>Health care educators need valid and reliable tools to assess evidence based practice (EBP) knowledge and skills. Such instruments have yet to be developed for use among physical therapists. The Fresno Test (FT) has been validated only among general practitioners and occupational therapists and does not assess integration of research evidence with patient perspectives and clinical expertise. The purpose of this study was to develop and validate a modified FT to assess EBP know ...[more]

PMID: 20500871

Similar Datasets

Project description:BackgroundThe Modified Fresno Test has been used to evaluate the use of the Evidence-Based Physiotherapy (EBP). So far, none of the versions of the Fresno Test were subjected to analysis of the factorial structure. The objective of the study was to describe the exploratory and confirmatory factor structure of the Modified Fresno Test adapted to the Portuguese-Brazilian and analyze the statistical feasibility for the elaboration of a short version.MethodsThe questionnaire was applied with a convenience sample of 57 physiotherapists, being 36 professionals (13 of these also professors) and 21 students from the last semester of the physiotherapy course. Exploratory Factor Analysis (EFA) was performed by the method of principal components. Confirmatory Factor Analysis (CFA) was performed by the method of maximum likelihood. The total score of the answers in the test and retest was evaluated, totalling 228 observations. Reliability was assessed by means of internal consistency, using Cronbach's alpha coefficient.ResultsReliability was satisfactory (α 0.81) for all questions of the instrument. The coefficient α calculated for the corrected item-total showed values higher than 0.20 except for item 9. Preliminary tests for Exploratory Factor Analysis showed acceptable values with Kaiser-Meyer-Olkin (KMO = 0.80) and Bartlett's test of sphericity [chi-square (78) = 1149.615, p < 0.001], indicating that the correlations were sufficient for analysis. The analysis revealed the presence of 3 factors (eigenvalues> 1), which explains 60.9% of the instrument's total variance. In Confirmatory Factor Analysis, none of the indices came close to an acceptable level (≥ 0.90), however, the second model which tested a three-factor structure provided a better fit to the data. From the results of this study the Modified Fresno Test short version was drawn.ConclusionThe analysis showed good factor validity and adequate internal consistency for the use of the instrument consisting of 13 questions and 3 factors. This model proved to be better than the original model. The short version consisting of 9 questions may be an appropriate alternative for use in the population of interest.

Project description:Purpose: The aim of this study was to develop a tool to assess physical therapists' knowledge, skills, and judgement in performing airway suctioning with intubated and non-intubated adults. Method: A modified Delphi methodology was used to develop the tool and to evaluate its sensibility (i.e., common-sense nature). Participants were experienced cardiorespiratory physical therapists who perform airway suctioning and physical therapists employed in academic positions related to cardiorespiratory physical therapy at Canadian universities. Round 1 focused on refining which items to include in the tool, Round 2 focused on finalizing the items, and Round 3 focused on evaluating a preliminary version of the tool. Results: A total of 34 individuals participated in Round 1, 30 participated in Round 2, and 25 participated in Round 3. A literature review identified 11 relevant domains and 69 supporting competencies. In Round 1, consensus was achieved for all domains; however, it was borderline for the professionalism domain. Multiple participants suggested that it was redundant because it is a global requirement for all physical therapists. Consensus was also achieved for 64 of the 69 supporting competencies; however, it was borderline for 5 of these items, and 5 achieved no consensus. In Round 2, participants rated a series of recommendations related to items requiring further consideration, as well as 9 new items suggested by the participants in Round 1. In Round 3, the preliminary tool was found to be globally sensible, but concerns were expressed about the inclusion of redundant factors and the tool's length. The tool was revised, resulting in a tool with 4 domains, 6 sub-domains and 43 supporting competencies, as well as an item rating the individual's overall performance. Conclusions: The final-round sensibility questionnaire provided preliminary evidence of the tool's face and content validity. We will investigate the tool's measurement properties in a future study.

Project description:BackgroundPhysical therapists are uniquely positioned in health care to initiate or support smoking cessation (SC). Little is known, however, about their knowledge and views of SC as part of their practices. Objective The purpose of this study was to assess Canadian physical therapists' knowledge about the health effects of smoking, their views about addressing SC in practice, and their self-efficacy in enabling patients to quit smoking. Design This study was a cross-sectional survey.MethodsLicensed physical therapists in Canada were surveyed with postal methods.ResultsA total of 738 survey questionnaires were returned. The mean age and years of clinical experience of the respondents were 41.9 (SD=10.8) years and 17.4 (SD=11.0), respectively. Most respondents (78.6%) were women. Canadian physical therapists are largely informed about the negative effects of smoking on health. Although 76.9% of the physical therapists agreed or strongly agreed that the profession should be more involved in helping people who smoke quit, only 56.8% of the physical therapists agreed or strongly agreed that they should receive training on SC. More than 70% of the physical therapists reported that they were not prepared to provide counseling and, overall, the level of self-efficacy regarding counseling about SC was low. Lack of resources and time were reported to be key barriers to counseling patients to quit smoking. Limitations The findings of this study are limited to Canadian physical therapists. Response bias and social desirability bias also are potential limiters in this study.ConclusionsOverall, the majority of physical therapists expressed the view that advising people who smoke to quit is a clinical responsibility and endorsed greater involvement of the profession in helping people who smoke quit. Discordance existed, however, between these views and the physical therapists' interest in receiving training on counseling about SC. This is a benchmark study that has practical implications for targeting training consistent with the profession's mission to improve health by increasing physical therapists' preparedness and self-efficacy regarding counseling about SC.

Project description:ObjectiveA behavioral medicine approach, incorporating a biopsychosocial view and behavior change techniques, is recommended in physical therapy for the management of musculoskeletal pain. However, little is known about physical therapists' actual practice behavior regarding the behavioral medicine approach. The aim of this study was to examine how physical therapists in primary health care judge their own practice behavior of a behavioral medicine approach in the assessment and treatment of patients with persistent musculoskeletal pain versus how they practice a behavioral medicine approach as observed by independent experts in video recordings of patient consultations.MethodsA prospective cohort study was conducted. Video recordings of 23 physical therapists' clinical behavior in 139 patient consultations were observed by independent experts and compared with the physical therapists' self-reported practice behavior, using a protocol including 24 clinical behaviors. The difference between observed and self-reported clinical behaviors was analyzed with a Chi-square test and a Fisher exact test.ResultsThe behavioral medicine approach was, in general, practiced to a small extent and half of the self-reported clinical behaviors were overestimated when compared with the observed behaviors. According to the observations, the physical perspective dominated in assessment and treatment, the functional behavioral analysis was never performed, and the mean number of behavior change techniques used was 0.7.ConclusionThere was a discrepancy between how physical therapists perceived the extent to which they practiced a behavioral medicine approach in their clinical behavior compared with what the independent researchers observed in the video recordings.ImpactThis study demonstrates the importance of using observations instead of using self-reports when evaluating professionals' clinical behavior. The results also suggest that-to ensure that physical therapy integrates the biopsychosocial model of health-physical therapists need to increase their focus on psychosocial factors in clinical practice.

Dataset Information

Validation of the modified Fresno test: assessing physical therapists' evidence based practice knowledge and skills.

Background

Methods

Results

Conclusions

Publications

Validation of the modified Fresno test: assessing physical therapists' evidence based practice knowledge and skills.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets