Thoroughness and Psychometrics of Fidelity Measures in Occupational and Physical Therapy: A Systematic Review.
Ontology highlight
ABSTRACT: Objective
This study evaluated the thoroughness and psychometric properties of fidelity measures used by or of relevance to occupational or physical therapy.Method
A systematic review of the literature was completed. Assessments used to measure occupational or physical therapy intervention fidelity were evaluated for thoroughness, reliability, validity, and clinical utility.Results
Eight fidelity measures met inclusion criteria for this systematic review. Most of the measures had moderate levels of thoroughness in the coverage of key aspects of fidelity, reported adequate to excellent reliability and validity, and were highly variable in clinical utility.Conclusion
Additional research is recommended to validate existing occupational or physical therapy fidelity measures and to develop novel measures for other occupational therapy and physical therapy interventions. Clinicians and researchers must place greater emphasis on the development and implementation of fidelity measures to ensure uniformity in intervention delivery and high-quality, evidence-based care.
SUBMITTER: Hand BN
PROVIDER: S-EPMC6114192 | biostudies-literature | 2018 Sep/Oct
REPOSITORIES: biostudies-literature
Publications
Thoroughness and Psychometrics of Fidelity Measures in Occupational and Physical Therapy: A Systematic Review.
Hand Brittany N BN Darragh Amy R AR Persch Andrew C AC
The American journal of occupational therapy : official publication of the American Occupational Therapy Association 20180901 5
<h4>Objective</h4>This study evaluated the thoroughness and psychometric properties of fidelity measures used by or of relevance to occupational or physical therapy.<h4>Method</h4>A systematic review of the literature was completed. Assessments used to measure occupational or physical therapy intervention fidelity were evaluated for thoroughness, reliability, validity, and clinical utility.<h4>Results</h4>Eight fidelity measures met inclusion criteria for this systematic review. Most of the meas ...[more]
Similar Datasets
Project description:IntroductionImproving occupational performance is a key service of occupational therapists and client-centred approach to care is central to clinical practice. As such it is important to comprehensively evaluate the quality of psychometric properties reported across measures of occupational performance; in order to guide assessment and treatment planning.ObjectiveTo systematically review the literature on the psychometric properties of child-report measures of occupational performance for children ages 2-18 years.MethodsA systematic search of the following six electronic databases was conducted: CINAHL; PsycINFO; EMBASE; PubMed; the Health and Psychosocial Instruments (HAPI) database; and Google Scholar. The quality of the studies was evaluated against the COSMIN taxonomy of measurement properties and the overall quality of psychometric properties was evaluated using pre-set psychometric criteria.ResultsFifteen articles and one manual were reviewed to assess the psychometric properties of the six measures-the PEGS, MMD, CAPE, PAC, COSA, and OSA- which met the inclusion criteria. Most of the measures had conducted good quality studies to evaluate the psychometric properties of measures (PEGS, CAPE, PAC, OSA); however, the quality of the studies for two of these measures was relatively weak (MMD, COSA). When integrating the quality of the psychometric properties of the measures with the quality of the studies, the PAC stood out as having superior psychometric qualities.ConclusionsThe overall quality of the psychometric properties of most measures was limited. There is a need for continuing research into the psychometric properties of child-report measures of occupational performance, and to revise and improve the psychometric properties of existing measures.
| S-EPMC4726555 | biostudies-literature
Project description:This special section presents the psychometric properties of fidelity scales used in a national mental health services project in Norway to improve the quality of care of people with psychoses. Across Norway, 39 clinical units in six health trusts participated. The project provided education, implementation support and fidelity assessments. The papers in the section address the psychometrics of fidelity measurement for the specific evidence-based practices: illness management and recovery, family psychoeducation, physical healthcare and antipsychotic medication management. Another paper analyzes the psychometrics of a scale measuring individualization and quality improvement that may be used in conjunction with fidelity scales for specific evidence-based practices. The first paper in the section presents the development and field of fidelity scales, and the two final papers with comments add some additional perspectives and discuss fidelity scales in a wider context. The psychometrics of the five scales were good to excellent. Fidelity assessment is a necessary and effective strategy for quality improvement.
| S-EPMC7547989 | biostudies-literature
Project description:BackgroundAlthough item response theory (IRT) appears to be increasingly used within health care research in general, a comprehensive overview of the frequency and characteristics of IRT analyses within the rheumatic field is lacking. An overview of the use and application of IRT in rheumatology to date may give insight into future research directions and highlight new possibilities for the improvement of outcome assessment in rheumatic conditions. Therefore, this study systematically reviewed the application of IRT to patient-reported and clinical outcome measures in rheumatology.MethodsLiterature searches in PubMed, Scopus and Web of Science resulted in 99 original English-language articles which used some form of IRT-based analysis of patient-reported or clinical outcome data in patients with a rheumatic condition. Both general study information and IRT-specific information were assessed.ResultsMost studies used Rasch modeling for developing or evaluating new or existing patient-reported outcomes in rheumatoid arthritis or osteoarthritis patients. Outcomes of principle interest were physical functioning and quality of life. Since the last decade, IRT has also been applied to clinical measures more frequently. IRT was mostly used for evaluating model fit, unidimensionality and differential item functioning, the distribution of items and persons along the underlying scale, and reliability. Less frequently used IRT applications were the evaluation of local independence, the threshold ordering of items, and the measurement precision along the scale.ConclusionIRT applications have markedly increased within rheumatology over the past decades. To date, IRT has primarily been applied to patient-reported outcomes, however, applications to clinical measures are gaining interest. Useful IRT applications not yet widely used within rheumatology include the cross-calibration of instrument scores and the development of computerized adaptive tests which may reduce the measurement burden for both the patient and the clinician. Also, the measurement precision of outcome measures along the scale was only evaluated occasionally. Performed IRT analyses should be adequately explained, justified, and reported. A global consensus about uniform guidelines should be reached concerning the minimum number of assumptions which should be met and best ways of testing these assumptions, in order to stimulate the quality appraisal of performed IRT analyses.
| S-EPMC3517453 | biostudies-literature
Project description:Cerebral palsy (CP) treatment includes physical therapy and various complementary therapies to the standard clinical treatment. However, there are not many reviews that focus on the methods used and evaluation procedures. This study aims to analyze which tools are most suitable for the evaluation and methodology of patients with CP treated with physical therapy. Following the PRISMA statement, through a PICOS strategy, PubMed/MEDLINE, Web of Science (WOS), Scopus, Science Direct, and Scielo were searched with the following terms: cerebral palsy AND (physical therapy modalities OR therapeutics) AND outcome assessment. The methodological quality of the RCTs was assessed with the Evidence Project risk of bias tool. Thirty-seven RCTs and six RCT protocols, comprising 1359 participants with different types of CP: spastic hemiplegia/paresis, spastic diplegia/paresis, and spastic CP, met the inclusion criteria, uncovering 21 variables measured through 77 different instruments and several interventions. The therapies most widely used in CP are gaming or technology-assisted therapies, aerobic training, hippotherapy, music therapy, gait training, and aquatic exercises. This study provides an overview of what the authors used in the neurorehabilitation field through procedure evaluation and checking the technological advance that began to be used.
| S-EPMC8303849 | biostudies-literature
Project description:Backgroundmeasures of physical capability may be predictive of subsequent health, but existing published studies have not been systematically reviewed. We hypothesised that weaker grip strength, slower walking speed and chair rising and shorter standing balance time, in community-dwelling populations, would be associated with higher subsequent risk of fracture, cognitive outcomes, cardiovascular disease, hospitalisation and institutionalisation.Methodsstudies were identified through systematic searches of the electronic databases MEDLINE and EMBASE (to May 2009). Reference lists of eligible papers were also manually searched.Resultstwenty-four papers had examined the associations between at least one physical capability measure and one of the outcomes. As the physical capability measures and outcomes had been assessed and categorised in different ways in different studies, and there were differences in the potential confounding factors taken into account, this made it impossible to pool results. There were more studies examining fractures than other outcomes, and grip strength and walking speed were the most commonly examined capability measures. Most studies found that weaker grip strength and slower walking speed were associated with increased risk of future fractures and cognitive decline, but residual confounding may explain results in some studies. Associations between physical capability levels and the other specified outcomes have not been tested widely.Conclusionsthere is some evidence to suggest that objective measures of physical capability may be predictors of subsequent health in older community-dwelling populations. Most hypothesised associations have not been studied sufficiently to draw definitive conclusions suggesting the need for further research.
| S-EPMC3000177 | biostudies-literature
Project description:Burnout is a syndrome that results from chronic stress at work, with several consequences to workers' well-being and health. This systematic review aimed to summarize the evidence of the physical, psychological and occupational consequences of job burnout in prospective studies. The PubMed, Science Direct, PsycInfo, SciELO, LILACS and Web of Science databases were searched without language or date restrictions. The Transparent Reporting of Systematic Reviews and Meta-Analyses guidelines were followed. Prospective studies that analyzed burnout as the exposure condition were included. Among the 993 articles initially identified, 61 fulfilled the inclusion criteria, and 36 were analyzed because they met three criteria that must be followed in prospective studies. Burnout was a significant predictor of the following physical consequences: hypercholesterolemia, type 2 diabetes, coronary heart disease, hospitalization due to cardiovascular disorder, musculoskeletal pain, changes in pain experiences, prolonged fatigue, headaches, gastrointestinal issues, respiratory problems, severe injuries and mortality below the age of 45 years. The psychological effects were insomnia, depressive symptoms, use of psychotropic and antidepressant medications, hospitalization for mental disorders and psychological ill-health symptoms. Job dissatisfaction, absenteeism, new disability pension, job demands, job resources and presenteeism were identified as professional outcomes. Conflicting findings were observed. In conclusion, several prospective and high-quality studies showed physical, psychological and occupational consequences of job burnout. The individual and social impacts of burnout highlight the need for preventive interventions and early identification of this health condition in the work environment.
| S-EPMC5627926 | biostudies-literature
Project description:IntroductionPaediatric occupational therapy seeks to improve children's engagement and participation in life roles. A wide variety of intervention approaches exist. Our aim was to summarise the best-available intervention evidence for children with disabilities, to assist families and therapists choose effective care.MethodsWe conducted a systematic review (SR) using the Cochrane methodology, and reported findings according to PRISMA. CINAHL, Cochrane Library, MEDLINE, OTSeeker, PEDro, PsycINFO were searched. Two independent reviewers: (i) determined whether studies met inclusion: SR or randomised controlled trial (RCT); an occupational therapy intervention for children with a disability; (ii) categorised interventions based on name, core components and diagnostic population; (iii) rated quality of evidence and determined the strength of recommendation using GRADE criteria; and (iv) made recommendations using the Evidence Alert Traffic Light System.Results129 articles met inclusion (n = 75 (58%) SRs; n = 54 (42%)) RCTs, measuring the effectiveness of 52 interventions, across 22 diagnoses, enabling analysis of 135 intervention indications. Thirty percent of the indications assessed (n = 40/135) were graded 'do it' (Green Go); 56% (75/135) 'probably do it' (Yellow Measure); 10% (n = 14/135) 'probably don't do it' (Yellow Measure); and 4% (n = 6/135) 'don't do it' (Red Stop). Green lights were: Behavioural Interventions; Bimanual; Coaching; Cognitive Cog-Fun & CAPS; CO-OP; CIMT; CIMT plus Bimanual; Context-Focused; Ditto; Early Intervention (ABA, Developmental Care); Family Centred Care; Feeding interventions; Goal Directed Training; Handwriting Task-Specific Practice; Home Programs; Joint Attention; Mental Health Interventions; occupational therapy after toxin; Kinesiotape; Pain Management; Parent Education; PECS; Positioning; Pressure Care; Social Skills Training; Treadmill Training and Weight Loss 'Mighty Moves'.ConclusionEvidence supports 40 intervention indications, with the greatest number at the activities-level of the International Classification of Function. Yellow light interventions should be accompanied by a sensitive outcome measure to monitor progress and red light interventions could be discontinued because effective alternatives existed.
| S-EPMC6850210 | biostudies-literature
Project description:People with musculoskeletal disorders of the shoulder commonly experience pain, decreased strength, and restricted range of motion (ROM) that limit participation in meaningful occupational activities. The purpose of this systematic review was to evaluate the current evidence for interventions within the occupational therapy scope of practice that address pain reduction and increase participation in functional activities. Seventy-six studies were reviewed for this study-67 of Level I evidence, 7 of Level II evidence, and 2 of Level III evidence. Strong evidence was found that ROM, strengthening exercises, and joint mobilizations can improve function and decrease pain. The evidence to support physical modalities is moderate to mixed, depending on the shoulder disorder. Occupational therapy practitioners can use this evidence to guide daily clinical decision making.
| S-EPMC5182015 | biostudies-literature
Project description:Behaviour change interventions that promote physical activity have major implications for health and well-being. Measuring intervention fidelity is crucial in determining the extent to which an intervention is delivered as intended, therefore increasing scientific confidence about effectiveness. However, we lack a clear overview of how well intervention fidelity is typically assessed in physical activity trials.A systematic literature search was conducted to identify peer - reviewed physical activity promotion trials that explicitly measured intervention fidelity. Methods used to assess intervention fidelity were categorised, narratively synthesised and critiqued using assessment criteria from NIH Behaviour Change Consortium (BCC) Treatment Fidelity Framework (design, training, delivery, receipt and enactment).Twenty eight articles reporting of twenty one studies used a wide variety of approaches to measure intervention fidelity. Delivery was the most common domain of intervention fidelity measured. Approaches used to measure fidelity across all domains varied from researcher coding of observational data (using checklists or scales) to participant self-report measures. There was considerable heterogeneity of methodological approaches to data collection with respect to instruments used, attention to psychometric properties, rater-selection, observational method and sampling strategies.In the field of physical activity interventions, fidelity measurement is highly heterogeneous both conceptually and methodologically. Clearer articulation of the core domains of intervention fidelity, along with appropriate measurement approaches for each domain are needed to improve the methodological quality of fidelity assessment in physical activity interventions. Recommendations are provided on how this situation can be improved.
| S-EPMC5625828 | biostudies-other
Project description:BackgroundClimate change is likely to increase the threat of wildfires, and little is known about how wildfires affect health in exposed communities. A better understanding of the impacts of the resulting air pollution has important public health implications for the present day and the future.MethodWe performed a systematic search to identify peer-reviewed scientific studies published since 1986 regarding impacts of wildfire smoke on health in exposed communities. We reviewed and synthesized the state of science of this issue including methods to estimate exposure, and identified limitations in current research.ResultsWe identified 61 epidemiological studies linking wildfire and human health in communities. The U.S. and Australia were the most frequently studied countries (18 studies on the U.S., 15 on Australia). Geographic scales ranged from a single small city (population about 55,000) to the entire globe. Most studies focused on areas close to fire events. Exposure was most commonly assessed with stationary air pollutant monitors (35 of 61 studies). Other methods included using satellite remote sensing and measurements from air samples collected during fires. Most studies compared risk of health outcomes between 1) periods with no fire events and periods during or after fire events, or 2) regions affected by wildfire smoke and unaffected regions. Daily pollution levels during or after wildfire in most studies exceeded U.S. EPA regulations. Levels of PM10, the most frequently studied pollutant, were 1.2 to 10 times higher due to wildfire smoke compared to non-fire periods and/or locations. Respiratory disease was the most frequently studied health condition, and had the most consistent results. Over 90% of these 45 studies reported that wildfire smoke was significantly associated with risk of respiratory morbidity.ConclusionExposure measurement is a key challenge in current literature on wildfire and human health. A limitation is the difficulty of estimating pollution specific to wildfires. New methods are needed to separate air pollution levels of wildfires from those from ambient sources, such as transportation. The majority of studies found that wildfire smoke was associated with increased risk of respiratory and cardiovascular diseases. Children, the elderly and those with underlying chronic diseases appear to be susceptible. More studies on mortality and cardiovascular morbidity are needed. Further exploration with new methods could help ascertain the public health impacts of wildfires under climate change and guide mitigation policies.
| S-EPMC4262561 | biostudies-literature