Dataset Information

Psychometric Properties of Child (0-5 Years) Outcome Measures as used in Randomized Controlled Trials of Parent Programs: A Systematic Review.

ABSTRACT: This systematic review is one of the three which sought to identify measures commonly implemented in parenting program research, and to assess the level of psychometric evidence available for their use with this age group. This review focuses specifically on measures of child social-emotional and behavioral outcomes. Two separate searches of the same databases were conducted; firstly to identify eligible instruments, and secondly to identify studies reporting on the psychometric properties of the identified measures. Five commercial platforms hosting 19 electronic databases were searched from their inception to conducted search dates. Twenty-four measures were identified from Search 1: a systematic search of randomized controlled trial evaluations of parenting programs. For Search 2, inclusion/exclusion criteria were applied to 21,329 articles that described the development and/or validation of the 24 measures identified in Search 1. Thirty articles met the inclusion criteria. resulting in 11 parent report questionnaires and three developmental assessment measures for review. Data were extracted and synthesized to describe the methodological quality of each article using the COSMIN checklist alongside the overall quality rating of the psychometric property reported for each measure. Measure reliability was categorized into four domains (internal consistency, test-re-test, inter-rater, and intra-rater). Measure validity was categorized into four domains (content, structural, convergent/divergent, and discriminant). Results indicated that supporting evidence for included measures is weak. Further work is required to improve the evidence base for those measures designed to assess children's social-emotional and behavioral development in this age group. PROSPERO Registration number: CRD42016039600.

SUBMITTER: Gridley N

PROVIDER: S-EPMC6669186 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Psychometric Properties of Child (0-5 Years) Outcome Measures as used in Randomized Controlled Trials of Parent Programs: A Systematic Review.

Gridley Nicole N Blower Sarah S Dunn Abby A Bywater Tracey T Bryant Maria M

Clinical child and family psychology review 20190901 3

This systematic review is one of the three which sought to identify measures commonly implemented in parenting program research, and to assess the level of psychometric evidence available for their use with this age group. This review focuses specifically on measures of child social-emotional and behavioral outcomes. Two separate searches of the same databases were conducted; firstly to identify eligible instruments, and secondly to identify studies reporting on the psychometric properties of th ...[more]

PMID: 30806864

Similar Datasets

Project description:BackgroundAnkle fractures cause considerable pain, loss of function and healthcare resource use. High quality randomised controlled trials are required to evaluate the optimal management protocols for ankle fracture. However, there is debate regarding the most appropriate outcome measure to use when assessing patients with ankle fractures. The aim of this systematic review is to identify and summarise primary outcome measure use in clinical trials of non-pharmacological interventions for adults with an ankle fracture.MethodsWe performed comprehensive searches of the Medline, Embase, CINAHL, AMED and Cochrane CENTRAL databases, as well as ISRCTN and ClinicalTrials.gov online clinical trial registries on 19/06/2019 with no date limits applied. The titles and abstracts were initially screened to identify randomised or quasi-randomised clinical trials of non-pharmacological interventions for ankle fracture in adults. Two authors independently screened the full text of any articles which could potentially be eligible. Descriptive statistics we used to summarise the outcome measures collected in these articles including an assessment of trends over time. Secondary analysis included a descriptive summary of the multi-item patient reported outcome measures used in this study type.ResultsThe searches returned a total of 3380 records. Following application of the eligibility criteria, 121 records were eligible for inclusion in this review. The most frequently collected primary outcome measures in this type of publication was the Olerud Molander Ankle Score, followed by radiographic and range of movement assessments. There was a total of 28 different outcome measures collected and five different multi-item, patient reported outcome measures collected as the primary outcome measure. There was a sequential increase in the number of this type of study published per decade since the 1980's.ConclusionThis review demonstrates the wide range of measurement methods used to assess outcome in adults with an ankle fracture. Future research should focus on establishing the validity and reliability of the outcome measures used in this patient population. Formulation of a consensus based core outcome set for adults with an ankle fracture would be advantageous for ensuring homogeneity across studies in order to meta-analyse trial results.

Project description:BackgroundMultiple Sclerosis (MS) is associated with impaired gait and a growing number of clinical trials have investigated efficacy of various interventions. Choice of outcome measures is crucial in determining efficiency of interventions. However, it remains unclear whether there is consensus on which outcome measures to use in gait intervention studies in MS.ObjectiveWe aimed to identify the commonly selected outcome measures in randomized controlled trials (RCTs) on gait rehabilitation interventions in people with MS. Additional aims were to identify which of the domains of the International Classification of Functioning, Disability and Health (ICF) are the most studied and to characterize how outcome measures are combined and adapted to MS severity.MethodsPubmed, Cochrane Central, Embase and Scopus databases were searched for RCT studies on gait interventions in people living with MS according to PRISMA guidelines.ResultsIn 46 RCTs, we identified 69 different outcome measures. The most used outcome measures were 6-minute walking test and the Timed Up and Go test, used in 37% of the analyzed studies. They were followed by gait spatiotemporal parameters (35%) most often used to inform on gait speed, cadence, and step length. Fatigue was measured in 39% of studies. Participation was assessed in 50% of studies, albeit with a wide variety of scales. Only 39% of studies included measures covering all ICF levels, and Participation measures were rarely combined with gait spatiotemporal parameters (only two studies).ConclusionsSelection of outcome measures remains heterogenous in RCTs on gait rehabilitation interventions in MS. However, there is a growing consensus on the need for quantitative gait spatiotemporal parameter measures combined with clinical assessments of gait, balance, and mobility in RCTs on gait interventions in MS. Future RCTs should incorporate measures of fatigue and measures from Participation domain of ICF to provide comprehensive evaluation of trial efficacy across all levels of functioning.

Project description:Implementation outcome measures are essential for monitoring and evaluating the success of implementation efforts. Yet, currently available measures lack conceptual clarity and have largely unknown reliability and validity. This study developed and psychometrically assessed three new measures: the Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM).Thirty-six implementation scientists and 27 mental health professionals assigned 31 items to the constructs and rated their confidence in their assignments. The Wilcoxon one-sample signed rank test was used to assess substantive and discriminant content validity. Exploratory and confirmatory factor analysis (EFA and CFA) and Cronbach alphas were used to assess the validity of the conceptual model. Three hundred twenty-six mental health counselors read one of six randomly assigned vignettes depicting a therapist contemplating adopting an evidence-based practice (EBP). Participants used 15 items to rate the therapist's perceptions of the acceptability, appropriateness, and feasibility of adopting the EBP. CFA and Cronbach alphas were used to refine the scales, assess structural validity, and assess reliability. Analysis of variance (ANOVA) was used to assess known-groups validity. Finally, half of the counselors were randomly assigned to receive the same vignette and the other half the opposite vignette; and all were asked to re-rate acceptability, appropriateness, and feasibility. Pearson correlation coefficients were used to assess test-retest reliability and linear regression to assess sensitivity to change.All but five items exhibited substantive and discriminant content validity. A trimmed CFA with five items per construct exhibited acceptable model fit (CFI = 0.98, RMSEA = 0.08) and high factor loadings (0.79 to 0.94). The alphas for 5-item scales were between 0.87 and 0.89. Scale refinement based on measure-specific CFAs and Cronbach alphas using vignette data produced 4-item scales (?'s from 0.85 to 0.91). A three-factor CFA exhibited acceptable fit (CFI = 0.96, RMSEA = 0.08) and high factor loadings (0.75 to 0.89), indicating structural validity. ANOVA showed significant main effects, indicating known-groups validity. Test-retest reliability coefficients ranged from 0.73 to 0.88. Regression analysis indicated each measure was sensitive to change in both directions.The AIM, IAM, and FIM demonstrate promising psychometric properties. Predictive validity assessment is planned.

Project description:IntroductionAssessing treatment response is key to determining treatment value in atopic dermatitis (AD). Currently, response is assessed using various clinician- or patient-reported measures and response criteria. This variation creates a mismatch of evidence across trials, hindering the ability of clinicians, regulators, and payers to compare the efficacy of treatments. This review identifies which measures and criteria are used to determine response in clinical trials and health technology assessments (HTAs). Moreover, it systematically reviews the psychometric performance of those measures and criteria to understand which perform best in capturing patient-relevant symptoms and treatment benefits.MethodsA scoping review of clinical trials and HTAs in AD identified the following measures for inclusion: the Eczema Area and Severity Index (EASI), the Investigator's Global Assessment (IGA), the Dermatology Life Quality Index (DLQI) and the Peak Pruritus Numerical Rating Scale (PP-NRS). A systematic search was performed in MEDLINE and Embase to identify studies testing the psychometric performance of these measures in adults or adolescents with AD.ResultsA lack of consistency in the assessment of response was observed across clinical trials and HTAs. Important gaps in psychometric evidence were identified. No content validations of the EASI and IGA in AD were found, while some quantitative studies suggested that these measures fail to capture itch, a core symptom. The PP-NRS and DLQI performed well. No studies compared the performance of different response criteria.ConclusionContent validation of the PP-NRS confirmed the importance of itch as a core symptom and treatment priority in AD; however, itch is not well covered in the EASI or IGA. Including the PP-NRS in clinical trials and HTAs will better capture patient-relevant benefit and response. Although various response criteria were used, no studies compared the performance of different criteria to inform which were most appropriate to compare treatments in clinical trials and HTAs.

Dataset Information

Psychometric Properties of Child (0-5 Years) Outcome Measures as used in Randomized Controlled Trials of Parent Programs: A Systematic Review.

Publications

Psychometric Properties of Child (0-5 Years) Outcome Measures as used in Randomized Controlled Trials of Parent Programs: A Systematic Review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets