A Meta-Analysis of the Convergent Validity of Self-Control Measures.
Ontology highlight
ABSTRACT:
SUBMITTER: Duckworth AL
PROVIDER: S-EPMC3105910 | biostudies-literature | 2011 Jun
REPOSITORIES: biostudies-literature
Publications
A Meta-Analysis of the Convergent Validity of Self-Control Measures.
Duckworth Angela Lee AL Kern Margaret L ML
Journal of research in personality 20110601 3
There is extraordinary diversity in how the construct of self-control is operationalized in research studies. We meta-analytically examined evidence of convergent validity among executive function, delay of gratification, and self- and informant-report questionnaire measures of self-control. Overall, measures demonstrated moderate convergence (r(random) = .27 [95% CI = .24, .30]; r(fixed) = .34 [.33, .35], k = 282 samples, N = 33,564 participants), although there was substantial heterogeneity in ...[more]
Similar Datasets
Project description:Self-report and cognitive tasks of reward sensitivity and self-regulation have influenced several developmental models that may explain the heightened engagement in risk behaviors during adolescence. Despite some inconsistencies across studies, few studies have explored the convergent, discriminant, and predictive validity of self-report and cognitive measures of these psychological characteristics in adolescence. The present study evaluated the convergent and discriminant validity of self-report and cognitive measures of reward sensitivity and self-regulation among 2017 adolescents (age M?=?16.8, SD?=?1.1; 56% female; 55% White, 22% Black, 8% Hispanic, 15% other race/ethnic; 49% 10th grade and 51% 12th grade). This study compared the predictive validity of an omnibus measure and specific measures of risk engagement. Convergent and discriminant validity from self-report to cognitive tasks were as predicted, although with weak convergent relationships. As hypothesized, compared to cognitive tasks, self-report measures consistently predicted risky behaviors and explained more variance in the models. These results demonstrate that while cognitive tasks can significantly predict certain risk behaviors, they require increased power to find the very small effects, raising questions about their use as implicit proxies for real world risk behavior.
| S-EPMC6732226 | biostudies-literature
Project description:Emotion reactivity and emotion regulation are salient constructs in theories of emotion and emotion disorders; however, little is known about the convergent and discriminant validity of instruments used to measure them. The current paper examines the validity of four emotion-regulation and three emotion-reactivity instruments (with a total of 27 subscales) across three independent samples of university students (total N = 715). Eight subscales from a coping instrument were also examined. Confirmatory factor analysis failed to show the expected patterns of convergent and discriminant validity; however, exploratory factor analysis revealed three different factors, reflecting out-of-control negative emotion, emotion awareness and expression, and cognitive strategies for emotion regulation. Results have implications for both basic emotions research and clinical science.
| S-EPMC6736644 | biostudies-literature
Project description:Background: An association between gaming disorder (GD) and the symptoms of common mental disorders is unraveled yet. In this preregistered study, we quantitatively synthesized reliability, convergent and discriminant validity of GD scales to examine association between GD and other constructs. Methods: Five representative GD instruments (GAS-7, AICA, IGDT-10, Lemmens IGD-9, and IGDS9-SF) were chosen based on recommendations by the previous systematic review study to conduct correlation meta-analyses and reliability generalization. A systematic literature search was conducted through Pubmed, Proquest, Embase, and Google Scholar to identify studies that reported information on either reliability or correlation with related variables. 2,124 studies were full-text assessed as of October 2020, and 184 were quantitatively synthesized. Conventional Hedges two-level meta-analytic method was utilized. Results: The result of reliability generalization reported a mean coefficient alpha of 0.86 (95% CI = 0.85-0.87) and a mean test-retest estimate of 0.86 (95% CI = 0.81-0.89). Estimated effect sizes of correlation between GD and the variables were as follows: 0.33 with depression (k = 45; number of effect sizes), 0.29 with anxiety (k = 37), 0.30 with aggression (k = 19), -0.22 with quality of life (k = 18), 0.29 with loneliness (k = 18), 0.56 with internet addiction (k = 20), and 0.40 with game playtime (k = 53), respectively. The result of moderator analyses, funnel and forest plots, and publication bias analyses were also presented. Discussion and Conclusion: All five GD instruments have good internal consistency and test-retest reliability. Relatively few studies reported the test-retest reliability. The result of correlation meta-analysis revealed that GD scores were only moderately associated with game playtime. Common psychological problems such as depression and anxiety were found to have a slightly smaller association with GD than the gaming behavior. GD scores were strongly correlated with internet addiction. Further studies should adopt a rigorous methodological procedure to unravel the bidirectional relationship between GD and other psychopathologies. Limitations: The current study did not include gray literature. The representativeness of the five tools included in the current study could be questioned. High heterogeneity is another limitation of the study. Systematic Review Registration: [https://www.crd.york.ac.uk/PROSPERO/], identifier [CRD42020219781].
| S-EPMC8689178 | biostudies-literature
Project description:The objective of this study is to determine whether summary estimates of a self-report physical activity questionnaire that does not specifically assess frequency or duration (the Coronary Artery Risk Development in Young Adults (CARDIA) physical activity history (PAH)) differs from the summary estimates of one that does (CARDIA Supplemental Questionnaire).After the year 25 examination (2010-2011), 203 CARDIA black and white men and women (age 50.3 ± 3.6 yr) at the Oakland, CA, site participated in this comparison study. The between-questionnaire association and agreement were determined for continuous and categorical estimates on the basis of 1) quartiles and 2) meeting 2008 physical activity guidelines. Differences in participant characteristics by concordance/discordance status were also examined. Finally, receiver operating characteristic curves were computed to determine the accuracy of the PAH compared with the supplemental questionnaire.Reported physical activity levels were high and varied significantly by race and sex (all P < 0.01). Between-questionnaire estimates were significantly correlated (rho = 0.75 to 0.90, all P < 0.001) and had high agreement (? = 0.51 to 0.80) across all race/sex groups. A higher proportion of women than men were classified as concordant by quartile of vigorous intensity (P = 0.001), but no other participant characteristics were associated with concordant/discordant quartile ranking. Participants classified as concordant on the basis of physical activity guidelines had lower body mass index than those classified as discordant (both P < 0.05). The area under the curve was 0.95, suggesting that the PAH has high accuracy for classifying individuals as meeting physical activity guidelines.Although it is inconvenient that the PAH is not expressed in more standard units, these findings support the practice of not directly assessing frequency and duration, which are frequent sources of reporting error.
| S-EPMC5842916 | biostudies-literature
Project description:Because they provide data on responsiveness to experimental manipulation, clinical trials involving mindfulness-based interventions are a source of evidence for the construct validity of self-report measures of mindfulness. Within-group and between-group changes in mindfulness were examined from randomized clinical trials comparing mindfulness interventions to other bona fide treatment comparison conditions or waitlist control conditions. We also examined changes in clinical outcomes and the magnitude of these changes relative to changes in mindfulness. We included 69 published studies representing 55 unique samples (n = 4,743). Self-report mindfulness measures showed relatively larger gains in mindfulness intervention conditions vis-à-vis waitlist comparison conditions at both post-treatment (effect size [ES] = 0.52, 95% CI [0.40, 0.64]) and follow-up (ES = 0.52 [0.20, 0.84]), although the effect at follow-up diminished to non-significance in a trim-and-fill analysis intended to account for publication bias (ES = 0.35 [-0.03, 0.72]). Measures of mindfulness also showed relatively larger gains in mindfulness intervention conditions vis-à-vis bona fide comparison conditions, but only at post-treatment (ES = 0.25 [0.11, 0.38], 0.10 [-0.08, 0.28], at post-treatment and follow-up, respectively). All three conditions (mindfulness, bona fide, waitlist) showed relatively larger improvements on measures of clinical outcomes than measures of mindfulness, with the exception of waitlist conditions for which this effect was no longer significant at follow-up. Taken together, findings provide partial support for the unique responsiveness of mindfulness self-report measures to interventions that include promotion of mindfulness meditation practice.
| S-EPMC6602541 | biostudies-literature
Project description:BackgroundThe validity of ratings of perceived exertion (RPE) during aerobic training is well established; however, its validity during resistance exercise is less clear. This meta-analysis used the known relationships between RPE and exercise intensity (EI), heart rate (HR), blood lactate (BLa), blood pressure (BP) and electromyography (EMG) to determine the convergent validity of RPE as a measure of resistance exercise intensity and physiological exertion, during different forms of resistance exercise. Additionally, this study aims to assess the effect of several moderator variables on the strength of the validity coefficients, so that clearer guidance can be given on the use of RPE during resistance exercise.MethodsAn online search of 4 databases and websites (PubMed, Web of Science SPORTDiscus and ResearchGate) was conducted up to 28 February 2020. Additionally, the reference lists of the included articles were inspected manually for further unidentified studies. The inclusion criteria were healthy participants of any age, a rating scale used to measure RPE, resistance exercise of any type, one cohort receiving no other intervention, and must present data from one of the following outcome measures: EI, HR, BP, EMG or BLa. Weighted mean effect sizes (r) were calculated using a random-effects model. Heterogeneity was assessed using the τ2 and I2 statistics. Moderator analysis was conducted using random-effects meta-regression.ResultsOne-hundred and eighteen studies were included in the qualitative synthesis, with 75 studies (99 unique cohorts) included in the meta-analysis. The overall weighted mean validity coefficient was large (0.88; 95% CI 0.84-0.91) and between studies heterogeneity was very large (τ2 = 0.526, I2 = 96.1%). Studies using greater workload ranges, isometric muscle actions, and those that manipulated workload or repetition time, showed the highest validity coefficients. Conversely, sex, age, training status, RPE scale used, and outcome measure no significant effect.ConclusionsRPE provides a valid measure of exercise intensity and physiological exertion during resistance exercise, with effect sizes comparable to or greater than those shown during aerobic exercise. Therefore, RPE may provide an easily accessible means of prescribing and monitoring resistance exercise training. Trial Registration The systematic review protocol was registered on the PROSPERO database (CRD42018102640).
| S-EPMC8742800 | biostudies-literature
Project description:A number scales have been developed to measure conspiracist ideation, but little attention has been paid to the factorial validity of these scales. We reassessed the psychometric properties of four widely-used scales, namely the Belief in Conspiracy Theories Inventory (BCTI), the Conspiracy Mentality Questionnaire (CMQ), the Generic Conspiracist Beliefs Scale (GCBS), and the One-Item Conspiracy Measure (OICM). Eight-hundred-and-three U.S. adults completed all measures, along with measures of endorsement of 9/11 and anti-vaccination conspiracy theories. Through both exploratory and confirmatory factor analysis, we found that only the BCTI had acceptable factorial validity. We failed to confirm the factor structures of the CMQ and the GBCS, suggesting these measures had poor factorial validity. Indices of convergent validity were acceptable for the BCTI, but weaker for the other measures. Based on these findings, we provide suggestions for the future refinement in the measurement of conspiracist ideation.
| S-EPMC5322923 | biostudies-literature
Project description:PurposeThe PET radioligand (R)-[11C]PK11195 is used to quantify the 18-kDa translocator protein (TSPO), a marker for glial activation. Since there is no brain region devoid of TSPO, an arterial input function (AIF) is ideally required for quantification of binding. However, obtaining an AIF is experimentally demanding, is sometimes uncomfortable for participants, and can introduce additional measurement error during quantification. The objective of this study was to perform an evaluation of the test-retest reliability and convergent validity of techniques used for quantifying (R)-[11C]PK11195 binding without an AIF in clinical studies.MethodsData from six healthy individuals who participated in two PET examinations, 6 weeks apart, were analyzed. Regional non-displaceable binding potential (BPND) values were calculated using the simplified reference tissue model, with either cerebellum as reference region or a reference input derived using supervised cluster analysis (SVCA). Standardized uptake values (SUVs) were estimated for the time interval of 40-60 min.ResultsTest-retest reliability for BPND estimates were poor (80% of ICCs <?0.5). BPND estimates derived without an AIF were not correlated with BPND, total or specific distribution volume from the 2TCM using an AIF (all R2?<?12%). SUVs showed moderate reliability but no correlation to any other outcome measure.ConclusionsCaution is warranted when interpreting patient-control comparisons employing (R)-[11C]PK11195 outcome measures obtained without an AIF.
| S-EPMC6265355 | biostudies-literature
Project description:Aggression among group housed male mice continues to challenge laboratory animal researchers because mitigation strategies are generally applied at the cage level without a good understanding of how it affects the dominance hierarchy. Aggression within a group is typically displayed by the dominant mouse targeting lower ranking subordinates; thus, the strategies for preventing aggression may be more successful if applied specifically to the dominant mouse. Unfortunately, dominance rank is often not assessed because of time intensive observations or tests. Several correlates of dominance status have been identified, but none have been directly compared to home cage behavior in standard housing. This study assessed the convergent validity of three dominance correlates (urinary darcin, tube test score, preputial gland to body length ratio) with wound severity and rankings based on home cage behavior, using factor analysis. Discriminant validity with open field measures was assessed to determine if tube test scores are independent of anxiety. Cages were equally split between SJL and albino C57BL/6 strains and group sizes of 3 or 5 (N = 24). Home cage behavior was observed during the first week, and dominance measures were recorded over the second. After controlling for strain and group size, darcin and preputial ratio had strong loadings on the same factor, which was a significant predictor of home cage ranking showing strong convergent validity. Tube test scores were not significantly impacted by open field data, showing discriminant validity. Social network analysis revealed that despotic power structures were prevalent, aggressors were typically more active and rested away from cage mates, and the amount of social investigation and aggression performed by an individual were highly correlated. Data from this study show that darcin and preputial ratio are representative of home cage aggression and provide further insight into individual behavior patterns in group housed male mice.
| S-EPMC8301077 | biostudies-literature
Project description:OBJECTIVE:To evaluate the convergent validity and responsiveness of the Stroke Upper Limb Capacity Scale (SULCS) in comparison to the Arm Motor Ability Test (AMAT), the Box and Blocks Test (BBT), and the upper limb Fugl-Meyer Assessment (FMA). The SULCS is a relatively new measure that was designed to be easier to score and less time consuming than some existing measures. DESIGN:Prospective repeated-measures design. SETTING:Clinical research laboratory of a large public hospital. PARTICIPANTS:Patients (N=61) <2 years poststroke with moderate to severe upper limb hemiparesis. INTERVENTION:Participants received 12 weeks of therapy that included neuromuscular electrical stimulation of the paretic finger and thumb extensors. The SULCS, AMAT, BBT, and FMA were administered at weeks 0, 6, 12 (end of therapy), 20, 28, and 36 (6mo post-therapy). MAIN OUTCOME MEASURES:Convergent validity was evaluated with Spearman's correlation coefficients between pairs of measures at each time point. Responsiveness from 0 to 12 weeks and 0 to 36 weeks was evaluated with the standardized response mean (SRM). RESULTS:The SULCS demonstrated strong correlation with the AMAT (?=0.81-0.93), BBT (?=0.73-0.92), and FMA (?=0.78-0.92), at all 6 time points. All 4 measures had moderate to large SRMs (SULCS, 0.71-0.77; AMAT, 0.83-0.97; BBT, 0.73-0.82; FMA, 0.75-0.76). There was no significant difference in responsiveness among the 4 measures. CONCLUSIONS:The results support the use of the SULCS to measure upper limb capacity in patients who are less than 2 years poststroke with moderate to severe hemiplegia.
| S-EPMC6309739 | biostudies-literature