Theoretical adequacy, methodological quality and efficacy of online interventions targeting resilience: a systematic review and meta-analysis.
Ontology highlight
ABSTRACT: Background
There is a growing interest in the promotion of mental health, and concepts as resilience are re-emerging and taking relevance. In addition, Information and Communication Technologies can provide potential benefits in the field of mental health, and the treatment of mental disorders in particular. This study aims to synthesize the evidence of internet-based resilience interventions, analyzing the theoretical adequacy, methodological quality and efficacy.Methods
A systematic search was performed. The eligibility criteria stated for this article were: randomized controlled trials targeted at adults or adolescents and including any psychological intervention focussing on resilience in its rationale or design. Studies with direct (e.g. resilience scales) and proximal resilience measures (e.g. scales on well-being) were included. Risk of bias was assessed for each trial using Cochrane's Collaboration Tool. Two reviewers worked independently in order to identify potential articles. A total of 11 articles were selected. A random-effects pooling model using the Hartung-Knapp-Sidik-Jonkman method based on direct and proximal resilience measures at post-test was used.Results
The overall effects of online resilience training compared to control groups at post-test were not significant; the effect size concerning the improvement of resilience was g=0.12 (95% CI: -0.14 to 0.38). In addition, a potential association between the type of outcome and the effect size could be revealed.Conclusions
The results of the present meta-analysis showed that the overall effect of online resilience trainings was not significant. Nonetheless, a tendency for a higher benefit for resilience was found in the studies with a clear assessment theory, indicating some promising effects.Registration number
PROSPERO CRD42018083339.
SUBMITTER: Diaz-Garcia A
PROVIDER: S-EPMC8266533 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ObjectiveTo summarize the guiding theoretical frameworks included in pediatric adherence-promotion interventions and characterize targeted domains using the theoretical domains framework (TDF), a standardized system developed by adult behavior change researchers.MethodsA systematic review of PubMed, PsycINFO, and CINAHL databases identified 47 articles describing pediatric adherence-promotion interventions. Data extraction was completed independently by two authors. Targeted intervention domains were classified using the TDF.ResultsThe majority of interventions did not cite a guiding theoretical framework or cited multiple theories with overlapping domains. The TDF was a reliable categorization system and suggested that pediatric adherence-promotion interventions most commonly target knowledge, skills, and social influences.ConclusionsPediatric adherence-promotion interventions draw from a variety of theories and lack a consistent language for describing targeted domains. The adapted TDF proposed here is one method of reducing variability in intervention development and reporting and may facilitate efforts to identify the processes that improve adherence.
| S-EPMC4536847 | biostudies-literature
Project description:The evaluation of interventions and policies designed to promote resilience, and research to understand the determinants and associations, require reliable and valid measures to ensure data quality. This paper systematically reviews the psychometric rigour of resilience measurement scales developed for use in general and clinical populations.Eight electronic abstract databases and the internet were searched and reference lists of all identified papers were hand searched. The focus was to identify peer reviewed journal articles where resilience was a key focus and/or is assessed. Two authors independently extracted data and performed a quality assessment of the scale psychometric properties.Nineteen resilience measures were reviewed; four of these were refinements of the original measure. All the measures had some missing information regarding the psychometric properties. Overall, the Connor-Davidson Resilience Scale, the Resilience Scale for Adults and the Brief Resilience Scale received the best psychometric ratings. The conceptual and theoretical adequacy of a number of the scales was questionable.We found no current 'gold standard' amongst 15 measures of resilience. A number of the scales are in the early stages of development, and all require further validation work. Given increasing interest in resilience from major international funders, key policy makers and practice, researchers are urged to report relevant validation statistics when using the measures.
| S-EPMC3042897 | biostudies-other
Project description:ObjectivesTo synthesise the available evidence on interventions designed to improve individual resilience.DesignA systematic review and meta-analysis METHODS: The following electronic databases were searched: Ovid Medline, Ovid EMBASE, PsycINFO, Ovid Cochrane and WHO Clinical Trials Registry in order to identify any controlled trials or randomised controlled trials (RCTs) examining the efficacy of interventions aimed at improving psychological resilience. Pooled effects sizes were calculated using the random-effects model of meta-analysis.Outcome measuresValid and reliable measures of psychological resilience.ResultsOverall, 437 citations were retrieved and 111 peer-reviewed articles were examined in full. Seventeen studies met the inclusion criteria and were subject to a quality assessment, with 11 RCTs being included in the final meta-analysis. Programmes were stratified into one of three categories (1) cognitive behavioural therapy (CBT)-based interventions, (2) mindfulness-based interventions or (3) mixed Interventions, those combining CBT and Mindfulness training. A meta-analysis found a moderate positive effect of resilience interventions (0.44 (95% CI 0.23 to 0.64) with subgroup analysis suggesting CBT-based, mindfulness and mixed interventions were effective.ConclusionsResilience interventions based on a combination of CBT and mindfulness techniques appear to have a positive impact on individual resilience.
| S-EPMC6009510 | biostudies-literature
Project description:PurposeTo assess the overall quality of published urological meta-analyses and identify predictive factors for high quality.Materials and methodsWe systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities.ResultsA total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, "a priori" design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and "a priori" design were associated with superior reporting quality, following PRISMA guideline and "a priori" design were associated with superior methodological quality.ConclusionsReporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having "a priori" protocol.
| S-EPMC5399869 | biostudies-literature
Project description:BackgroundHealthcare providers need reliable evidence for supporting the adoption of new interventions, of which the source of evidence often originates from systematic reviews (SRs). However, little assessment on the rigor of SRs related to osteoarthritis interventions has been conducted. This cross-sectional study aimed to evaluate the methodological quality and predictors among SRs on osteoarthritis interventions.MethodsFour electronic databases (Cochrane Database of Systematic Reviews, MEDLINE, Embase, and PsycINFO) were searched, from 1 January 2008 to 10 October 2019. An SR was eligible if it focused on osteoarthritis interventions, and we performed at least one meta-analysis. Methodological quality was assessed using the validated AMSTAR 2 instrument. Multivariate regression analyses were conducted to assess predictors of methodological quality.ResultsIn total, 167 SRs were included. The most SRs were non-Cochrane reviews (88.6%), and 54.5% investigated non-pharmacological interventions. Only seven (4.2%) had high methodological quality. Respectively, eight (4.8%), 25 (15.0%), and 127 (76.0%) SRs had moderate, low, and critically low quality. Main methodological weaknesses were as follows: only 16.8% registered protocol a priori, 4.2% searched literature comprehensively, 25.7% included lists of excluded studies with justifications, and 30.5% assessed risk of bias appropriately by considering allocation concealment, blinding of patients and assessors, random sequence generation and selective reported outcomes. Cochrane reviews [adjusted odds ratio (AOR) 251.5, 95% confidence interval (CI) 35.5-1782.6], being updates of previous SRs (AOR 3.9, 95% CI 1.1-13.7), and SRs published after 2017 (AOR 7.7, 95% CI 2.8-21.5) were positively related to higher methodological quality.ConclusionDespite signs of improvement in recent years, most of the SRs on osteoarthritis interventions have critically low methodological quality, especially among non-Cochrane reviews. Future SRs should be improved by conducting comprehensive literature search, justifying excluded studies, publishing a protocol, and assessing the risk of bias of included studies appropriately.
| S-EPMC7518002 | biostudies-literature
Project description:AimsThe aim of this review was to evaluate the reporting and methodological quality of systematic reviews and meta-analyses (SRs/MAs) on nursing interventions in patients with chronic obstructive pulmonary disease (COPD) and to determine potential factors that predict high quality.DesignThe review is a quantitative systematic review.Data sourcesPubMed, Embase and the Cochrane Database of Systematic Reviews.Review methodsA comprehensive literature search was conducted in three databases for SRs/MAs published up to 6 May 2020. The PRISMA statement and AMSTAR checklist were used to evaluate the reporting and methodological quality.ResultsA total of 130 articles published between 1996-2020 from 69 journals were included in this review. Multivariate regression analyses demonstrated that the following factors were related to the higher reporting quality of included articles: having a protocol or registration and being published on the Cochrane Database of Systematic Reviews. Systematic reviews including meta-analyses, number of authors >5, number of pages and having protocol or registration were related to higher methodological quality. A strong linear correlation (r = 0.860) was detected between the scores of PRISMA and AMSTAR.ConclusionA significant number of systematic reviews and meta-analyses on nursing interventions in patients with COPD show suboptimal reporting and poor methodology quality. The use of PRISMA and AMSTAR guidelines in conducting, reading, reviewing and editing systematic reviews and meta-analyses is recommended to improve the quality of systematic reviews and meta-analyses.ImpactThe findings of this review can provide references for health workers and health policy makers to evaluate and apply evidence-based knowledge. Additionally, such high-quality systematic reviews/meta-analyses can guide medical and health practice.
| S-EPMC8046131 | biostudies-literature
Project description:OBJECTIVES:There is an increasing prevalence of hypothyroidism and there is a growing body of meta-analyses (MAs) on the association between hypothyroidism and other diseases. However, the methodological quality of the MAs significantly varies. Thus, this study aimed to evaluate and summarise data on the methodological quality of MAs on the associations between hypothyroidism and other diseases using the Assessment of Multiple Systematic Reviews (AMSTAR) scale, providing suggestions for clinical decision-making processes. DESIGN:To assess the methodological quality of MAs using the AMSTAR scale. DATA SOURCES:A systematic literature search was performed in PubMed, EMBASE, the Cochrane Library, web of science and Chinese Biomedicine Literature Database. ELIGIBILITY CRITERIA:We included MAs that had assessed the association between hypothyroidism and other diseases in humans and that had full texts regardless of the publication status. No restriction applied on language or date. DATA EXTRACTION AND SYNTHESIS:Two reviewers independently screened the titles and abstracts of all searched literature to acquire potentially eligible publications. The full texts of possible eligible publications were downloaded and assessed. Inconsistent comments were resolved through discussions with a third reviewer. RESULTS:52 studies were included. The average AMSTAR score of the included articles was 8.6 (range: 5-10), and those of English and Chinese MAs were 8.8 and 7.0, respectively. A total of 52 MAs were evaluated, and 19 (36.5%) and 33 (63.5%) of these MAs were of moderate and high quality, respectively. None of the MAs were of low quality. Only two MAs had an a priori design. Items 3, 5 and 9 had the highest compliance (50/52, 96.2%), and aside from item 1, items 7 and 8 had the lowest compliance (33/52,63.5%). According to the results of these MAs, hypothyroidism was significantly associated with cardiovascular diseases, metabolic diseases, neuropsychiatric disorders, breast cancer and pregnancy outcome. CONCLUSIONS:The methodological quality of the included MAs on the association between hypothyroidism and other diseases was moderate to high. MAs with high qualities confirmed that hypothyroidism was significantly associated with cardiovascular diseases, metabolic syndrome, preterm birth and neonatal outcomes. Consideration of scientific quality when formulating conclusions should be made explicit and more attention should be paid to improving the methodological quality of MAs, and increasing their applicability for clinical decision-making.
| S-EPMC6475183 | biostudies-literature
Project description:Reaction time testing is widely used in online computerized concussion assessments, and most concussion studies utilizing the metric have demonstrated varying degrees of difference between concussed and non-concussed individuals. The problem with most of these online concussion assessments is that they predominantly rely on consumer grade technology. Typical administration of these reaction time tests involves presenting a visual stimulus on a computer monitor and prompting the test subject to respond as quickly as possible via keypad or computer mouse. However, inherent delays and variabilities are introduced to the reaction time measure by both computer and associated operating systems that the concussion assessment tool is installed on. The authors hypothesized systems that are typically used to collect concussion reaction time data would demonstrate significant errors in reaction time measurements. To remove human bias, a series of experiments was conducted robotically to assess timing errors introduced by reaction time tests under four different conditions. In the first condition, a visual reaction time test was conducted by flashing a visual stimulus on a computer monitor. Detection was via photodiode and mechanical response was delivered via computer mouse. The second condition employed a mobile device for the visual stimulus, and the mechanical response was delivered to the mobile device's touchscreen. The third condition simulated a tactile reaction time test, and mechanical response was delivered via computer mouse. The fourth condition also simulated a tactile reaction time test, but response was delivered to a dedicated device designed to store the interval between stimulus delivery and response, thus bypassing any problems hypothesized to be introduced by computer and/or computer software. There were significant differences in the range of responses recorded from the four different conditions with the reaction time collected from visual stimulus on a mobile device being the worst and the device with dedicated hardware designed for the task being the best. The results suggest that some of the commonly used visual tasks on consumer grade computers could be (and have been) introducing significant errors for reaction time testing and that dedicated hardware designed for the reaction time task is needed to minimize testing errors.
| S-EPMC7559397 | biostudies-literature
Project description:BackgroundThe health care quality improvement movement is a complex enterprise. Implementing clinical quality initiatives requires attitude and behaviour change on the part of clinicians, but this has proven to be difficult. In an attempt to solve this kind of behavioural challenge, the theoretical domains framework (TDF) has been developed. The TDF consists of 14 domains from psychological and organisational theory said to influence behaviour change. No systematic research has been conducted into the ways in which clinical quality initiatives map on to the domains of the framework. We therefore conducted a qualitative mapping experiment to determine to what extent, and in what ways, the TDF is relevant to the implementation of clinical quality interventions.MethodsWe conducted a thematic synthesis of the qualitative literature exploring clinicians' perceptions of various clinical quality interventions. We analysed and synthesised 50 studies in total, in five domains of clinical quality interventions: clinical quality interventions in general, structural interventions, audit-type interventions, interventions aimed at making practice more evidence-based, and risk management interventions. Data were analysed thematically, followed by synthesis of these themes into categories and concepts, which were then mapped to the domains of the TDF.ResultsOur results suggest that the TDF is highly relevant to the implementation of clinical quality interventions. It can be used to map most, if not all, of the attitudinal and behavioural barriers and facilitators of uptake of clinical quality interventions. Each of these 14 domains appeared to be relevant to many different types of clinical quality interventions. One possible additional domain might relate to perceived trustworthiness of those instituting clinical quality interventions.ConclusionsThe TDF can be usefully applied to a wide range of clinical quality interventions. Because all 14 of the domains emerged as relevant, and we did not identify any obvious differences between different kinds of clinical quality interventions, our findings support an initially broad approach to identifying barriers and facilitators, followed by a "drilling down" to what is most contextually salient. In future, it may be possible to establish a model of clinical quality policy implementation using the TDF.
| S-EPMC3901331 | biostudies-literature
Project description:OBJECTIVES:Meta-analyses (MAs) are often used because they are lauded to provide robust evidence that synthesises information from multiple studies. However, the validity of MA conclusions relies on the procedural rigour applied by the authors. Therefore, this meta-research study aims to characterise the methodological quality and meta-analytic practices of MAs indexed in PsycINFO. DESIGN:A meta-epidemiological study. PARTICIPANTS:We evaluated a random sample of 206 MAs indexed in the PsycINFO database in 2016. PRIMARY AND SECONDARY OUTCOMES:Two authors independently extracted the methodological characteristics of all MAs and checked their quality according to the 16 items of the A MeaSurement Tool to Assess systematic Reviews (AMSTAR2) tool for MA critical appraisal. Moreover, we investigated the effect of mentioning Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) on the methodological quality of MAs. RESULTS:According to AMSTAR2 criteria, 95% of the 206 MAs were rated as critically low quality. Statistical methods were appropriate and publication bias was well evaluated in 87% and 70% of the MAs, respectively. However, much improvement is needed in data collection and analysis: only 11% of MAs published a research protocol, 44% had a comprehensive literature search strategy, 37% assessed and 29% interpreted the risk of bias in the individual included studies, and 11% presented a list of excluded studies. Interestingly, the explicit mentioning of PRISMA suggested a positive influence on the methodological quality of MAs. CONCLUSION:The methodological quality of MAs in our sample was critically low according to the AMSTAR2 criteria. Some efforts to tremendously improve the methodological quality of MAs could increase their robustness and reliability.
| S-EPMC7402002 | biostudies-literature