Dataset Information

German language questionnaires for assessing implementation constructs and outcomes of psychosocial and health-related interventions: a systematic review.

ABSTRACT: BACKGROUND:Over the past years, implementation science has gained more and more importance in German-speaking countries. Reliable and valid questionnaires are needed for evaluating the implementation of evidence-based practices. On an international level, several initiatives focused on the identification of questionnaires used in English-speaking countries but limited their search processes to mental health and public health settings. Our aim was to identify questionnaires used in German-speaking countries measuring the implementation of interventions in public health and health care settings in general and to assess their psychometric properties. METHODS:We searched five different bibliographic databases (from 1985 to August 2017) and used several other search strategies (e.g., reference lists, forward citation) to obtain our data. We assessed the instruments, which were identified in an independent dual review process, using 12 psychometric rating criteria. Finally, we mapped the instruments' scales and subscales in regard to the constructs of the Consolidated Framework for Implementation Research (CFIR) and the Implementation Outcome Framework (IOF). RESULTS:We identified 31 unique instruments available for the assessment of implementation science constructs. Hospitals and other health care settings were the ones most often investigated (23 instruments), while education and childcare settings, workplace settings, and community settings lacked published instruments. Internal consistency, face and content validity, usability, and structural validity were the aspects most often described. However, most studies did not report on test-retest reliability, known-groups validity, predictive criterion validity, or responsiveness. Overall, the majority of studies did not reveal high-quality instruments, especially regarding the psychometric criteria internal consistency, structural validity, and criterion validity. In addition, we seldom detected instruments operationalizing the CFIR domains intervention characteristics, outer setting, and process, and the IOF constructs adoption, fidelity, penetration, and sustainability. CONCLUSIONS:Overall, a sustained and continuous effort is needed to improve the reliability and validity of existing instruments to new ones. Instruments applicable to the assessment of implementation constructs in public health and community settings are urgently needed. TRIAL REGISTRATION:The systematic review protocol was registered in PROSPERO on October 19, 2017, under the following number: CRD42017075208 .

SUBMITTER: Kien C

PROVIDER: S-EPMC6292038 | biostudies-literature | 2018 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

German language questionnaires for assessing implementation constructs and outcomes of psychosocial and health-related interventions: a systematic review.

Kien Christina C Schultes Marie-Therese MT Szelag Monika M Schoberberger Rudolf R Gartlehner Gerald G

Implementation science : IS 20181212 1

<h4>Background</h4>Over the past years, implementation science has gained more and more importance in German-speaking countries. Reliable and valid questionnaires are needed for evaluating the implementation of evidence-based practices. On an international level, several initiatives focused on the identification of questionnaires used in English-speaking countries but limited their search processes to mental health and public health settings. Our aim was to identify questionnaires used in German ...[more]

PMID: 30541590

Similar Datasets

Project description:BackgroundPeople often prefer evidence-based psychosocial interventions (EBPIs) for mental health care; however, these interventions frequently remain unavailable to people in nonspecialty or integrated settings, such as primary care and schools. Previous research has suggested that usability, a concept from human-centered design, could support an understanding of the barriers to and facilitators of the successful adoption of EBPIs and support the redesign of EBPIs and implementation strategies.ObjectiveThis study aimed to identify and categorize usability issues in EBPIs and their implementation strategies.MethodsWe adapted a usability issue analysis and reporting format from a human-centered design. A total of 13 projects supported by the National Institute of Mental Health-funded Accelerating the Reach and Impact of Treatments for Youth and Adults with Mental Illness Center at the University of Washington used this format to describe usability issues for EBPIs and implementation strategies with which they were working. Center researchers used iterative affinity diagramming and coding processes to identify usability issue categories. On the basis of these categories and the underlying issues, we propose heuristics for the design or redesign of EBPIs and implementation strategies.ResultsThe 13 projects reported a total of 90 usability issues, which we categorized into 12 categories, including complex and/or cognitively overwhelming, required time exceeding available time, incompatibility with interventionist preference or practice, incompatibility with existing workflow, insufficient customization to clients/recipients, intervention buy-in (value), interventionist buy-in (trust), overreliance on technology, requires unavailable infrastructure, inadequate scaffolding for client/recipient, inadequate training and scaffolding for interventionists, and lack of support for necessary communication. These issues range from minor inconveniences that affect a few interventionists or recipients to severe issues that prevent all interventionists or recipients in a setting from completing part or all of the intervention. We propose 12 corresponding heuristics to guide EBPIs and implementation strategy designers in preventing and addressing these usability issues.ConclusionsUsability issues were prevalent in the studied EBPIs and implementation strategies. We recommend using the lens of usability evaluation to understand and address barriers to the effective use and reach of EBPIs and implementation strategies.International registered report identifier (irrid)RR2-10.2196/14990.

Project description:BackgroundImproving patient safety has become a major focus of clinical care and research over the past two decades. An institution's patient safety climate represents an essential component of ensuring a safe environment and thereby can be vital to the prevention of adverse events. Covering six patient safety related factors, the Safety Attitudes Questionnaire (SAQ) is a validated and widely used instrument to measure the patient safety climate in clinical areas. The objective of this study was to assess the psychometric properties of the German language version of the SAQ.MethodsA survey was carried out in two University Hospitals in Switzerland in autumn 2009 where the SAQ was distributed to a sample of 406 nurses and physicians in medical and surgical wards. Following the American Educational Research Association guidelines, we tested the questionnaire validity by levels of evidence: content validity, internal structure and relations to other variables. Confirmatory factor analysis was used to examine factor structure. Cronbach's alphas and inter-item correlations were calculated to examine internal consistency reliability.ResultsA total of 319 questionnaires were completed representing an overall response rate of 78.6%. For three items, the item content validity index was <0.75. Confirmatory factor analysis showed acceptable model fit (RMSEA = 0.045; CFI = 0.944) for the six-factor model. Additional exploratory factor analysis could not identify a better factor model. SAQ factor scores showed positive correlations with the Safety Organizing Scale (r = .56-.72). The SAQ German version showed moderate to strong internal consistency reliability indices (Cronbach alpha = .65-.83).ConclusionsThe German language version of the SAQ demonstrated acceptable to good psychometric properties and therefore shows promise to be a sound instrument to measure patient safety climate in Swiss hospital wards. However, the low item content validity and large number of missing responses for several items suggest that improvements and adaptations in translation are required for select items, especially within the perception of management scale. Following these revisions, psychometric properties should reassessed in a randomly selected sample and hospitals and departments prior to use in Swiss hospital settings.

Project description:BackgroundYoung people who fail to develop language as expected face significant challenges in all aspects of life. Unfortunately, language disorders are common, either as a distinct condition (e.g., Developmental Language Disorder) or as a part of another neurodevelopmental condition (e.g., autism). Finding ways to attenuate language problems through intervention has the potential to yield great benefits not only for the individual but also for society as a whole.ObjectivesThis meta-analytic review examined the effect of oral language interventions for children with neurodevelopmental disorders.Search methodsThe last electronic search was conducted in April 2022.Selection criteriaIntervention studies had to target language skills for children from 2 to 18 years of age with Developmental Language Disorder, autism, intellectual disability, Down syndrome, Fragile X syndrome, and Williams syndrome in randomised controlled trials or quasi-experimental designs. Control groups had to include business-as-usual, waiting list, passive or active conditions. However, we excluded studies in which the active control group received a different type, delivery, or dosage of another language intervention. Eligible interventions implemented explicit and structured activities (i.e., explicit instruction of vocabulary, narrative structure or grammatical rules) and/or implicit and broad activities (i.e., shared book reading, general language stimulation). The intervention studies had to assess language skills in receptive and/or expressive modalities.Data collection and analysisThe search provided 8195 records after deduplication. Records were screened by title and abstract, leading to full-text examinations of 448 records. We performed Correlated and Hierarchical Effects models and ran a retrospective power analysis via simulation. Publication bias was assessed via p-curve and precision-effect estimate.Main resultsWe examined 38 studies, with 46 group comparisons and 108 effects comparing pre-/post-tests and eight studies, with 12 group comparisons and 21 effects at follow-up. The results showed a mean effect size of d = 0.27 at the post-test and d = 0.18 at follow-up. However, there was evidence of publication bias and overestimation of the mean effects. Effects from the meta-analysis were significantly related to these elements: (1) receptive vocabulary and omnibus receptive measures showed smaller effect sizes relative to expressive vocabulary, grammar, expressive and receptive discourse, and omnibus expressive tests; and (2) the length of the intervention, where longer sessions conducted over a longer period of time were more beneficial than brief sessions and short-term interventions. Neither moderators concerning participants' characteristics (children's diagnosis, diagnostic status, age, sex, and non-verbal cognitive ability and severity of language impairment), nor those regarding of the treatment components and implementation of the language interventions (intervention content, setting, delivery agent, session structure of the intervention or total number of sessions) reached significance. The same occurred to indicators of study quality. The risk of bias assessment showed that reporting quality for the studies examined in the review was poor.Authors’ conclusionsIn sum, the current evidence base is promising but inconclusive. Pre-registration and replication of more robust and adequately powered trials, which include a wider range of diagnostic conditions, together with more long-term follow-up comparisons, are needed to drive evidence-based practice and policy.

Project description:BackgroundMore than 135 million people worldwide live with acquired brain injury (ABI) and its many psychosocial sequelae. This growing global burden necessitates scalable rehabilitation services. Despite demonstrated potential to increase the accessibility and scalability of psychosocial supports, digital health interventions are challenging to implement and sustain. The Nonadoption, Abandonment, Scale-Up, Spread, and Sustainability (NASSS) framework can offer developers and researchers a comprehensive overview of considerations to implement, scale, and sustain digital health interventions.ObjectiveThis systematic review identified published, peer-reviewed primary evidence of implementation outcomes, strategies, and factors for web-based psychosocial interventions targeting either adults with ABI or their formal or informal caregivers; evaluated and summarized this evidence; synthesized qualitative and quantitative implementation data according to the NASSS framework; and provided recommendations for future implementation. Results were compared with 3 hypotheses which state that complexity (dynamic, unpredictable, and poorly characterized factors) in most or all NASSS domains increases likelihood of implementation failure; success is achievable, but difficult with many complicated domains (containing multiple interacting factors); and simplicity (straightforward, predictable, and few factors) in most or all domains increases the likelihood of success.MethodsFrom a comprehensive search of MEDLINE, EMBASE, PsycINFO, CINAHL, Scopus, speechBITE, and neuroBITE, we reviewed primary implementation evidence from January 2008 to June 2020. For web-based psychosocial interventions delivered via standard desktop computer, mobile phone, tablet, television, and virtual reality devices to adults with ABI or their formal or informal caregivers, we extracted intervention characteristics, stakeholder involvement, implementation scope and outcomes, study design and quality, and implementation data. Implementation data were both narratively synthesized and descriptively quantified across all 7 domains (condition, technology, value proposition, adopters, organization, wider system, and their interaction over time) and all subdomains of the NASSS framework. Study quality and risk of bias were assessed using the 2018 Mixed Methods Appraisal Tool.ResultsWe identified 60 peer-reviewed studies from 12 countries, including 5723 adults with ABI, 1920 carers, and 50 health care staff. The findings aligned with all 3 hypotheses.ConclusionsAlthough studies were of low methodological quality and insufficient number to statistically test relationships, the results appeared consistent with recommendations to reduce complexity as much as possible to facilitate implementation. Although studies excluded individuals with a range of comorbidities and sociocultural challenges, such simplification of NASSS domain 1 may have been necessary to advance intervention value propositions (domain 3). However, to create equitable digital health solutions that can be successfully implemented in real-world settings, it is recommended that developers involve people with ABI, their close others, and health care staff in addressing complexities in domains 2 to 7 from the earliest intervention design stages.Trial registrationPROSPERO International Prospective Register of Systematic Reviews CRD42020186387; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020186387.International registered report identifier (irrid)RR2-10.1177/20552076211035988.

Project description:BackgroundMeasuring work-related stress in a reliable way is important in the development of appropriate prevention and intervention strategies. Especially in multilingual studies the use of comparable and reliable instruments is crucial. Therefore, the aim of this study was to translate selected scales and single items from the German version of the Copenhagen Psychosocial Questionnaire (COPSOQ) into French and Italian and psychometrically test them in a sample of health professionals.MethodsThis study used cross-sectional data from health professionals at 163 randomised selected health organisations in Switzerland. Selected COPSOQ items/scales were backwards- and forwards- translated and cross-culturally adapted from German to French and Italian. Reliability was assessed with Cronbach alpha and intraclass correlation coefficients, construct validity with confirmatory factor analysis (CFA) and structural equation modelling as well as comparative fit index.ResultsResponses from 12,754 health professionals were included in the analysis. Of the overall 24 scales, 20 in the German version, 19 in the French version and 17 in the Italian version attained sufficient internal consistency with a threshold of 0.7 for Cronbach's alpha. Predominantly high factor loadings on scale level are reported (> 0.35), as well as good and satisfactory fit values with RMSEA below 0.1, SRMR below 0.08 and CFI above 0.95. For 10 out of 15 scales, the test for factor invariance revealed a significant difference regarding the psychological constructs of the scales across the language versions.ConclusionsThe psychometric properties verify the underlying theoretical model of the COPSOQ questionnaire, which is to some extent comparable across the three language versions. Of the 10 scales with significant factor variance, four showed large differences, implying that revision is needed for better comparability. Potential cultural issues as well as regional differences may have led to the factor variance and the different reliability scores per scale across language versions. One known influencing factor for regional differences is culture, which should be considered in scale development. Moreover, emerging topics such as digitization should be considered in further development of the questionnaire.

Dataset Information

German language questionnaires for assessing implementation constructs and outcomes of psychosocial and health-related interventions: a systematic review.

Publications

German language questionnaires for assessing implementation constructs and outcomes of psychosocial and health-related interventions: a systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets