Dataset Information

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal.

ABSTRACT:

Background

The lack of culturally adapted and validated instruments for child mental health and psychosocial support in low and middle-income countries is a barrier to assessing prevalence of mental health problems, evaluating interventions, and determining program cost-effectiveness. Alternative procedures are needed to validate instruments in these settings.

Methods

Six criteria are proposed to evaluate cross-cultural validity of child mental health instruments: (i) purpose of instrument, (ii) construct measured, (iii) contents of construct, (iv) local idioms employed, (v) structure of response sets, and (vi) comparison with other measurable phenomena. These criteria are applied to transcultural translation and alternative validation for the Depression Self-Rating Scale (DSRS) and Child PTSD Symptom Scale (CPSS) in Nepal, which recently suffered a decade of war including conscription of child soldiers and widespread displacement of youth. Transcultural translation was conducted with Nepali mental health professionals and six focus groups with children (n=64) aged 11-15 years old. Because of the lack of child mental health professionals in Nepal, a psychosocial counselor performed an alternative validation procedure using psychosocial functioning as a criterion for intervention. The validation sample was 162 children (11-14 years old). The Kiddie-Schedule for Affective Disorders and Schizophrenia (K-SADS) and Global Assessment of Psychosocial Disability (GAPD) were used to derive indication for treatment as the external criterion.

Results

The instruments displayed moderate to good psychometric properties: DSRS (area under the curve (AUC)=0.82, sensitivity=0.71, specificity=0.81, cutoff score ? 14); CPSS (AUC=0.77, sensitivity=0.68, specificity=0.73, cutoff score ? 20). The DSRS items with significant discriminant validity were "having energy to complete daily activities" (DSRS.7), "feeling that life is not worth living" (DSRS.10), and "feeling lonely" (DSRS.15). The CPSS items with significant discriminant validity were nightmares (CPSS.2), flashbacks (CPSS.3), traumatic amnesia (CPSS.8), feelings of a foreshortened future (CPSS.12), and easily irritated at small matters (CPSS.14).

Conclusions

Transcultural translation and alternative validation feasibly can be performed in low clinical resource settings through task-shifting the validation process to trained mental health paraprofessionals using structured interviews. This process is helpful to evaluate cost-effectiveness of psychosocial interventions.

SUBMITTER: Kohrt BA

PROVIDER: S-EPMC3162495 | biostudies-literature | 2011 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal.

Kohrt Brandon A BA Jordans Mark J D MJ Tol Wietse A WA Luitel Nagendra P NP Maharjan Sujen M SM Upadhaya Nawaraj N

BMC psychiatry 20110804 1

<h4>Background</h4>The lack of culturally adapted and validated instruments for child mental health and psychosocial support in low and middle-income countries is a barrier to assessing prevalence of mental health problems, evaluating interventions, and determining program cost-effectiveness. Alternative procedures are needed to validate instruments in these settings.<h4>Methods</h4>Six criteria are proposed to evaluate cross-cultural validity of child mental health instruments: (i) purpose of i ...[more]

PMID: 21816045

Similar Datasets

Project description:BackgroundObtaining accurate and valid measurements of disruptive behavior disorders remains a challenge in non-Western settings due to variability in societal norms for child behavior and a lack of tools developed outside of Western contexts. This paper assesses the reliability and construct validity of the Disruptive Behavior International Scale - Nepal version (DBIS-N)-a scale developed using ethnographic research in Nepal-and compares it with a widely used Western-derived scale in assessing locally defined child behavior problems.MethodsWe assessed a population-based sample of 268 children ages 5-15 years old in Nepal for behavior problems with a pool of candidate items developed from ethnographic research. We selected final items for the DBIS-N using exploratory factor analysis in a randomly selected half of the sample and then evaluated the model fit using confirmatory factor analysis in the remaining half. We compared the classification accuracy and incremental validity of the DBIS-N and Eyberg Child Behavior Inventory (ECBI) using local defined behavior problems as criteria. Local criteria were assessed via parent report using: 1) local behavior problem terms, and 2) a locally developed vignette-based assessment.ResultsTen items were selected for the final scale. The DBIS-N had good internal consistency (Cronbach's α: 0.84) and excellent test-retest reliability (intraclass correlation 0.93, r = .93). Classification accuracy and area under the curve (AUC) were similar and high for both the ECBI (AUC: 0.83 and 0.85) and DBIS-N (AUC: 0.83 and 0.85) on both local criteria. The DBIS-N added predictive value above the ECBI in logistic regression models, supporting its incremental validity.ConclusionsWhile both the DBIS-N and the ECBI had high classification accuracy for local idioms for behavior problems, the DBIS-N had a more coherent factor structure and added predictive value above the ECBI. Items from the DBIS-N were more consistent with cultural themes identified in qualitative research, whereas multiple items in the ECBI that did not fit with these themes performed poorly in factor analysis. In conjunction with practical considerations such as price and scale length, our results lend support for the utility of the DBIS-N for the assessment of locally prioritized behavior problems in Nepal.

Project description:BackgroundAn automated web-based assessment and monitoring system ( www.psynary.com ) has been developed to assist non-specialist clinicians in managing common mood and anxiety disorders. Psynary promotes the use of standardised outcome measures to assess symptom severity and optimise treatments with the aim of improving outcomes and enabling faster recovery. This paper analyses the results from two parallel studies in New Zealand and Japan (OptiMA-1 NZ and Japan) to assess the validity of the R8 Depression scale, one of the system's core outcome measures.MethodsClinical samples were recruited from a public secondary care and a private psychiatry clinic. Participants completed the outcome measures for the study via the online Psynary system. The R8 Depression scale is a 30-item questionnaire which includes all symptom domains covered in the ICD-10 classification of depression. The Patient Health Questionnaire (PHQ-9) was completed at the same time points as the R8 Depression, with a smaller sample also completing a paper-based Quick Inventory of Depressive Symptomatology (QIDS-SR16). Internal validity was quantified via Cronbach's alpha and Guttman lower bounds method. External validation against the PHQ-9 and QIDS used the Pearson's and Kendall's correlation coefficients. Severity categories were set using a multivariate regression model.Results270 patients participated in the study and completed a maximum of 1 baseline and 5 reviews within a 90-day period, giving a total of 1124 assessments with the PHQ-9 also being completed in 1053 of these assessments. R8 Depression normative data was also collected from 204 non-clinical volunteers with 187 of these also completing the PHQ9. Internal reliability scores were all higher than 0.9 (n = 1328). There was overall good external validity when comparing the R8 Depression to the PHQ-9, with a correlation of 0.91 for the combined normative and clinical samples (n = 1240).ConclusionsThe R8 Depression has been developed as a patient-rated outcome measure for depression for administration on an online system called "Psynary". It has high internal and external validity against current widely used scales. Further work is underway to determine the sensitivity to change of the R8 Depression.

Project description:Pain intensity and patients' impression of global improvement are widely used patient-reported outcome measures (PROMs) in clinical practice and research. They are commonly assessed using the Numerical Pain Rating Scale (NPRS) and Global Rating of Change (GROC) questionnaires. The GROC is essential as an anchor for evaluating the psychometric properties of PROMs. Both of these PROMs are translated to many languages and have shown excellent psychometric properties. Their availability in Nepali would facilitate pain research and cross-cultural comparison of research findings. Therefore, the objectives of this study were to translate and cross-culturally adapt the NPRS and GROC into Nepali and to assess the psychometric properties of the Nepali version of the NPRS (NPRS-NP).After translating and cross-culturally adapting the NPRS and GROC into Nepali using recommended guidelines, NPRS-NP was administered to 104 individuals with musculoskeletal pain twice. The Nepali version of the GROC (GROC-NP) was administered at the follow-up for anchor-based assessment. (1) Test-retest reliability and minimum detectable change (MDC) among the stable group, (2) construct validity (by single sample t-test within the improved group and independent sample t-test between groups), and (3) concurrent validity were assessed. Receiver operating characteristic (ROC) curves were plotted to determine the responsiveness of the NPRS-NP using the area under the curve (AUC), and minimum important changes (MIC) for small, medium and large improvements.Significant cultural adaptations were required to obtain relevant Nepali versions of both the NPRS and GROC. The NPRS-NP showed excellent test-retest reliability and a MDC of 1.13 points. NPRS-NP demonstrated a good construct validity by significant within-group difference in mean of NPRS score- t(63)= 7.57, P?<?0.001 and statistically significant difference of mean score- t(98)= -4.24, P?<?.001 between the stable and improved groups. It demonstrated moderate concurrent correlation with the GROC-NP; r?=?0.43, P?<?0.01. Responsiveness of the NPRS-NP was shown at three levels with AUC?=?0.68-0.82, and MIC?=?1.17-1.33.The NPRS and GROC were successfully translated and culturally adapted into Nepali. The NPRS-NP demonstrated good reliability, validity and responsiveness in assessing musculoskeletal pain intensity in a Nepali population.

Project description:BackgroundMenopause Rating Scale (MRS) evaluates eleven menopausal symptoms and health related quality of life (HRQOL) of postmenopausal women under three subscales. In this study we attempted cross cultural adaptation and evaluation of psychometric properties of a Sinhala translation of MRS.MethodsSinhala version of MRS was adapted following standard methodology; forward and backward translations, review by an expert group, focus group discussion (FGD) and pre-testing. It was self-administered among randomly selected healthy, Sinhalese, community-dwelling 166 postmenopausal women (aged; median = 56.5, IQR, 53.0-59.0 years) along with the Short Form 36 (SF-36) survey questionnaire. MRS was re-administered among a subsample (n = 80) after two weeks of first administration. Psychometric properties; reliability and validity were evaluated.ResultsIn Sinhala version of MRS, both internal consistency (Cronbach's alpha coefficient = 0.79) and test retest reliability (intra class correlation / ICC = 0.86, 95%CI = 0.82-0.91, p < 0.001 and Pearson correlation / r = 0.93) were high. Factor analysis (FA) with Principal Component Analysis (PCA) extracted three factors explaining 59.82% cumulative variance with few exceptions from the original version. In the item-subscale correlation analysis items showed stronger correlations within their own subscale score (r range between 0.56-0.84) than with other subscales scores and subscales' scores showed strong correlations with the overall MRS score (r range between 0.70-0.86) indicating strong convergent validity. Mean (SD) symptom severities of each item were significantly different between symptomatic and asymptomatic women (p < 0.05) emphasizing good discriminant validity. The overall MRS and SF-36 scores correlated significantly (Pearson correlation: - 0.52, p < 0.01 and Kendall's tau-b: - 0.39, p < 0.01) ensuring strong criterion validity.ConclusionsThe Sinhala version of MRS we adapted is an informative tool with high reliability and validity and this tool can be used to evaluate the menopausal symptoms and HRQOL in postmenopausal women conversant in Sinhala.

Project description:ObjectiveIntradialytic nutrition has been shown to improve nutritional status in maintenance hemodialysis (HD) patients but remains controversial due in part to concerns over hemodynamic stability and gastrointestinal (GI) distress. There are limited data on the relationship between intradialytic nutrition and GI symptoms, possibly due to the lack of a validated tool. Therefore, we intended to validate a questionnaire to measure GI symptoms associated with a single HD treatment and determine the relationship between intradialytic nutrition and GI symptoms.DesignCross-sectional study. Forty-eight maintenance HD patients.Main outcome measureGI symptoms and dietary intake during HD treatment.ResultsIn general, we found acceptable internal consistency (Cronbach's alpha >0.5, exception reflux domain) and repeatability in all 5 domains of a modified version of the Gastrointestinal Symptom Rating Scale. The prevalence of GI symptoms associated with a single HD treatment (generalized score greater than 1) was 54.2, 43.7, 6.2, 41.7, and 45.8% for the abdominal pain, indigestion, reflux, diarrhea, and constipation domains, respectively. More than two-thirds of patients chose to eat during treatment (168.6 ± 165.6 kcal) with the most commonly consumed items being candy, oral supplements, and cookies. There was no difference in GI symptoms among patients who did or did not eat (P > .05). However, the amount of total dietary fat and fiber consumed during treatment was associated with greater indigestion (P < .05) prior to accounting for outliers or multiple comparisons.ConclusionIn this sample, the modified version of the Gastrointestinal Symptom Rating Scale was a generally valid tool for measuring GI symptoms associated with a single HD treatment. Patients who ate during treatment did not experience greater GI symptoms than those who did not; however, high amounts of fat and fiber may be associated with greater GI symptoms. Prospective trials should examine the relationship between GI symptoms and dietary intake during treatment in HD patients.

Project description:BackgroundThe Exercise Adherence Rating Scale (EARS) is a commonly used outcome tool, which helps to identify the adherence rate of exercises and reasons for adherence and non-adherence. There is no evidence of the availability of any measurement tools to assess exercise adherence in the Nepalese context and cultural background. Therefore, we conducted a cross-cultural adaptation of the EARS into the Nepali language and investigated its reliability and validity.MethodsCross-cultural adaptation of the EARS was done based on Beaton guidelines. Psychometric properties were evaluated among 18 participants aged 18 years or older with pre-diabetes or confirmed diagnosis of any disease who were prescribed with home exercises by physiotherapists. Any disease that limited participants from doing exercise and individuals unwilling to participate were excluded. Reliability was evaluated through internal consistency, using Cronbach's alpha. Exploratory Factor Analysis (EFA) was performed to explore construct validity and confirm its unidimensionality. Receiver Operating Characteristic (ROC) curve was analyzed to identify cut-off score, sensitivity and specificity of the tool.ResultsThe Cronbach's alpha was 0.94 for EARS-adherence behavior. The EFA of 6-items adherence behavior revealed the presence of one factor with an eigenvalue exceeding one. The scree-plot suggested for extraction of only one factor with strong loading (75.84%). The Area Under the Curve was 0.91 with 95% confidence interval 0.77-1.00 at p = 0.004. The cutoff score was found 17.5 with 89% sensitivity and 78% specificity.ConclusionsThe EARS was cross-culturally adapted to the Nepali language. The reliability and construct validity of the Nepali version of the EARS were acceptable to assess exercise adherence in Nepali-speaking individuals. This validated tool might facilitate the evaluation of exercise-related interventions. Future studies could investigate other psychometric properties of the Nepali EARS.

Dataset Information

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal.

Background

Methods

Results

Conclusions

Publications

Validation of cross-cultural child mental health and psychosocial research instruments: adapting the Depression Self-Rating Scale and Child PTSD Symptom Scale in Nepal.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets