A methodological study on the combination of qualitative and quantitative methods in cognitive interviewing for cross-cultural adaptation.
Ontology highlight
ABSTRACT: Aim
The aim of this study is to explore the use of the Questionnaire Appraisal System with a combination of qualitative and quantitative methods in cognitive interviewing for cross-cultural adaptation.Design
This is a descriptive methodological study.Methods
Using the Mandarin version of the Post-Stroke Checklist as an example, cognitive interviews were conducted with 27 stroke survivors in Guangzhou between November 2020 and February 2021. The Questionnaire Appraisal System was applied as a codebook in focus group discussions to perform quantitative data collections and quantitative content analysis.Results
Thirty-eight problems were proposed in focus group discussions and identified all but four of the 30 questions that emerged in the cognitive interviews. A new item was added to the Questionnaire Appraisal System for better categorization. Four categories and six subcategories of problems in the checklist were revealed.
SUBMITTER: Jia M
PROVIDER: S-EPMC8685835 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles.All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals.All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component.Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (?(2) (1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (?(2) (1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively).Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports.
| S-EPMC3419885 | biostudies-literature
Project description:OBJECTIVES:Our research determined whether the Addenbrooke's Cognitive Examination Version III (ACE-III) Urdu eliminated cultural bias through a qualitative assessment of its understanding and acceptability within the British Urdu-speaking population, employing cognitive interviews. METHOD:We aimed to recruit 25 participants fluent in speaking and writing Urdu, over the age of 60 years, able to give informed consent and who did not have a history of cognitive impairment. Participants were administered the ACE-III Urdu, and cognitive interviews were conducted, which involve obtaining verbal data on the individual's perception of the assessment overall, their understanding of the mental processes behind how they interpreted questions within the assessment and how they produced appropriate responses. This allows us to gauge the participants' overall thoughts on the Urdu ACE-III before applying question-formatted prompts to every ACE-III Urdu item. RESULTS:We recruited 25 participants, 12 women (48%), ranging from ages 60 years to 85 years (M=69.12, SD=6.57), all from Greater Manchester. Participants came from varied socioeconomic backgrounds, with 22 identifying as Pakistani, one as British Pakistani and two as East African. Across 19 ACE-III Urdu items, 7 required changes based on participant feedback: item 5a: fluency; items 6, 18 and 19: memory; items 12 and 13: language; and item 17: visuospatial abilities.The need for some of these changes was realised after 21 participants, due to persistently reoccurring issues, and these were applied before the last four participants. Overall, the ACE-III Urdu was considered easy and straightforward by all 25 participants, who understood items and felt the ACE-III Urdu was appropriate, not just for them, but for British Urdu speakers in general. CONCLUSION:Our cognitive interviews determined the ACE-III Urdu was acceptable, especially with regards to cultural context, but further changes were made to ensure understanding. Therefore, we adapted the ACE-III Urdu in accordance with feedback, resulting in our finalised version being culturally validated.
| S-EPMC6303692 | biostudies-literature
Project description:When patient-reported measures are translated and cross-culturally adapted into any language, the process should conclude with cognitive interviewing during pretesting. This article reports on translation and cross-cultural adaptation of the Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire into Afrikaans (for the Western Cape). This qualitative component of a clinical measurement, longitudinal study was aimed at the pretesting and cognitive interviewing of the prefinal Afrikaans (for the Western Cape) DASH questionnaire highlighting the iterative nature thereof. Twenty-two females and eight males with upper limb conditions were recruited to participate at public health care facilities in the Western Cape of South Africa. Cognitive interviews were conducted as a reparative approach with an iterative process through retrospective verbal probing during a debriefing session with 30 participants once they answered all 30 items of the translated DASH questionnaire. The sample included Afrikaans-speaking persons from low socioeconomic backgrounds, with low levels of education and employment (24 of 30 were unemployed). Pragmatic factors and measurement issues were addressed during the interviews. This study provides confirmation that both pragmatic factors and measurement issues need consideration in an iterative process as part of a reparative methodology towards improving patient-reported measures and ensuring strong content validity.
| S-EPMC7576342 | biostudies-literature
Project description:The intensifying pace of research based on cross-cultural studies in the social sciences necessitates a discussion of the unique challenges of multi-sited research. Given an increasing demand for social scientists to expand their data collection beyond WEIRD (Western, educated, industrialized, rich and democratic) populations, there is an urgent need for transdisciplinary conversations on the logistical, scientific and ethical considerations inherent to this type of scholarship. As a group of social scientists engaged in cross-cultural research in psychology and anthropology, we hope to guide prospective cross-cultural researchers through some of the complex scientific and ethical challenges involved in such work: (a) study site selection, (b) community involvement and (c) culturally appropriate research methods. We aim to shed light on some of the difficult ethical quandaries of this type of research. Our recommendation emphasizes a community-centred approach, in which the desires of the community regarding research approach and methodology, community involvement, results communication and distribution, and data sharing are held in the highest regard by the researchers. We argue that such considerations are central to scientific rigour and the foundation of the study of human behaviour.
| S-EPMC7542829 | biostudies-literature
Project description:BackgroundThe Exercise Adherence Rating Scale (EARS) is a commonly used outcome tool, which helps to identify the adherence rate of exercises and reasons for adherence and non-adherence. There is no evidence of the availability of any measurement tools to assess exercise adherence in the Nepalese context and cultural background. Therefore, we conducted a cross-cultural adaptation of the EARS into the Nepali language and investigated its reliability and validity.MethodsCross-cultural adaptation of the EARS was done based on Beaton guidelines. Psychometric properties were evaluated among 18 participants aged 18 years or older with pre-diabetes or confirmed diagnosis of any disease who were prescribed with home exercises by physiotherapists. Any disease that limited participants from doing exercise and individuals unwilling to participate were excluded. Reliability was evaluated through internal consistency, using Cronbach's alpha. Exploratory Factor Analysis (EFA) was performed to explore construct validity and confirm its unidimensionality. Receiver Operating Characteristic (ROC) curve was analyzed to identify cut-off score, sensitivity and specificity of the tool.ResultsThe Cronbach's alpha was 0.94 for EARS-adherence behavior. The EFA of 6-items adherence behavior revealed the presence of one factor with an eigenvalue exceeding one. The scree-plot suggested for extraction of only one factor with strong loading (75.84%). The Area Under the Curve was 0.91 with 95% confidence interval 0.77-1.00 at p = 0.004. The cutoff score was found 17.5 with 89% sensitivity and 78% specificity.ConclusionsThe EARS was cross-culturally adapted to the Nepali language. The reliability and construct validity of the Nepali version of the EARS were acceptable to assess exercise adherence in Nepali-speaking individuals. This validated tool might facilitate the evaluation of exercise-related interventions. Future studies could investigate other psychometric properties of the Nepali EARS.
| S-EPMC7538843 | biostudies-literature
Project description:The article examines the cross-cultural transferability of a widely accepted cross-cultural assessment tool - the Cultural Intelligence Scale (CQS) - using research conducted in Slovenia and insights from the American and Slovenian researchers who translated the tool into Slovene and adapted it for use in Slovenia. In the context of a qualitative focus group based study, the researchers look at the specific characteristics of CQS perceptions within the Slovenian sample (two focus groups - one in the capital and the other in the south of the country) and identify barriers to these perceptions and the specific characteristics of the perceptions of Slovenian citizens regarding cross-cultural interaction.
| S-EPMC6016030 | biostudies-other
Project description:Background and objective: Dysfunctional voiding (DV) presents relatively frequent problem in pediatric urologist practice. The necessity for implementation of DV evaluation in the pediatric population is of particular importance, since there is no clear consensus on the clinical assessment of such condition. The aims of our study were to evaluate the test/retest reliability and reproducibility of dysfunctional voiding and incontinence scoring system: Serbian version (DVISSSR) in patients with voiding and incontinence dysfunctions without structural deformities, and to estimate cut-off value for DVISSSR. Methods: The cross-sectional study included 57 children with voiding and incontinence dysfunctions and 30 healthy pediatric controls. For the evaluation of voiding and incontinence dysfunction we used DVISS. The forward-backward method was applied for translation of the DVISS questionnaire from English into Serbian language. Reproducibility was analyzed by Interclass Correlation Coefficient (ICC). Sensitivity and specificity of DVISSSR scores was done by receiver operating curve (ROC) curve. Results: There was a significant difference in DVISSSR score between patients and controls (p < 0.001). For reliability and reproducibility of the questionnaire, there was no significant difference between repeated measurements (p = 0.141), and strong reliability (ICC = 0.957; p < 0.001). Conclusion: We have demonstrated successful translation and validation of the DVISSSR score. Moreover, a reliable scoring system of children with voiding dysfunctions should include evaluations of symptom scoring systems at the multicentric level.
| S-EPMC6524058 | biostudies-literature
Project description:Introduction. Chronic rhinosinusitis is a highly prevalent disease, so it is necessary to create valid instruments to assess the quality of life of these patients. The SNOT-20 questionnaire was developed for this purpose as a specific test to evaluate the quality of life related to chronic rhinosinusitis. It was validated in the English language, and it has been used in most studies on this subject. Currently, there is no validated instrument for assessing this disease in Portuguese. Objective. Cross-cultural adaptation and validation of SNOT-20 in Portuguese. Patients and Methods. The SNOT-20 questionnaire underwent a meticulous process of cross-cultural adaptation and was evaluated by assessing its sensitivity, reliability, and validity. Results. The process resulted in an intelligible version of the questionnaire, the SNOT-20p. Internal consistency (Cronbach's alpha = 0.91, P < .001), reliability testing-retesting (r = 0.994, P < .001), content validity, validity of discrimination of patients without chronic rhinosinusitis (U = 44, P < .0001) and assessment of sensitivity to change (SRM = 1.53 and 1.09) were evaluated. Conclusion. We conducted a successful process of cross-cultural adaptation and validation of the SNOT-20 questionnaire into Portuguese.
| S-EPMC3142655 | biostudies-literature
Project description:BACKGROUND: Oral health-related quality of life (OHRQoL) measures are being increasingly used to introduce dimensions excluded by normative measures. Consequently, there is a need for an index which evaluates children's OHRQoL validated for Brazilian population, useful for oral health needs assessments and for the evaluation of oral health programs, services and technologies. The aim of this study was to do a cross-cultural adaptation of the Child Oral Impacts on Daily Performances (Child-OIDP) index, and assess its reliability and validity for application among Brazilian children between the ages of eleven and fourteen. METHODS: For cross-cultural adaptation, a translation/back-translation method integrated with expert panel reviews was applied. A total of 342 students from four public schools took part of the study. RESULTS: Overall, 80.7% of the sample reported at least one oral impact in the last three months. Cronbach's alpha was 0.63, the weighted kappa 0.76, and the intraclass correlation coefficient (ICC) 0.79. The index had a significant association with self-reported health measurements (self-rated oral health, satisfaction with oral health, perceived dental treatment needs, self-rated general health; all p < 0.01). CONCLUSION: It was concluded that the Child-OIDP index is a measure of oral health-related quality of life that can be applied to Brazilian children.
| S-EPMC2553067 | biostudies-literature
Project description:ObjectiveNational and international medical organizations and boards have recognized the importance of Evidence Based Medicine (EBM) and emphasized that EBM training should be included in medical education programs. Although some Turkish medical schools have developed and implemented EBM training programs, no validated Turkish language assessment tool has been available to compare the effectiveness of these training programs to national or international standards. The aim of this study is to cross-culturally adapt the Fresno Test, which is a validated English language tool utilized worldwide in the assessment of EBM training.MethodsThis study is a cross-sectional validation study, which was performed in two stages: Cross-cultural adaptation of the Fresno Test into Turkish; and evaluation of the psychometric properties, validity, reliability and responsiveness, of the Turkish version of the Fresno Test.ResultsThe content validity of the test was evaluated by experienced physicians in the field of Evidence-Based Medicine, and the content validity index was 1.00. The Cronbach α coefficient was 0.78 on the post-test results. The intraclass correlation (ICC) coefficient and the kappa analysis were calculated to evaluate inter-rater reliability. The ICC coefficients ranged from 0.66 to 0.97 for pre- and post-test results. The Kappa coefficients were 1.00 for all pre-test and post-test questions except one post-test question which was 0.89. The change score of the Fresno Test was used to evaluate responsiveness. The students' score of the Turkish Fresno Test was 49.9 ±18.2 pre-training and 118.9 ±26.3 post-training with a change of 69 points (95% CI, 63.9-74.2). The Cohen's effect size was 3.04 (95% CI, 2.6-3.5) indicating a very large change in scores.ConclusionsThe Turkish adapted Fresno Test used to evaluate students' success and program effectiveness is a valid and reliable measurement tool. It will be of great benefit for the comparison of the effectiveness of Turkish education programs nationally and cross-culturally.
| S-EPMC7793267 | biostudies-literature