Dataset Information

An instrument for evaluating clinical teaching in Japan: content validity and cultural sensitivity.

ABSTRACT:

Background

Many instruments for evaluating clinical teaching have been developed but almost all in Western countries. None of these instruments have been validated for the Asian culture, and a literature search yielded no instruments that were developed specifically for that culture. A key element that influences content validity in developing instruments for evaluating the quality of teaching is culture. The aim of this study was to develop a culture-specific instrument with strong content validity for evaluating clinical teaching in initial medical postgraduate training in Japan.

Methods

Based on data from a literature search and an earlier study we prepared a draft evaluation instrument. To ensure a good cultural fit of the instrument with the Asian context we conducted a modified Delphi procedure among three groups of stakeholders (five education experts, twelve clinical teachers and ten residents) to establish content validity, as this factor is particularly susceptible to cultural factors.

Results

Two rounds of Delphi were conducted. Through the procedure, 52 prospective items were reworded, combined or eliminated, resulting in a 25-item instrument validated for the Japanese setting.

Conclusions

This is the first study describing the development and content validation of an instrument for evaluating clinical teaching specifically tailored to an East Asian setting. The instrument has similarities and differences compared with instruments of Western origin. Our findings suggest that designers of evaluation instruments should consider the probability that the content validity of instruments for evaluating clinical teachers can be influenced by cultural aspects.

SUBMITTER: Kikukawa M

PROVIDER: S-EPMC4167259 | biostudies-literature | 2014 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An instrument for evaluating clinical teaching in Japan: content validity and cultural sensitivity.

Kikukawa Makoto M Stalmeijer Renee E RE Emura Sei S Roff Sue S Scherpbier Albert J J A AJ

BMC medical education 20140828

<h4>Background</h4>Many instruments for evaluating clinical teaching have been developed but almost all in Western countries. None of these instruments have been validated for the Asian culture, and a literature search yielded no instruments that were developed specifically for that culture. A key element that influences content validity in developing instruments for evaluating the quality of teaching is culture. The aim of this study was to develop a culture-specific instrument with strong cont ...[more]

PMID: 25164309

Similar Datasets

Project description:BackgroundTo provide better quality healthcare services to patients with different linguistic and cultural backgrounds, the cross-cultural competence of medical professionals is important. However, assessing and improving the cross-cultural competence of healthcare professionals is difficult in Japan, as there is no standardized scale to measure the competence. This study's purpose was to translate the Cross-Cultural Competence instrument for Healthcare Professionals (CCCHP), which was developed and used in Europe, and to examine its reliability and validity among Japanese nurses.MethodsDuring June and July 2021, nursing staff were invited to take web- and paper-based surveys in Okinawa Japan. The CCCHP (five-factor model with 27 items across motivation, attitude, skills, emotion, and knowledge) was translated using a combination translation method, and a five-point Likert scale was used for responses. Exploratory and confirmatory factor analyses and known-group method were used to examine structural validity, while Cronbach's alpha coefficient was used to test reliability.ResultsA total of 294 responses were analyzed; 77.2% had more than five years of experience. Since the fit index indicated that the five-factor model was not a good fit, it was modified to a four-factor model (J-CCCHP24) by moving three variables, removing the knowledge factor, and using the error covariance of the variables. The fit index after the modification was improved to comparative fit index (CFI) = 0.92, Tucker-Lewis index (TLI) = 0.91, root mean square error of approximation (RMSEA) = 0.05, and standardized root mean square residual (SRMR) = 0.06, and Cronbach's alpha was 0.85. The mean scores of J-CCCHP24 were significantly higher in the group with a history of overseas travel, higher foreign language skill, training in intercultural care, experience of foreign patient care, and intercultural interactions outside the workplace than in the group without these characteristics.ConclusionThis study confirmed the validity and reliability of the modified Japanese version of the CCCHP (four-factor model with 24 items). The results suggest that the exposure to different cultures on a personal level may help improve nurses' cross-cultural competence. Further refinement of this scale for practical use would encourage the implementation of necessary countermeasures to improve the cross-cultural competence of Japanese healthcare professionals.

Project description:BackgroundCurrently, there are no outcome measures assessing the ability of people with non-specific low back pain to self-manage their illness. Inspired by the 'Patient Enablement Instrument', we developed the Patient Enablement Instrument for Back Pain (PEI-BP). The aim of this study was to describe the development of the Patient Enablement Instrument for Back Pain (PEI-BP) and investigate content validity, construct validity, internal consistency, test-retest reliability, measurement error, responsiveness and floor and ceiling effects.MethodsThe PEI-BP consists of 6 items that are rated on a 0-10 Numeric Rating Scale. Measurement properties were evaluated using the COSMIN taxonomy and were based on three cohorts from primary care with low back pain: The content validity cohort (N = 14) which participated in semi-structured interviews, the GLA:D® Back cohort (N = 272) and the test-retest cohort (N = 37) which both completed self-reported questionnaires. For construct validity and responsiveness, enablement was compared to disability (Oswestry Disability Index), back pain beliefs (Brief Illness Perception Questionnaire), fear avoidance (Fear-Avoidance Beliefs Questionnaire-physical activity), mental health (SF-36), educational level and number of previous episodes of low back pain.ResultsThe PEI-BP was found to have acceptable content validity, construct validity, reliability (internal consistency, test-retest reliability and measurement error) and responsiveness. The Smallest Detectable Change was 10.1 points illustrating that a patient would have to change more than 1/6 of the scale range for it to be a true change. A skewed distribution towards the high scores were found at baseline indicating a potentially problematic ceiling effect in the current population.ConclusionsThe PEI-BP can be considered a valid and reliable tool to measure enablement on people seeking care for non-specific LBP. Further testing of the PEI-BP in populations with more severe LBP is recommended.Trial registrationNot applicable.

Project description:Enabling patients with asthma to obtain the knowledge, confidence and skills they need in order to assume a major role in the management of their disease is cost effective. It should be an integral part of any plan for long-term control of asthma. The modified Patient Enablement Instrument (mPEI) is an easily administered questionnaire that was adapted in the United Kingdom to measure patient enablement in asthma, but its applicability in Portugal is not known. Validity and reliability of questionnaires should be tested before use in settings different from those of the original version. The purpose of this study was to test the applicability of the mPEI to Portuguese asthma patients after translation and cross-cultural adaptation, and to verify the structural validity, internal consistency and reproducibility of the instrument. The mPEI was translated to Portuguese and back translated to English. Its content validity was assessed by a debriefing interview with 10 asthma patients. The translated instrument was then administered to a random sample of 142 patients with persistent asthma. Structural validity and internal consistency were assessed. For reproducibility analysis, 86 patients completed the instrument again 7 days later. Item-scale correlations and exploratory factor analysis were used to assess structural validity. Cronbach's alpha was used to test internal consistency, and the intra-class correlation coefficient was used for the analysis of reproducibility. All items of the Portuguese version of the mPEI were found to be equivalent to the original English version. There were strong item-scale correlations that confirmed construct validity, with a one component structure and good internal consistency (Cronbach's alpha >0.8) as well as high test-retest reliability (ICC=0.85). The mPEI showed sound psychometric properties for the evaluation of enablement in patients with asthma making it a reliable instrument for use in research and clinical practice in Portugal. Further studies are needed to confirm its responsiveness.

Project description:IntroductionA growing number of children and young people are surviving severe acquired brain injuries due to advances in healthcare. However, many fail to emerge from coma and continue to live with disorders of consciousness (DOC). Diagnostic, clinical and ethical challenges are prominent in this group. Misdiagnosis can have severe consequences for children and their families, including inadequate care, insufficient access to rehabilitation and stimulation, reduced accessibility to services and inappropriately limited opportunities for participation. The proposed project will develop and validate a diagnostic measure that supports detailed goal-planning-the Music therapy Sensory Instrument for Cognition, Consciousness and Awareness (MuSICCA).Methods and analysisFace validity will be assessed using a short questionnaire and the MuSICCA will be amended if face validity is insufficient. Once face validity is sufficient, 80 participants with suspected DOC will be recruited from multiple sites around the UK, USA and Ireland.Validity will be assessed using external reference standards (Coma Recovery Scale-Revised, Coma Near-Coma Scale and Nociception Coma Scale). Intra-rater reliability will be established using repeated ratings of video recordings from the assessment sessions. Inter-rater reliability will be assessed through video ratings by a second blinded assessor. In addition to these analyses, the clinical utility of the MuSICCA will be evaluated using a questionnaire to be completed by clinicians and relatives of the participants following the completion of the MuSICCA assessment.Ethics and disseminationEthical approval has been obtained for this study from the Research Ethics Committee and Health Research Authority of the National Health Service of the UK (ID: 167534). Results will be presented at national and international conferences, published in scientific journals and disseminated to participant representatives, clinicians, educators and care providers.Trial registration detailsThis study was registered at ClinicalTrials.gov Protocol Registration and Results System on 7th August 2019 (ID: NCT04050995); Pre-results.

Dataset Information

An instrument for evaluating clinical teaching in Japan: content validity and cultural sensitivity.

Background

Methods

Results

Conclusions

Publications

An instrument for evaluating clinical teaching in Japan: content validity and cultural sensitivity.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets