Dataset Information

The concise measurement of clinical communication skills: Validation of a short scale.

ABSTRACT:

Objective

There is a lack of brief rating scales for the reliable assessment of psychotherapeutic skills, which do not require intensive rater training and/or a high level of expertise. Thus, the objective is to validate a 14-item version of the Clinical Communication Skills Scale (CCSS-S).

Methods

Using a sample of N = 690 video-based ratings of role-plays with simulated patients, we calculated a confirmatory factor analysis and an exploratory structural equation modeling (ESEM), assessed convergent validities, determined inter-rater reliabilities and compared these with those who were either psychology students, advanced psychotherapy trainees, or experts.

Results

Correlations with other competence rating scales were high (rs > 0.86-0.89). The intraclass correlations ranged between moderate and good [ICC_(2,2) = 0.65-0.80], with student raters yielding the lowest scores. The one-factor model only marginally replicated the data, but the internal consistencies were excellent (α = 0.91-95). The ESEM yielded a two-factor solution (Collaboration and Structuring and Exploration Skills).

Conclusion

The CCSS-S is a brief and valid rating scale that reliably assesses basic communication skills, which is particularly useful for psychotherapy training using standardized role-plays. To ensure good inter-rater reliabilities, it is still advisable to employ raters with at least some clinical experience. Future studies should further investigate the one- or two-factor structure of the instrument.

SUBMITTER: Maaß U

PROVIDER: S-EPMC9596765 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The concise measurement of clinical communication skills: Validation of a short scale.

Maaß Ulrike U Kühne Franziska F Heinze Peter Eric PE Ay-Bryson Destina Sevde DS Weck Florian F

Frontiers in psychiatry 20221012

<h4>Objective</h4>There is a lack of brief rating scales for the reliable assessment of psychotherapeutic skills, which do not require intensive rater training and/or a high level of expertise. Thus, the objective is to validate a 14-item version of the Clinical Communication Skills Scale (CCSS-S).<h4>Methods</h4>Using a sample of <i>N</i> = 690 video-based ratings of role-plays with simulated patients, we calculated a confirmatory factor analysis and an exploratory structural equation modeling ...[more]

PMID: 36311532

Similar Datasets

Project description:Self-efficacy encompasses the professional and personal language goals of learners as their progress depends upon a strong motivation to put practical language skills to use when the real world requires it. Intercultural communication and effectiveness are of interest to the professional and personal language goals of learners as their progress depends upon a strong motivation to put practical language skills to use when the real world requires it. Studying or working abroad and engaging in intercultural training are two such contexts that bind research in learner characteristics between applied linguistics and positive psychology as they provide a substrate of concrete interactions, transformative experiences characterized by opportunities for changes in self-concept, negotiations with values and authenticity, and forms of interpersonal development underwritten by intercultural communication as an ability. A tool to capture this domain-specific intercultural communication was previously developed with sojourner educational professionals for use among English speaking populations. However, the original study lacked confirmatory analyses of internal and external validity that would clarify model identification and applicability for research that deals with intercultural communication competence across populations with diverse sample characteristics. A total of 876 teachers (M age = 37.48, SD = 10.81) and 266 university students (M age = 19.48, SD = 0.74) in Japan responded to items from the SEIC instrument. Acceptable model fit was supported for the eight-item short form. Metric invariance was observed for individuals from a sample of sojourning English language teachers similar to the original validation and a nationwide survey of Japanese teachers of English, offering indications of cross-cultural validity. Degrees of equivalence were also found for the Japanese items as extending fitness for use to students from two universities in Japan. Concurrent validity was supported for SEIC measured by the scale with intercultural effectiveness competencies and speaking and listening self-efficacy constructs used in classroom contexts. Together, this study offers a tool of valid indicators for researchers and practitioners who aim to observe self-efficacy in positive education, intercultural training, or international programs that intersect with language learning and intercultural communication.

Project description:BackgroundThe Communication Skills Attitude Scale (CSAS) is a recognized tool for assessment of attitudes towards communication learning. In the original version, it consists of 26 items divided on theoretical assumptions into two subscales: Positive and Negative Attitudes Scales. However, the evidence for its structure seems unsatisfactory, and a simple division into positive and negative attitudes may be insufficient to describe attitudes of medical students towards communication learning. Moreover, the existing evidence of the test-retest reliability of the CSAS seems limited. Consequently, this study aimed to provide more evidence on its psychometric properties while validating the CSAS questionnaire in a cohort of Polish medical students.MethodsThe CSAS was translated, adapted into Polish, and validated in a cohort of 389 Polish medical students. Statistical analysis involved, among others, parallel analysis to determine the number of factors, confirmatory factor analysis to compare the proposed model with theory-based ones, and test-retest reliability analysis.ResultsConducted analysis revealed that in the examined population, the CSAS should rather consist of four than two subscales. Proposed four subscales addressed perceived outcomes of communication learning, positive and negative attitudes towards it (affective components), and factors motivating students to learn communication (a cognitive component of attitudes). Results of test-retest reliability were satisfactory for individual items and subscales.ConclusionsThis study presented a valid and reliable version of the Communication Skills Attitude Scale for Polish medical students and confirmed previous assumptions that CSAS may also be appropriate for assessment of affective and cognitive components of attitudes. Future research should, based on Ajzen's Theory of Planned Behavior, make attempts to develop a tool assessing not only attitudes but also subjective norms and perceived behavioral control.

Project description:BackgroundCommunication-based activities and products (i.e., training programs, webinars) are a critical component of implementation strategies that relay information to various audiences. Audience perceptions of communication effectiveness contribute important insight into the processes and mechanisms through which an implementation effort may succeed or fail. To advance research on this front, a psychometrically sound instrument for measuring perceived communication effectiveness (PCE) is needed.MethodsAn expert panel identified the theoretical foundations and conceptual domains of PCE and drafted preliminary items. Five focus groups of correctional professionals who had recently completed an implementation leadership training reviewed the items and provided feedback for refinement. Revised items were then included in a survey-based evaluation of an ongoing eLearning curriculum designed to improve the practices used by front-line probation officers in supervising individuals in the field. The factorial structure of a final 6-item scale as well as its convergent, divergent, and predictive validity was evaluated using data from the evaluation surveys (Nfollow-up = 358, Nbaseline+follow-up = 159).ResultsConfirmatory factor analysis of the final scale of PCE demonstrated adequate fit. PCE was strongly correlated with measures of implementation outcomes (acceptability, r = .819, p < .001; appropriateness, r = .809, p < .001; and feasibility, r = .754, p < .001), yet uncorrelated with a scale of need to evaluate (r = - .051, p = .422), demonstrating both convergent and divergent validities. The predictive validity of PCE was evidenced by significant associations between PCE and key training outcomes, including perceived staff use of evidence-based practices (β = .230, p < .05), agency climate (β = .261, p < .05), and value concordance (β = .209, p < .05), after controlling for baseline values and other confounders.ConclusionsThe PCE scale is psychometrically sound and can be a useful tool for gauging audience receptivity to and the potential impact of communication-based implementation activities and products.

Project description:Because it has been associated with significant increases [through the Werther Effect (WE)] or decreases [through the Papageno Effect (PE)] of suicide rates, media coverage of suicide-related events is recognized as a prevention leverage. Unfortunately, the recommendations that the World Health Organization (WHO) has published to help journalists reporting on suicide remain poorly applied. The Mini Media Training (MMT) is a short media training session designed to increase psychiatrists' ability to communicate about suicide during interviews. We aimed at assessing the effect of the MMT on psychiatrists' ability to help journalists complying with the WHO recommendations. From June 2017 to December 2019, 173 physicians and residents in psychiatry were recruited during French national congresses. At baseline (T0) and 1 and 3 months later (T1), participants received the MMT, which consisted in a simulated interview where they we asked to answer a journalist about a mock suicide. Communication skills were measured with a score summing the number of delivered pieces of advice in relation to the WHO recommendations, with a maximum score of 33. A weighted score was also derived based on the degree of directivity needed for the participant to provide these items, again with a possible maximum of 33. A total of 132 psychiatrists participated in the study at T0 and T1. Both the weighted and unweighted score significantly increased from T0 to T1 (d = +2.08, p < 0.001, and d = +1.24, p < 0.001, respectively). Having a history of contacts with journalists, a short professional experience (<3 years) and prior knowledge of the WE, PE, and WHO recommendations were significantly associated with greater unweighted and weighted scores at baseline. The latter two variables also predicted greater T0-T1 improvement of the weighted score. These results suggest that the MMT could be effective for improving the ability of psychiatrists to guide journalists toward more responsible media coverage of suicide. As a short, easy to implement educational activity, the MMT could therefore be considered in association with other measures to help media professionals mitigating the WE and promoting the PE.

Dataset Information

The concise measurement of clinical communication skills: Validation of a short scale.

Objective

Methods

Results

Conclusion

Publications

The concise measurement of clinical communication skills: Validation of a short scale.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets