Dataset Information

A new tool for assessing short debriefings after immersive simulation: validity of the SHORT scale.

ABSTRACT:

Background

Simulation is being increasingly used worldwide in healthcare education. However, it is costly both in terms of finances and human resources. As a consequence, several institutions have designed programs offering several short immersive simulation sessions, each followed by short debriefings. Although debriefing is recommended, no tool exists to assess appropriateness of short debriefings after such simulation sessions. We have developed the Simulation in Healthcare retrOaction Rating Tool (SHORT) to assess short debriefings, and provide some validity evidence for its use.

Methods

We designed this scale based on our experience and previously published instruments, and tested it by assessing short debriefings of simulation sessions offered to emergency medicine residents at Laval University (Canada) from 2015 to 2016. Analysis of its reliability and validity was done using Standards for educational and psychological testing. Generalizability theory was used for testing internal structure evidence for validity.

Results

Two raters independently assessed 22 filmed short debriefings. Mean debriefing length was 10:35 (min 7:21; max 14:32). Calculated generalizability (reliability) coefficients are ??=?0.80 and ?-?3?=?0.82. The generalizability coefficient for a single rater assessing three debriefings is ??=?0.84.

Conclusions

The G study shows a high generalizability coefficient (????0.80), which demonstrates a high reliability. The response process evidence for validity provides evidence that no errors were associated with using the instrument. Further studies should be done to demonstrate validity of the English version of the instrument and to validate its use by novice raters trained in the use of the SHORT.

SUBMITTER: Riviere E

PROVIDER: S-EPMC6419351 | biostudies-literature | 2019 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A new tool for assessing short debriefings after immersive simulation: validity of the SHORT scale.

Rivière Etienne E Aubin Etienne E Tremblay Samuel-Lessard SL Lortie Gilles G Chiniara Gilles G

BMC medical education 20190312 1

<h4>Background</h4>Simulation is being increasingly used worldwide in healthcare education. However, it is costly both in terms of finances and human resources. As a consequence, several institutions have designed programs offering several short immersive simulation sessions, each followed by short debriefings. Although debriefing is recommended, no tool exists to assess appropriateness of short debriefings after such simulation sessions. We have developed the Simulation in Healthcare retrOactio ...[more]

PMID: 30871505

Similar Datasets

Project description:BACKGROUND:Mentorship plays an essential role in enhancing the success of junior faculty. Previous evaluation tools focused on specific types of mentors or mentees. The main objective was to develop and provide validity evidence for a Mentor Evaluation Tool (MET) to assess the effectiveness of one-on-one mentoring for faculty in the academic health sciences. METHODS:Evidence was collected for the validity domains of content, internal structure and relationship to other variables. The 13 item MET was tested for internal structure evidence with 185 junior faculty from Schools of Dentistry, Medicine, Nursing, and Pharmacy. Finally, the MET was studied for additional validity evidence by prospectively enrolling mentees of three different groups of faculty (faculty nominated for, or winners of, a lifetime achievement in mentoring award; faculty graduates of a mentor training program; and faculty mentors not in either of the other two groups) at the University of California San Francisco (UCSF) and asking them to rate their mentors using the MET. Mentors and mentees were clinicians, educators and/or researchers. RESULTS:The 13 MET items mapped well to the five mentoring domains and six competencies described in the literature. The standardized Cronbach's coefficient alpha was 0.96. Confirmatory factor analysis supported a single factor (CFI = 0.89, SRMR = 0.05). The three mentor groups did not differ in the single overall assessment item (P = 0.054) or mean MET score (P = 0.288), before or after adjusting for years of mentoring. The mentorship score means were relatively high for all three groups. CONCLUSIONS:The Mentor Evaluation Tool demonstrates evidence of validity for research, clinical, educational or career mentors in academic health science careers. However, MET did not distinguish individuals nominated as outstanding mentors from other mentors. MET validity evidence can be studied further with mentor-mentee pairs and to follow prospectively the rating of mentors before and after a mentorship training program.

Project description:Background/aimsThe ABC Dementia Scale (ABC-DS), a new tool for evaluating dementia, was developed in Japan. The ABC-DS is a comprehensive instrument that can simultaneously evaluate activities of daily living (ADLs), behavioral and psychological symptoms of dementia (BPSD), and cognitive function. The ABC-DS can be administered easily and quickly and can clarify the severity of dementia and its changes over time. While the ABC-DS has been reported to be useful in Alzheimer disease (AD)-type dementia, it has not yet been studied in other types of dementia. The purpose of this study was to reevaluate the standard validity of ABC-DS separately for various dementia types and severities.MethodsWe evaluated the ABC-DS in outpatients at 1 hospital in Nagasaki Prefecture and patients who use the facility. Domain A, corresponding to ADLs, correlated with Disability Assessment for Dementia (DAD); domain B, corresponding to BPSD, correlated with the Neuropsychiatric Inventory (NPI); domain C, corresponding to cognitive functions, correlated with Mini-Mental State Examination (MMSE); and the total score of the ABC-DS correlated with the Clinical Dementia Rating (CDR).Results102 patients, comprising 38 males and 64 females with an average age of 80.7 ± 8.6 years, were enrolled. AD-type dementia was present in 38 cases, vascular dementia (VaD) in 23, mixed dementia in 23, dementia with Lewy bodies in 6, argyrophilic grain dementia in 9, and mild cognitive impairment in 3. A strong correlation was found between ABC-DS domain scores and their respective reference neuropsychological instruments (domain A and the DAD, domain B and the NPI, domain C and the MMSE, and total score and CDR). The correlation of each ABC-DS domain score with the corresponding standard scale depended on the type and severity of dementia, and we observed moderate or high correlations in AD and VaD patients with moderate and severe dementia.DiscussionAlthough the ABC-DS targets AD, it can be used in VaD based on the results of this study. In other types of dementia, the results differed depending on the domain; in some conditions, the ABC-DS may not show sufficient concurrent validity with other standard scales. Also, the ABC-DS is more beneficial for moderate-to-severe dementia, as reported in previous studies. It is highly useful in clinical practice in Japan since there more than half of all patients have moderate-to-severe dementia.

Project description:Intellectual giftedness is usually defined in terms of having a very high Intellectual Quotient (IQ). The intellectual capacity is assessed by a standardized test such as the Wechsler Intelligence Scale for Children (WISC). However, the identification of intellectually gifted children (IGC) often remains time-consuming. A short-form WISC can be used as a screening instrument. The practitioners and researchers in this field can then make a more in-depth evaluation of the IGC's cognitive and socioemotional characteristics if needed. The aim of our study is thus to determine the best short tests, in terms of their psychometric qualities, for the identification of IGC. The current study is composed of three-step analyses. Firstly, we created nine IQs short forms (IQSF) with 2-subtests, and nine IQSF with 4-subtests from the WISC-IV (Wechsler, 2005). Secondly, we estimated psychometric parameters (i.e., reliability and validity) from empirical and simulated dataset with WISC-IV. The difference in the estimation of psychometric qualities of each IQSF from the simulated data is very close to those derived from empirical data. We thus selected the three best IQSF based on these psychometrics parameters estimated from simulated datasets. For each selected short form of the WISC-IV, we estimated the screening quality in our sample of IGC. Thirdly, we created IQSF with 2- and 4-subtests from the WISC-V (Wechsler, 2016) with simulated dataset. We then highlighted the three best short forms of WISC-V based on the estimated psychometric parameters. The results are interpreted in terms of validity, reliability and screening quality of IGC. In spite of the important changes in the WISC-V, our findings show that the 2-subtest form, Similitaries + Matrix Reasoning, and 4-subtest form, Similitaries + Vocabulary + Matrix Reasoning + Block Design, are the most efficient to identify the IGC at the two recent versions of Wechsler scales. Finally, we discuss the advantages and drawbacks of a brief assessment of intellectual aptitudes for the identification of the IGC.

Dataset Information

A new tool for assessing short debriefings after immersive simulation: validity of the SHORT scale.

Background

Methods

Results

Conclusions

Publications

A new tool for assessing short debriefings after immersive simulation: validity of the SHORT scale.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets