Dataset Information

Reliability testing of a modified MISTELS score using a low-cost trainer box.

ABSTRACT:

Background

Training programs such as the fundamentals of laparoscopic surgery (FLS) that are based on simulation are being currently used in several western countries. FLS allows skill acquisition and evaluation of competency in laparoscopic surgery. On the practical side, evaluation is determined by the MISTELS metrics (MISTELS is the acronym for the McGill inanimate system for training and evaluation of laparoscopic skills). This training program may be modified so that it can be implemented in countries with limited resources using a low-cost trainer box. Would the use of a low-cost trainer box alter the reliability of the MISTELS score?

Objective of study

The aim of the study was to evaluate the reliability of a modified MISTELS using a low-cost trainer box.

Methods

It was a prospective study carried out at Habib Thameur hospital in Tunis (Tunisia), between April 2016 and August 2016. The study involved residents from different surgical specialties in the departments of general surgery and paediatric surgery of the hospital during 2015 and 2016. This study assessed the reliability of a modified MISTELS system (Only three tasks were performed out of the five tasks used in the original MISTELS system). Evaluation was based on Cronbach's alpha and intraclass correlation coefficients (ICC). A low-cost trainer box was designed and constructed. The residents included in the study performed three series of three tasks using this trainer box. The first series was scored by two trained raters to evaluate inter-rater reliability. The two-other series were successively performed to evaluate test-retest reliability.

Results

The internal consistency, assessed by Cronbach's alpha, was at 0.929 which is an acceptable score. As for inter-rater and test-retest reliabilities that were assessed by ICCs, they yielded excellent scores that were at 1 and 0.95 (95% CI, 0.891-0.978) respectively.

Conclusions

The reliability of a modified MISTELS is not altered by the use of a low-cost trainer box. The score of the modified MISTELS is a reliable score for evaluating technical skills of surgical residents using a low-cost trainer box.

SUBMITTER: Hasnaoui A

PROVIDER: S-EPMC6503379 | biostudies-literature | 2019 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability testing of a modified MISTELS score using a low-cost trainer box.

Hasnaoui Anis A Zaafouri Haithem H Haddad Dhafer D Bouhafa Ahmed A Ben Maamer Anis A

BMC medical education 20190506 1

<h4>Background</h4>Training programs such as the fundamentals of laparoscopic surgery (FLS) that are based on simulation are being currently used in several western countries. FLS allows skill acquisition and evaluation of competency in laparoscopic surgery. On the practical side, evaluation is determined by the MISTELS metrics (MISTELS is the acronym for the McGill inanimate system for training and evaluation of laparoscopic skills). This training program may be modified so that it can be imple ...[more]

PMID: 31060548

Similar Datasets

Project description:Background and purposeThe modified TICI score is the benchmark for quantifying reperfusion after mechanical thrombectomy. There has been limited investigation into the reliability of this score. We aim to identify intra-rater and inter-rater reliability of the mTICI score among endovascular neurosurgeons.Materials and methodsFour independent endovascular neurosurgeons (raters) reviewed angiograms of 67 patients at 2 time points. κ statistics assessed inter- and intrarater reliability and compared raters'-versus-proceduralists' scores. Reliability was also assessed for occlusion location and by dichotomizing modified TICI scores (0-2a versus 2b-3).ResultsInterrater reliability was moderate-to-substantial, weighted κ = 0.417-0.703, overall κ = 0.374 (P < .001). The dichotomized modified TICI score had moderate-to-substantial interrater agreement, κ statistics = 0.468-0.715, overall κ = 0.582 (P < .001). Intrarater reliability was moderate-to-almost perfect, weighted κ = 0.594-0.81. The dichotomized modified TICI score had substantial-to-almost perfect reliability, κ = 0.632-0.82. Proceduralists had fair-to-moderate agreement with raters, weighted κ = 0.348-0.574, and the dichotomized modified TICI score had fair-to-moderate agreement, κ = 0.365-0.544. When proceduralists and raters disagreed, proceduralists' scores were higher in 79.6% of cases. M1 followed by ICA occlusions had the highest agreement.ConclusionsThe modified TICI score is a practical metric for assessing reperfusion after mechanical thrombectomy, though not without limitations. Agreement improved when scores were dichotomized around the clinically relevant threshold of successful revascularization. Interrater reliability improved with time, suggesting that formal training of interventionalists may improve reporting reliability. Agreement of the modified TICI scale is best with M1 and ICA occlusion and becomes less reliable with more distal or posterior circulation occlusions. These findings should be considered when developing research trials.

Dataset Information

Reliability testing of a modified MISTELS score using a low-cost trainer box.

Background

Objective of study

Methods

Results

Conclusions

Publications

Reliability testing of a modified MISTELS score using a low-cost trainer box.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets