Dataset Information

Reliability testing of a modified MISTELS score using a low-cost trainer box.

ABSTRACT:

Background

Training programs such as the fundamentals of laparoscopic surgery (FLS) that are based on simulation are being currently used in several western countries. FLS allows skill acquisition and evaluation of competency in laparoscopic surgery. On the practical side, evaluation is determined by the MISTELS metrics (MISTELS is the acronym for the McGill inanimate system for training and evaluation of laparoscopic skills). This training program may be modified so that it can be implemented in countries with limited resources using a low-cost trainer box. Would the use of a low-cost trainer box alter the reliability of the MISTELS score?

Objective of study

The aim of the study was to evaluate the reliability of a modified MISTELS using a low-cost trainer box.

Methods

It was a prospective study carried out at Habib Thameur hospital in Tunis (Tunisia), between April 2016 and August 2016. The study involved residents from different surgical specialties in the departments of general surgery and paediatric surgery of the hospital during 2015 and 2016. This study assessed the reliability of a modified MISTELS system (Only three tasks were performed out of the five tasks used in the original MISTELS system). Evaluation was based on Cronbach's alpha and intraclass correlation coefficients (ICC). A low-cost trainer box was designed and constructed. The residents included in the study performed three series of three tasks using this trainer box. The first series was scored by two trained raters to evaluate inter-rater reliability. The two-other series were successively performed to evaluate test-retest reliability.

Results

The internal consistency, assessed by Cronbach's alpha, was at 0.929 which is an acceptable score. As for inter-rater and test-retest reliabilities that were assessed by ICCs, they yielded excellent scores that were at 1 and 0.95 (95% CI, 0.891-0.978) respectively.

Conclusions

The reliability of a modified MISTELS is not altered by the use of a low-cost trainer box. The score of the modified MISTELS is a reliable score for evaluating technical skills of surgical residents using a low-cost trainer box.

SUBMITTER: Hasnaoui A

PROVIDER: S-EPMC6503379 | biostudies-literature | 2019 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability testing of a modified MISTELS score using a low-cost trainer box.

Hasnaoui Anis A Zaafouri Haithem H Haddad Dhafer D Bouhafa Ahmed A Ben Maamer Anis A

BMC medical education 20190506 1

<h4>Background</h4>Training programs such as the fundamentals of laparoscopic surgery (FLS) that are based on simulation are being currently used in several western countries. FLS allows skill acquisition and evaluation of competency in laparoscopic surgery. On the practical side, evaluation is determined by the MISTELS metrics (MISTELS is the acronym for the McGill inanimate system for training and evaluation of laparoscopic skills). This training program may be modified so that it can be imple ...[more]

PMID: 31060548

Similar Datasets

Project description:Background and purposeThe modified TICI score is the benchmark for quantifying reperfusion after mechanical thrombectomy. There has been limited investigation into the reliability of this score. We aim to identify intra-rater and inter-rater reliability of the mTICI score among endovascular neurosurgeons.Materials and methodsFour independent endovascular neurosurgeons (raters) reviewed angiograms of 67 patients at 2 time points. κ statistics assessed inter- and intrarater reliability and compared raters'-versus-proceduralists' scores. Reliability was also assessed for occlusion location and by dichotomizing modified TICI scores (0-2a versus 2b-3).ResultsInterrater reliability was moderate-to-substantial, weighted κ = 0.417-0.703, overall κ = 0.374 (P < .001). The dichotomized modified TICI score had moderate-to-substantial interrater agreement, κ statistics = 0.468-0.715, overall κ = 0.582 (P < .001). Intrarater reliability was moderate-to-almost perfect, weighted κ = 0.594-0.81. The dichotomized modified TICI score had substantial-to-almost perfect reliability, κ = 0.632-0.82. Proceduralists had fair-to-moderate agreement with raters, weighted κ = 0.348-0.574, and the dichotomized modified TICI score had fair-to-moderate agreement, κ = 0.365-0.544. When proceduralists and raters disagreed, proceduralists' scores were higher in 79.6% of cases. M1 followed by ICA occlusions had the highest agreement.ConclusionsThe modified TICI score is a practical metric for assessing reperfusion after mechanical thrombectomy, though not without limitations. Agreement improved when scores were dichotomized around the clinically relevant threshold of successful revascularization. Interrater reliability improved with time, suggesting that formal training of interventionalists may improve reporting reliability. Agreement of the modified TICI scale is best with M1 and ICA occlusion and becomes less reliable with more distal or posterior circulation occlusions. These findings should be considered when developing research trials.

Project description:The usefulness of anthropometry to define childhood malnutrition is undermined by poor measurement quality, which led to calls for new measurement approaches. We evaluated the ability of a 3D imaging system to correctly measure child stature (length or height), head circumference and arm circumference. In 2016-7 we recruited and measured children at 20 facilities in and around metro Atlanta, Georgia, USA; including at daycare, higher education, religious, and medical facilities. We selected recruitment sites to reflect a generally representative population of Atlanta and to oversample newborns and children under two years of age. Using convenience sampling, a total of 474 children 0-5 years of age who were apparently healthy and who were present at the time of data collection were included in the analysis. Two anthropometrists each took repeated manual measures and repeated 3D scans of each child. We evaluated the reliability and accuracy of 3D scan-derived measurements against manual measurements. The mean child age was 26 months, and 48% of children were female. Based on reported race and ethnicity, the sample was 42% Black, 28% White, 8% Asian, 21% multiple races, other or race not reported; and 16% Hispanic. Measurement reliability of repeated 3D scans was within 1 mm of manual measurement reliability for stature, head circumference and arm circumference. We found systematic bias when analyzing accuracy-on average 3D imaging overestimated stature and head circumference by 6 mm and 3 mm respectively, and underestimated arm circumference by 2 mm. The 3D imaging system used in this study is reliable, low-cost, portable, and can handle movement; making it ideal for use in routine nutritional assessment. However, additional research, particularly on accuracy, and further development of the scanning and processing software is needed before making policy and clinical practice recommendations on the routine use of 3D imaging for child anthropometry.

Dataset Information

Reliability testing of a modified MISTELS score using a low-cost trainer box.

Background

Objective of study

Methods

Results

Conclusions

Publications

Reliability testing of a modified MISTELS score using a low-cost trainer box.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets