Dataset Information

Does Thirty-Minute Standardised Training Improve the Inter-Observer Reliability of the Horse Grimace Scale (HGS)? A Case Study.

ABSTRACT: The Horse Grimace Scale (HGS) is a facial-expression-based pain coding system that enables a range of acute painful conditions in horses to be effectively identified. Using valid assessment methods to identify pain in horses is of a clear importance; however, the reliability of the assessment is highly dependent on the assessors' ability to use it. Training of new assessors plays a critical role in underpinning reliability. The aim of the study was to evaluate whether a 30-minute standardised training program on HGS is effective at improving the agreement between observers with no horse experience and when compared to an HGS expert. Two hundred and six undergraduate students with no horse experience were recruited. Prior to any training, observers were asked to score 10 pictures of horse faces using the six Facial Action Units (FAUs) of the HGS. Then, an HGS expert provided a 30-minute face-to-face training session, including detailed descriptions and example pictures of each FAU. After training, observers scored 10 different pictures. Cohen's k coefficient was used to determine inter-observer reliability between each observer and the expert; a paired-sample t-test was conducted to determine differences in agreement pre- and post-training. Pre-training, Cohen's k ranged from 0.20 for tension above the eye area to 0.68 for stiffly backwards ears. Post-training, the reliability for stiffly backwards ears and orbital tightening significantly increased, reaching Cohen's k values of 0.90 and 0.91 respectively (paired-sample t-test; p < 0.001). The results suggest that this 30-minute face-to-face training session was not sufficient to allow observers without horse experience to effectively apply HGS. However, this standardised training program could represent a starting point for a more comprehensive training program for those without horse experience in order to increase their reliably in applying HGS.

SUBMITTER: Dai F

PROVIDER: S-EPMC7277819 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Does Thirty-Minute Standardised Training Improve the Inter-Observer Reliability of the Horse Grimace Scale (HGS)? A Case Study.

Dai Francesca F Leach Mattew M MacRae Amelia Mari AM Minero Michela M Costa Emanuela Dalla ED

Animals : an open access journal from MDPI 20200430 5

The Horse Grimace Scale (HGS) is a facial-expression-based pain coding system that enables a range of acute painful conditions in horses to be effectively identified. Using valid assessment methods to identify pain in horses is of a clear importance; however, the reliability of the assessment is highly dependent on the assessors' ability to use it. Training of new assessors plays a critical role in underpinning reliability. The aim of the study was to evaluate whether a 30-minute standardised tr ...[more]

PMID: 32365927

Similar Datasets

Project description:BackgroundMusculoskeletal disorders particularly in the back and lower extremities are common among marines. Here, movement-control tests are considered clinically useful for screening and follow-up evaluation. However, few studies have addressed the reliability of clinical tests, and no such published data exists for marines. The present aim was therefore to determine the inter- and intra-observer reliability of clinically convenient tests emphasizing movement control of the back and hip among marines. A secondary aim was to investigate the sensitivity and specificity of these clinical tests for discriminating musculoskeletal pain disorders in this group of military personnel.MethodsThis inter- and intra-observer reliability study used a test-retest approach with six standardized clinical tests focusing on movement control for back and hip. Thirty-three marines (age 28.7 yrs, SD 5.9) on active duty volunteered and were recruited. They followed an in-vivo observation test procedure that covered both low- and high-load (threshold) tasks relevant for marines on operational duty. Two independent observers simultaneously rated performance as "correct" or "incorrect" following a standardized assessment protocol. Re-testing followed 7-10 days thereafter. Reliability was analysed using kappa (κ) coefficients, while discriminative power of the best-fitting tests for back- and lower-extremity pain was assessed using a multiple-variable regression model.ResultsInter-observer reliability for the six tests was moderate to almost perfect with κ-coefficients ranging between 0.56-0.95. Three tests reached almost perfect inter-observer reliability with mean κ-coefficients > 0.81. However, intra-observer reliability was fair-to-moderate with mean κ-coefficients between 0.22-0.58. Three tests achieved moderate intra-observer reliability with κ-coefficients > 0.41. Combinations of one low- and one high-threshold test best discriminated prior back pain, but results were inconsistent for lower-extremity pain.ConclusionsOur results suggest that clinical tests of movement control of back and hip are reliable for use in screening protocols using several observers with marines. However, test-retest reproducibility was less accurate, which should be considered in follow-up evaluations. The results also indicate that combinations of low- and high-threshold tests have discriminative validity for prior back pain, but were inconclusive for lower-extremity pain.

Project description:BackgroundSeveral radiographic measurements of the humerus can be used to evaluate the treatment outcome of supracondylar fractures in children. Because of the cartilaginous nature of the immature elbow, interpretation of radiographs around this area is sometimes challenging and can be unreliable. This study was conducted to determine the inter-observer and intra-observer reliability of the six commonly used radiographic measurements of the distal humerus.MethodThe Baumann angle, humero-ulna angle, metaphyseal-diaphyseal angle, radial epiphyseal angle, shaft-condylar angle and lateral capitellohumeral angle of the humerus were measured by two observers on the radiographs of uninjured elbows from 58 children. The values between each measurement were compared and correlated using a Pearson coefficient of correlation to determine the inter-observer and intra-observer reliability.ResultsAll of the radiographic parameters showed excellent intra-observer reliability with the correlation coefficient values of the Baumann angle, humero-ulna angle, metaphyseal-diaphyseal angle, radial epiphyseal angle, shaft-condylar angle, lateral capitellohumeral angle as 0.945, 0.95, 0.909, 0.888, 0.961 and 0.975 (p < 0.001), respectively. The inter-observer reliability of the Baumann and humero-ulna angles were also found to be highly correlated at r = 0.843 (p < 0.001) and 0.878 (p < 0.001), respectively. The metaphyseal-diaphyseal angle had poor reliability with r = 0.136 (p = 0.291) while the radial epiphyseal angle, shaft-condylar angle, and lateral capitellohumeral angle demonstrated good reliability with r = 0.675 (p < 0.001), 0.747 (p < 0.001), and 0.686 (p < 0.001), respectively.ConclusionThe Baumann angle and humero-ulna angle measurements of distal humerus showed excellent inter- and intra-observer reliability. Both parameters represent repeatable and reliable methods for determining the outcome of supracondylar humeral fractures in pediatric population.

Project description:BackgroundHead-eye movement control deficit is an identified problem in patients with chronic neck pain, particularly in cases of whiplash associated disorders (WAD). To date, there is no evidence concerning the reliability and validity of visually assessed active head-eye movement control tests. Therefore, the objectives of the present cross-sectional study were, a) to develop a test battery; and b) to investigate inter-observer reliability and discriminative validity in patients with chronic neck pain compared to healthy controls.MethodsThe study was conducted at two physiotherapy clinics in Switzerland. Ethics Committee approval was obtained. Ten active head-eye coordination tests, on 23 patients with chronic neck pain and associated symptoms and 19 healthy controls, were videotaped. The tests included eye movements in the neutral head position and 45° relative neck rotation, gaze stability and sequential head-eye movements. All tests were performed in the sitting and standing positions. Two blinded physiotherapists independently rated the randomized videos. Performance was rated as "negative", "moderately positive" or "clearly positive". Weighted kappa (wK) and 95% confidence intervals (CI) were calculated to investigate inter-observer reliability. Good reliability was defined as wK >0.5 with a lower boundary of 95% CI >0.2. Odds ratios (to define cut-off points) and the distribution of the classificator, numbers of positive tests, were calculated.ResultsThree out of ten tests showed "excellent" (wK 0.82 to 0.86), five out of ten tests showed "substantial" (wK 0.69 to 0.79) and two out of ten tests showed "moderate" (wK 0.54 to 0.59) reliability. Results were comparable in the sitting and standing positions. On average, three out of five tests were rated positive in patients and one out of five tests was rated positive in healthy controls. An odds ratio of 13.3 to 18.6 was obtained using ?2/5 tests as a cut-off point.ConclusionVisual assessment by physiotherapists of head-eye movement control tests is reliable. The test battery is able to discriminate between patients with chronic neck pain and healthy controls. There were no differences in performance between the sitting and standing positions. The test battery can therefore be reduced to five tests. Further research is needed to identify the test-retest stability and responsiveness.

Dataset Information

Does Thirty-Minute Standardised Training Improve the Inter-Observer Reliability of the Horse Grimace Scale (HGS)? A Case Study.

Publications

Does Thirty-Minute Standardised Training Improve the Inter-Observer Reliability of the Horse Grimace Scale (HGS)? A Case Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets