Dataset Information

Grading reflective essays: the construct validity and reliability of a newly developed Tool- GRE-9.

ABSTRACT: The main objective of this study is to assess the construct validity and reliability of the Grading Reflective Essays-9 (GRE-9). This study took place in a major tertiary academic medical center in Beirut, Lebanon. 104 reflective essays written by years 1-3 residents in the department of Family Medicine at the American University of Beirut Medical Center (AUBMC) were graded by 2 trained raters who independently scored the essays using GRE-9. GRE-9 scores were then correlated with scores on communication skills OSCE stations and in-training examinations to investigate, respectively, convergent and divergent validity. One of the 2 raters scored the essays twice one month apart to assess the reliability of the GRE-9 using intra rater reliability and internal consistency. There was a weak, non-significant correlation between GRE-9 score and In training examination (ITE) score (r = - .213, p = .395). There was a moderate, non-significant correlation between GRE-9 scores and the Objective structured clinical examination (OSCE) communication station scores (r = - .412 p = .162). The correlation coefficient between trails 1 and 2 was significant (r = .832, p = .000). Intra class correlation coefficient (ICC) analysis demonstrated almost perfect intra-rater agreement (0.819; 95% CI: 0.741-0.875) of the test ratings over time. GRE-9, is a short, concise, easy-to-use reliable grading tool for reflective essays that has demonstrated moderate to substantial intra-rater reliability and evidence of divergent validity. The study found non-significant correlations between reflective writing scores OSCE communication scores demonstrating a lack of relationship between reflective writing and this measure of performance.

SUBMITTER: Makarem NN

PROVIDER: S-EPMC10655370 | biostudies-literature | 2023 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Grading reflective essays: the construct validity and reliability of a newly developed Tool- GRE-9.

Makarem Nisrine N NN Rahme Diana V DV Brome Dayana D Saab Bassem R BR

BMC medical education 20231116 1

<h4>Background</h4>The main objective of this study is to assess the construct validity and reliability of the Grading Reflective Essays-9 (GRE-9).<h4>Methods</h4>This study took place in a major tertiary academic medical center in Beirut, Lebanon. 104 reflective essays written by years 1-3 residents in the department of Family Medicine at the American University of Beirut Medical Center (AUBMC) were graded by 2 trained raters who independently scored the essays using GRE-9. GRE-9 scores were th ...[more]

PMID: 37974119

Similar Datasets

Project description:Reactive agility (RAG) and change of direction speed (CODS) are important determinants of success in football (soccer), but there is an evident lack of information on reliable and valid football-specific testing procedures which will be applicable in defining sport-specific RAG and CODS in youth players. This study evaluated reliability and construct validity of newly developed tests of football-specific RAG (FS_RAG) and CODS (FS_CODS), which involved the ball kicking football technique. Additionally, factors associated with FS_RAG and FS_CODS were evaluated. The participants were youth football players (n = 59; age: 13.40 ± 1.25 years) divided according to their age into U13 (11-12 years of age; n = 29), and U15 (13-14 years of age; n = 30) categories. Additionally, performance levels (starters [first-team] vs. non-starters [substitutes]) were observed in each age category. The dependent variables were newly developed FS_RAG and FS_CODS tests. The independent variables were sprinting capacities over 10 and 20 meters (S10M, S20M), countermovement jump (CMJ), the reactive strength index (RSI), and a generic CODS test of 20 yards (20Y). The newly developed FS_CODS and FS_RAG were observed as dependent variables. Results showed appropriate intra-testing and inter-testing reliability of the FS_RAG and FS_CODS, with somewhat better reliability of the FS_CODS (ICC=0.82 and 0.79, respectively). Additionally, better reliability was evidenced in U15 than in U13 (ICC: 0.82-0.85, and 0.78-0.80 for U15 and U13, respectively). Independent samples t-test indicated significant differences between U13 and U15 in S10 (t-test: 3.57, p < 0.001), S20M (t-test: 3.13, p < 0.001), 20Y (t-test: 4.89, p < 0.001), FS_RAG (t-test: 3.96, p < 0.001), and FS_CODS (t-test: 6.42, p < 0.001), with better performance in U15. Starters outperformed non-starters in most capacities among U13, but only in FS_RAG among U15 (t-test: 1.56, p < 0.05). Multiple regression calculations indicated nonsignificant association between independent and dependent variables in U13 (FS_CODS: 19%, FS_RAG: 21% of the explained variance, both p > 0.05), but independent variables explained significant proportion of both dependent variables in U15 (FS_CODS: 35%, FS_RAG: 33% explained variance, both p < 0.05). The study confirmed the applicability of newly developed tests in distinguishing studied age categories of players. Results indicate that superiority in all studied fitness capacities is translated into performance level in U13. Meanwhile, FS_RAG seems to be important determinant of quality in U15.

Project description:BackgroundThere is a need for a survey instrument to measure arthralgia (joint pain) that has been psychometrically validated in the context of existing reference instruments. We developed the 16-item Patient-Reported Arthralgia Inventory (PRAI) to measure arthralgia severity in 16 joints, in the context of a longitudinal cohort study to assess aromatase inhibitor-associated arthralgia in breast cancer survivors and arthralgia in postmenopausal women without breast cancer. We sought to evaluate the reliability and validity of the PRAI instrument in these populations, as well as to examine the relationship of patient-reported morning stiffness and arthralgia.MethodsWe administered the PRAI on paper in 294 women (94 initiating aromatase inhibitor therapy and 200 postmenopausal women without breast cancer) at weeks 0, 2, 4, 6, 8, 12, 16, and 52, as well as once in 36 women who had taken but were no longer taking aromatase inhibitor therapy.ResultsCronbach's alpha was 0.9 for internal consistency of the PRAI. Intraclass correlation coefficients of test-retest reliability were in the range of 0.87-0.96 over repeated PRAI administrations; arthralgia severity was higher in the non-cancer group at baseline than at subsequent assessments. Women with joint comorbidities tended to have higher PRAI scores than those without (estimated difference in mean scores: -0.3, 95% confidence interval [CI] -0.5, -0.2; P<0.001). The PRAI was highly correlated with the Functional Assessment of Cancer Therapy-Endocrine Subscale item "I have pain in my joints" (reference instrument; Spearman r range: 0.76-0.82). Greater arthralgia severity on the PRAI was also related to decreased physical function (r=-0.47, 95% CI -0.55, -0.37; P<0.001), higher pain interference (r=0.65, 95% CI 0.57-0.72; P<0.001), less active performance status (estimated difference in location (-0.6, 95% CI -0.9, -0.4; P<0.001), and increased morning stiffness duration (r=0.62, 95% CI 0.54-0.69; P<0.0001).ConclusionWe conclude that the psychometric properties of the PRAI are satisfactory for measuring arthralgia severity.

Project description:BackgroundThe Bilateral Vestibulopathy Questionnaire (BVQ) is a recently developed 54-item Patient Reported Outcome Measure (PROM) that evaluates the clinically important symptoms of bilateral vestibulopathy (BVP) and its impact on daily life. This study aimed to assess the construct validity and reliability of the BVQ in a large BVP cohort.MethodsPatients diagnosed with BVP were asked to complete a set of questionnaires, including the BVQ, the EuroQol-5D-5L, the Health Utilities Index, the Dizziness Handicap Inventory, the Hospital Anxiety and Depression Scale, and the Oscillopsia Severity Questionnaire. The construct validity of the BVQ was evaluated by confirmatory and exploratory factor analyses (CFA and EFA), followed by hypotheses testing and known groups validity. Structural properties were explored for each individual item. Reliability was assessed by testing the internal consistency of the BVQ constructs (Cronbach's alpha) and test-retest reliability [intraclass correlation coefficients (ICCs)].ResultsA total of 148 patients with BVP (50% women, mean age 66 years) completed the set of questionnaires. The CFA did not show a satisfactory model in the original BVQ. However, the EFA showed a four-factor solution with 20 Likert-scale items related to oscillopsia, imbalance, emotion, and cognition. The succeeding CFA provided evidence for construct validity and an acceptable model of fit. Hypothesis testing confirmed that this shortened version validly measures the constructs to be measured. Statistically significant differences in scores between known groups were found, providing further support for good construct validity. The structural properties were acceptable. Cronbach's alpha confirmed good internal consistency for the four constructs, ranging from 0.80 to 0.89. The ICCs of the 20 Likert-scale items and four visual analog scale (VAS) items were interpreted as good (range 0.76-0.93).ConclusionThis study showed evidence of good construct validity of the new shortened version of the BVQ, consisting of four constructs with a total of 20 Likert-scale items and four VAS items. The final 24-item BVQ proved to be a reliable and valid multi-item PROM that captures the clinically important symptoms of BVP and evaluates its impact on daily life. Consequently, the BVQ enables the gathering of high-level evidence of treatment effectiveness in a systematic and quantitative manner.

Project description:BackgroundCurrently, there are no outcome measures assessing the ability of people with non-specific low back pain to self-manage their illness. Inspired by the 'Patient Enablement Instrument', we developed the Patient Enablement Instrument for Back Pain (PEI-BP). The aim of this study was to describe the development of the Patient Enablement Instrument for Back Pain (PEI-BP) and investigate content validity, construct validity, internal consistency, test-retest reliability, measurement error, responsiveness and floor and ceiling effects.MethodsThe PEI-BP consists of 6 items that are rated on a 0-10 Numeric Rating Scale. Measurement properties were evaluated using the COSMIN taxonomy and were based on three cohorts from primary care with low back pain: The content validity cohort (N = 14) which participated in semi-structured interviews, the GLA:D® Back cohort (N = 272) and the test-retest cohort (N = 37) which both completed self-reported questionnaires. For construct validity and responsiveness, enablement was compared to disability (Oswestry Disability Index), back pain beliefs (Brief Illness Perception Questionnaire), fear avoidance (Fear-Avoidance Beliefs Questionnaire-physical activity), mental health (SF-36), educational level and number of previous episodes of low back pain.ResultsThe PEI-BP was found to have acceptable content validity, construct validity, reliability (internal consistency, test-retest reliability and measurement error) and responsiveness. The Smallest Detectable Change was 10.1 points illustrating that a patient would have to change more than 1/6 of the scale range for it to be a true change. A skewed distribution towards the high scores were found at baseline indicating a potentially problematic ceiling effect in the current population.ConclusionsThe PEI-BP can be considered a valid and reliable tool to measure enablement on people seeking care for non-specific LBP. Further testing of the PEI-BP in populations with more severe LBP is recommended.Trial registrationNot applicable.

Project description:ObjectivesThe aim of the present study was to investigate the construct validity, responsiveness and reliability of the Feline Grimace Scale (FGS) in kittens.MethodsA total of 36 healthy female kittens (aged 10 weeks to 6 months) were included in a prospective, randomized, blinded study. Video recordings of all kittens were made before and 1 and 2 h after ovariohysterectomy using an opioid-free injectable anesthetic protocol with or without multimodal analgesia. Additional recordings were taken before and 1 h after administration of rescue analgesia (buprenorphine 0.02 mg/kg IM) to painful kittens. Screenshots of facial images were collected from the video recordings for FGS scoring. Four observers blinded to treatment groups and time points scored 111 randomized images twice with a 5-week interval using the FGS. Five action units (AUs) were scored (ear position, orbital tightening, muzzle tension, whiskers position and head position; 0-2 each). Construct validity, responsiveness, and inter- and intra-rater reliability were evaluated using linear models with Benjamini-Hochberg correction, Wilcoxon signed-rank test and single intraclass correlation coefficients (ICCsingle), respectively (P <0.05).ResultsFGS total ratio scores were higher at 1 and 2 h after ovariohysterectomy (median [interquartile range, IQR]: 0.30 [0.20-0.40] and 0.30 [0.20-0.40], respectively) than at baseline (median [IQR]: 0.10 [0.00-0.30]) (P <0.001). FGS total ratio scores were lower after the administration of rescue analgesia (median [IQR] before and after rescue analgesia) 0.40 [0.20-0.50] and 0.20 [0.10-0.38], respectively (P <0.001). Inter-rater ICCsingle was 0.68 for the FGS total ratio scores and 0.35-0.70 for all AUs considered individually. Intra-rater ICCsingle was 0.77-0.91 for the FGS total ratio scores and 0.55-1.00 for all AUs considered individually.Conclusions and relevanceThe FGS is a valid and responsive acute pain-scoring instrument with moderate inter-rater reliability and good to excellent intra-rater reliability in kittens.

Dataset Information

Grading reflective essays: the construct validity and reliability of a newly developed Tool- GRE-9.

Publications

Grading reflective essays: the construct validity and reliability of a newly developed Tool- GRE-9.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets