Psychometric validation of the Laval developmental benchmarks scale for family medicine.
Ontology highlight
ABSTRACT: Background
With the implementation of competency-based education in family medicine, there is a need for summative end-of-rotation assessments that are criterion-referenced rather than normative. Laval University's family residency program therefore developed the Laval Developmental Benchmarks Scale for Family Medicine (DBS-FM), based on competency milestones. This psychometric validation study investigates its internal structure and its relation to another variable, two sources of validity evidence.Methods
We used assessment data from a cohort of residents (n = 1432 assessments) and the Rasch Rating Scale Model to investigate its reliability, dimensionality, rating scale functioning, targeting of items to residents' competency levels, biases (differential item functioning), items hierarchy (adequacy of milestones ordering), and score responsiveness. Convergent validity was estimated by its correlation with the clinical rotation decision (pass, in difficulty/fail).Results
The DBS-FM can be considered as a unidimensional scale with good reliability for non-extreme scores (.83). The correlation between expected and empirical items hierarchies was of .78, p < .0001.Year 2 residents achieved higher scores than year 1 residents. It was associated with the clinical rotation decision.Conclusion
Advancing its validation, this study found that the DBS-FM has a sound internal structure and demonstrates convergent validity.
SUBMITTER: Renaud JS
PROVIDER: S-EPMC8237442 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:This study examined psychometric properties and feasibility of the Family Psychoeducation (FPE) Fidelity Scale. Fidelity assessors conducted reviews using the FPE fidelity scale four times over 18 months at five sites in Norway. After completing fidelity reviews, assessors rated feasibility of the fidelity review process. The FPE fidelity scale showed excellent interrater reliability (.99), interrater item agreement (88%), and internal consistency (mean = .84 across four time points). By the 18-month follow-up, all five sites increased fidelity and three reached adequate fidelity. Fidelity assessors rated feasibility as excellent. The FPE fidelity scale has good psychometric properties and is feasible for evaluating the implementation of FPE programs. Trial registration ClinicalTrials.gov Identifier: NCT03271242.
| S-EPMC7547979 | biostudies-literature
Project description:In Italy, at present, a well-known problem is inhomogeneous provision of rehabilitative services, as stressed by MoH, requiring appropriate criteria and parameters to plan rehabilitation actions. According to the Italian National Rehabilitation Plan, Comorbidity, Disability and Clinical Complexity should be assessed to define the patient's real needs. However, to date, clinical complexity is still difficult to measure with shared and validated tools. The study aims to psychometrically validate the Italian Rehabilitation Complexity Scale-Extended v13 (RCS-E v13), in order to meet the guidelines requirements. An observational multicentre prospective cohort study, involving 8 intensive rehabilitation facilities of the Emilia-Romagna Region and 1712 in-patients, [823 male (48%) and 889 female (52%), mean age 68.34 years (95% CI 67.69-69.00 years)] showing neurological, orthopaedic and cardiological problems, was carried out. The construct and concurrent validity of the RCS-E v13 was confirmed through its correlation to Barthel Index (disability) and Cumulative Illness Rating Scale (comorbidity) and appropriate admission criteria (not yet published), respectively. Furthermore, the factor analysis indicated two different components ("Basic Care or Risk-Equipment" and "Medical-Nursing Needs and Therapy Disciplines") of the RCS-E v13. In conclusion, the Italian RCS-E v13 appears to be a useful tool to assess clinical complexity in the Italian rehab scenario case-mix and its psychometric validation may have an important clinical rehabilitation impact allowing the assessment of the rehabilitation needs considering all three dimensions (disability, comorbidity and clinical complexity) as required by the Guidelines and the inhomogeneity could be reduced.
| S-EPMC5646770 | biostudies-other
Project description:Diabetes Distress (DD)-an emotional or affective state arise from challenge of living with diabetes and the burden of self-care-negatively impact diabetes management and quality of life of T2DM patients. Early detection and management of DD is key to efficient T2DM management. The study aimed at developing a valid and reliable instrument for Bangladeshi patients as unavailability such a tool posing challenge in diabetes care. Linguistically adapted, widely used, 17-item Diabetes Distress Scale (DDS), developed through forward-backward translation from English to Bengali, was administered on 1184 T2DM patients, from four diabetes hospitals in Bangladesh. Psychometric assessment of the instrument included, construct validity using principal component factor analysis, internal consistency using Cronbach's α and discriminative validity through independent t-test and test-retest reliability using intraclass-correlation coefficient (ICC) and Kappa statistics. Factor analysis extracted 4 components similar to original DDS domains, confirms the construct validity. The scale demonstrated satisfactory internal consistency (α = 0.838), stability (test-retest ICC = 0.941) and good agreement across repeated measurements (Kappa = 0.584). Discriminative validity revealed that patients with complication (p < 0.001) and those are on insulin (p < 0.001) had significantly higher distress scores in all domains. Bengali version of DDS is a valid and reliable tool for assessing distress among Bangladeshi T2DM patients.
| S-EPMC8755848 | biostudies-literature
Project description:The 12-item Multiple Sclerosis Walking Scale (12-MSWS) is a validated questionnaire which assessed walking function; it has been widely adopted in multiple sclerosis (MS) clinical research.Identify and validate clinically meaningful 12-MSWS benchmarks in MS.Cross-sectional study of 159 MS patients permitted identification of clinically meaningful 12-MSWS benchmarks based on their relationship to real-life anchors. Identified 12-MSWS benchmarks were then validated in a second population of 96 subjects using measures of ambulation, cognition, and patient-reported outcomes.12-MSWS score of 0-24.99 was associated with working outside the home and assistance-free mobility; 25-49.99 was associated with gait disability and difficulty doing housework; 50-74.99 was associated with unemployment, government healthcare, cane use, and difficulty performing instrumental activities of daily living (IADLs); and 75-100 was associated with change in occupation due to walking, mobility impairment requiring bilateral assistance, and inability to perform IADLs. During the validation step, strong linear associations were identified between 12-MSWS benchmarks and other MS-related disability outcome measures, including ambulatory and non-ambulatory measures.We have identified clinically meaningful 12-MSWS benchmarks which define four groups differentiated by increasing levels of mobility impairment and associated loss of functional independence. These data provide insight into how 12-MSWS translate to meaningful functional limitations in MS.
| S-EPMC5411321 | biostudies-literature
Project description:The Sport Motivation Scale (SMS) is a widely used instrument that assesses motivational processes within sport and exercise environments. The scale has demonstrated validity and reliability in multiple cultures, however, there is yet no empirical evidence regarding its psychometric properties in the Czech population. In this study we therefore set out to examine the reliability and construct validity of the SMS in a sample of Czech university-aged athletes. We first examined the SMS factor structure using a nonparametric item response theory model (Mokken monotone homogeneity model) and identified six items violating the unidimensionality of the particular subscales. Remaining items were then subjected to test of hypothesized seven-factor structure and several different forms of measurement invariance examined based on gender, competition level and type of sport (individual vs team sports). The hypothesized seven-factor fit well and there was sufficient evidence supporting full invariance across the examined groups. All SMS subscales had adequate internal consistencies ranging from 0.66 to 0.89. Results of correlational analysis among the SMS subscales and between the SMS and two outcomes of interest further supported validity of the scale. Observed differences in SMS subscales between males and females, recreational and competitive athletes, as well as between individual and team-based sport activities, comported with prior empirical studies using a self-determination theory framework. In conclusion, results reinforce the utility and performance of the SMS in a sample of Czech university athletes. The SMS may therefore be recommended for measurement of the multidimensional motivational processes taking place in the exercise and sport domain.
| S-EPMC6939896 | biostudies-literature
Project description:BackgroundThe Affiliate Stigma Scale (ASS) is a widely used tool to measure affiliate stigma in the caregivers of individuals with various types of mental illnesses. However, the Hindi adaptation of this scale with evident psychometric properties is not available. This study aimed to adapt the ASS in the Hindi language and, further, to validate it in the Indian setting.MethodsTranslation and back-translation methods were used to translate the original items of the ASS to the Hindi language. After completion of translations and linguistic adaptation process, the Hindi translated version of the ASS, WHO Quality of Life-BREF (WHOQOL-BREF), General Health Questionnaire-12 (GHQ-12), and Hospital Anxiety and Depression Scale (HADS) were administered to 140 caregivers of persons with mental illness. Purposive sampling method was adopted. The age range of the participants was 17-60 years. Psychometric properties, as well as the factor structures of the scale, were evaluated.ResultsThe Hindi version of the ASS has adequate internal consistencies (r = 0.87-0.93) and test-retest reliability (r = 0.78, P < 0.001). The concurrent validity of this scale was also high, as the correlation coefficients among the Hindi version of the ASS, WHOQOL-BREF, GHQ-12, and HADS were ranging from 0.23 to 0.35. The exploratory factor analysis revealed three underlying factors, namely, cognition, affect, and behavior.ConclusionsThe Hindi version of the ASS is a reliable and valid psychometric tool to measure affiliate stigma in caregivers of patients with mental illness.
| S-EPMC9120987 | biostudies-literature
Project description:BackgroundThe family environment is important for explaining individual health behaviour. While previous research mostly focused on influences among family members and dyadic interactions (parent-child), the purpose of this study was to develop a new measure, the Family Health Climate Scale (FHC-Scale), using a family-based approach. The FHC is an attribute of the whole family and describes an aspect of the family environment that is related to health and health behaviour. Specifically, a questionnaire measuring the FHC (a) for nutrition (FHC-NU) and (b) for activity behaviour (FHC-PA) was developed and validated.MethodsIn Study 1 (N=787) the FHC scales were refined and validated. The sample was randomly divided into two subsamples. With random sample I exploratory factor analyses were conducted and items were selected according to their psychometric quality. In a second step, confirmatory factor analyses were conducted using the random sample II. In Study 2 (N=210 parental couples) the construct validity was tested by correlating the FHC to self-determined motivation of healthy eating and physical activity as well as the families' food environment and joint physical activities.ResultsExploratory factor analyses with random sample I (Study 1) revealed a four (FHC-NU) and a three (FHC-PA) factor model. These models were cross-validated with random sample II and demonstrated an acceptable fit [FHC-PA: χ(2)=222.69, df=74, p<.01; χ(2)/df=3.01; CFI=.96; SRMR=.04; RMSEA=.07, CI .06/.08; FHC-NU: χ(2)=278.30, df=113, p<.01, χ(2)/df=2.46, CFI=.96; SRMR=.04; RMSEA=.06, CI .05/.07]. The perception of FHC correlated (p<.01) with the intrinsic motivation of healthy eating (r=.42) and physical activity (r=.56). Moreover, parental perceptions of FHC-NU correlated with household soft drink availability (r=-.31) and perceptions of FHC-PA with the frequency of joint physical activities with the child (r=.51). These patterns were found on the intraindividual and interindividual level.ConclusionsTwo valid instruments measuring the FHC within families were developed. The use of different informants' ratings demonstrated that the FHC is a family level variable. The results confirm the high relevance of the FHC for individuals' health behaviour. The FHC and the measurement instruments are useful for examining health-related aspects of the family environment.
| S-EPMC4015295 | biostudies-literature
Project description:BackgroundAlzheimer's disease (AD) is the most frequent cause of cognitive impairment. Community knowledge of the disease has proven to be a very important aspect of the development of interventions and the evaluation of their effectiveness. However, it is necessary to have standardized and recognized tools in different languages. The aim of the current study was to develop a cross-cultural adaptation of the Spanish Dementia Knowledge Assessment Scale (DKAS-S) and to assess their psychometric properties with cohorts of health students and professional and non-professional caregivers of AD patients from several regions of Spain.MethodsWe developed and translated the DKAS into Spanish following the forward-back-forward translation procedure. Then, we performed a cross-sectional study to assess the validity, reliability and feasibility of the DKAS-S. We also performed an analysis to obtain test-retest reliability measures. The study was performed in four medical centres across three regions in Spain. From May to September 2019, we administered the scale to students, professional and non-professional caregivers; including a subgroup of non-professional caregivers of patients with early-onset AD (< 65 years).ResultsEight hundred forty-six volunteer participants completed the DKAS-S: 233 students (mean age 26.3 ± 9.2 years), 270 professional caregivers (mean age 42.5 ± 11.7 years) and 343 non-professional caregivers of AD patients. (mean age was 56.4 ± 13.16). The DKAS-S showed good internal consistency (Cronbach's α = 0.819) and good test-retest reliability (time 1: 28.1 ± 8.09 vs time 2: 28.8 ± 7.96; t = - 1.379; p = 0.173). Sensitivity to change was also significant in a subgroup of 31 students who received education related to AD and dementias between each administration (time 1: 25.6 ± 6.03) to (time 2: 32.5 ± 7.12; t = - 5.252, p = 0.000). The validity of the construct was verified by confirmatory factor analysis, although there were challenges in the inclusion of some items in the original 4 factors.ConclusionsThe 25-item DKAS-S showed good psychometric properties for validity and reliability and the factorial analysis when it was administered to a population of students and professional and non-professional caregivers. It was a useful instrument for measuring levels of knowledge about dementia in Spanish population.
| S-EPMC8111921 | biostudies-literature
Project description:ObjectiveSelf-neglect is an imprecisely defined entity with multiple clinical expressions and adverse health consequences, especially in the elderly. However, research has been limited by the absence of a measurement instrument that is both inclusive and specific. Our goal was to establish the psychometric properties of a quantitative instrument, the Abrams Geriatric Self-Neglect Scale (AGSS).MethodsWe analyzed data from a 2007 case-control study of 71 cognitively intact community-dwelling older self-neglectors that had used the AGSS. The AGSS was validated against two "gold standards": a categorical definition of self-neglect developed by expert consensus; and the clinical judgment of a geriatric psychiatrist using chart review. Frequencies were examined for the six scale domains by source (Subject, Observer, and Overall Impression). Internal consistency was estimated for each source, and associations among the sources were evaluated.ResultsInternal consistency estimates for the AGSS were rated as "good," with the Subject responses having the lowest alpha and omega (0.681 and 0.692) and the Observer responses the highest (0.758 and 0.765). Subject and Observer scores had the lowest association (0.578, p < 0.001). Using expert consensus criteria as the primary "gold standard," the Observer and Overall Impression subscales were "good" at classifying self-neglect, while the Subject subscale was "fair."ConclusionsThe AGSS correctly classified and quantified self-neglect against two "gold standards." Sufficient correlations among multiple sources of information allow investigators and clinicians to choose flexibly from Subject, Observer, or Overall Impression. The lower internal consistency estimates for Subject responses are consistent with self-neglectors' propensity to disavow symptoms. Copyright © 2017 John Wiley & Sons, Ltd.
| S-EPMC6209102 | biostudies-literature
Project description:BackgroundFor the treatment of female sexual dysfunction, the most relevant outcome measures are patient-reported treatment effects and changes in symptoms, underscoring the need for reliable, validated patient-reported outcome (PRO) instruments. The aim of this study was to evaluate the psychometric characteristics (validity and reliability) of the Female Sexual Distress Scale-Desire/Arousal/Orgasm (FSDS-DAO) PRO measure, which was adapted from the validated FSDS-Revised (FSDS-R) questionnaire and added 2 questions involving arousal and orgasm.MethodsPsychometric analyses were based on the data from a multicenter phase 2b dose-finding study that compared the safety and efficacy of bremelanotide versus placebo and were conducted in the evaluable modified intent-to-treat population (N = 325) from that study. Psychometric evaluation of the new items in the FSDS-DAO included confirmatory factor analyses, tests of internal consistency and test-retest reliability, examinations of convergent and discriminant validity, and determination of responsiveness. The validity of the FSDS-DAO was evaluated based on previously developed instruments, including the Female Sexual Function Index (FSFI), General Assessment Questionnaire (GAQ), Women's Inventory of Treatment Satisfaction (WITS-9), and Female Sexual Encounter Profile-Revised (FSEP-R).ResultsConfirmatory factor analyses demonstrated that the FSDS-DAO items fit very well (Bentler's comparative fit index of 0.929). Cronbach's α for the FSDS-DAO total score was ≥ 0.91 at Visits 1, 2, 5, and 12, demonstrating adequate internal consistency reliability. Test-retest reliability was acceptable with an intra-class coefficient of 0.61 and a Spearman's correlation coefficient score of 0.62 between Visits 1 and 2 (4 weeks). Acceptable construct validity was demonstrated by significant correlations with related PRO scales in the expected directions and magnitude. For example, participants reporting the worst levels of sexual function on the FSFI also showed the worst FSDS-DAO scores at Visits 5 and 12. The FSDS-DAO total score was responsive to change.ConclusionsEvidence supports the validity and reliability of the FSDS-DAO for assessing sexually related distress in women with female sexual arousal disorder and/or hypoactive sexual desire disorder; the addition of the arousal and orgasm items did not impact the validity and reliability of the measure. Clinical Trial Registration ClinicalTrials.gov NCT01382719.
| S-EPMC8463644 | biostudies-literature