Dataset Information

Examining the factor structure, reliability, and validity of the main outcome measure used in mentalization-based therapy skills training.

ABSTRACT:

Background and aims

Multiple national guidelines stress the importance for clinicians to possess good therapeutic skills for working with patients with significant relational difficulties (who may receive a diagnosis of personality disorder). Training clinicians in mentalization-based treatment skills (MBT-S) is one approach to address this. The main outcome measure used in MBT-S studies is the Knowledge and Application of MBT Questionnaire (KAMQ). However, an absence of research into the properties and validity of the KAMQ has limited the methodological quality of MBT-S evaluations so far. The aim of this study was therefore to investigate the factor structure, internal consistency, reliability, and validity of the KAMQ.

Methods

Using an existing multiprofessional sample of 217 clinicians from 2014 to 2016, we undertook exploratory factor analysis to determine the factor structure and internal consistency of the KAMQ. Convergent validity of the measure with the Attitudes to Personality Disorder Questionnaire (APDQ) was assessed in a subset of this dataset where both questionnaires had been administered (n = 92). Additionally, by recruiting a new sample of 70 clinicians, we assessed the measure's test-retest reliability.

Results

Factor analysis found three factors underlying 17 of the 20 KAMQ items, relating to therapeutic skills in mentalizing, beliefs about applying MBT in practice, and specific MBT knowledge. The KAMQ was revised following the factor analysis to form the KAMQ-2 with 17 items. Internal consistency (? = .85, 95% confidence interval [CI] = 0.80-0.89) and test-retest reliability (ICC = 0.84, 95% CI = 0.73-0.91) were good. In correlation analyses, the KAMQ-2 showed convergent validity with the main factor from the APDQ (n = 48; r _s = 0.39, P?ConclusionThe KAMQ-2 provides a short, reliable self-report instrument which probes clinicians' knowledge about mentalizing skills, and beliefs about using these. There was preliminary evidence for validity. The properties of the KAMQ-2 mean that more robust evaluation and development of MBT-S is now possible.

SUBMITTER: Polnay A

PROVIDER: S-EPMC7883382 | biostudies-literature | 2021 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Examining the factor structure, reliability, and validity of the main outcome measure used in mentalization-based therapy skills training.

Polnay Adam A McIntosh Lindsey G LG Burnett Aileen A Williams Andrea A Cahill Catherine C Wilkinson Peter P Mohammad Fiona F Patrick Jon J

Health science reports 20210215 1

<h4>Background and aims</h4>Multiple national guidelines stress the importance for clinicians to possess good therapeutic skills for working with patients with significant relational difficulties (who may receive a diagnosis of personality disorder). Training clinicians in mentalization-based treatment skills (MBT-S) is one approach to address this. The main outcome measure used in MBT-S studies is the <i>Knowledge and Application of MBT Questionnaire</i> (KAMQ). However, an absence of research ...[more]

PMID: 33614982

Similar Datasets

Project description:BackgroundFundamental Movement Skills (FMS) play a critical role in ontogenesis. Many children have insufficient FMS, highlighting the need for universal screening in schools. There are many observational FMS assessment tools, but their psychometric properties are not readily accessible. A systematic review was therefore undertaken to compile evidence of the validity and reliability of observational FMS assessments, to evaluate their suitability for screening.MethodsA pre-search of 'fundamental movement skills' OR 'fundamental motor skills' in seven online databases (PubMed, Ovid MEDLINE, Ovid Embase, EBSCO CINAHL, EBSCO SPORTDiscus, Ovid PsycINFO and Web of Science) identified 24 assessment tools for school-aged children that: (i) assess FMS; (ii) measure actual motor competence and (iii) evaluate performance on a standard battery of tasks. Studies were subsequently identified that: (a) used these tools; (b) quantified validity or reliability and (c) sampled school-aged children. Study quality was assessed using COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklists.ResultsNinety studies were included following the screening of 1863 articles. Twenty-one assessment tools had limited or no evidence to support their psychometric properties. The Test of Gross Motor Development (TGMD, n = 34) and the Movement Assessment Battery for Children (MABC, n = 37) were the most researched tools. Studies consistently reported good evidence for validity, reliability for the TGMD, whilst only 64% of studies reported similarly promising results for the MABC. Twelve studies found good evidence for the reliability and validity of the Bruininks-Oseretsky Test of Motor Proficiency but poor study quality appeared to inflate results. Considering all assessment tools, those with promising psychometric properties often measured limited aspects of validity/reliability, and/or had limited feasibility for large scale deployment in a school-setting.ConclusionThere is insufficient evidence to justify the use of any observational FMS assessment tools for universal screening in schools, in their current form.

Project description:BackgroundFew measures capture the complex symptoms and concerns of those receiving palliative care.AimTo validate the Integrated Palliative care Outcome Scale, a measure underpinned by extensive psychometric development, by evaluating its validity, reliability and responsiveness to change.DesignConcurrent, cross-cultural validation study of the Integrated Palliative care Outcome Scale - both (1) patient self-report and (2) staff proxy-report versions. We tested construct validity (factor analysis, known-group comparisons, and correlational analysis), reliability (internal consistency, agreement, and test-retest reliability), and responsiveness (through longitudinal evaluation of change).Setting/participantsIn all, 376 adults receiving palliative care, and 161 clinicians, from a range of settings in the United Kingdom and Germany.ResultsWe confirm a three-factor structure (Physical Symptoms, Emotional Symptoms and Communication/Practical Issues). Integrated Palliative care Outcome Scale shows strong ability to distinguish between clinically relevant groups; total Integrated Palliative care Outcome Scale and Integrated Palliative care Outcome Scale subscale scores were higher - reflecting more problems - in those patients with 'unstable' or 'deteriorating' versus 'stable' Phase of Illness (F = 15.1, p < 0.001). Good convergent and discriminant validity to hypothesised items and subscales of the Edmonton Symptom Assessment System and Functional Assessment of Cancer Therapy-General is demonstrated. The Integrated Palliative care Outcome Scale shows good internal consistency (α = 0.77) and acceptable to good test-retest reliability (60% of items kw > 0.60). Longitudinal validity in form of responsiveness to change is good.ConclusionThe Integrated Palliative care Outcome Scale is a valid and reliable outcome measure, both in patient self-report and staff proxy-report versions. It can assess and monitor symptoms and concerns in advanced illness, determine the impact of healthcare interventions, and demonstrate quality of care. This represents a major step forward internationally for palliative care outcome measurement.

Project description:BackgroundThe Functional Independence Measure + Functional Assessment Measure (FIM+FAM) Scale is one of the most widely used instruments to measure functional independence post-stroke, and features many cultural adaptations to various languages.AimThe aim of this study was to determine the psychometric properties of a Spanish cross-cultural adaptation of the FIM+FAM for use in the stroke population.DesignObservational study.SettingOutpatient long-term service of a neurorehabilitation unit.PopulationOne hundred and twenty-two individuals with stroke.MethodsThe functional independence of the participants was assessed with the adapted version of the FIM+FAM. Additionally, the functional, motor and cognitive condition of the participants was assessed with a battery of standardized clinical instruments. Finally, a group of 31 participants out of the total were evaluated a second time with the FIM+FAM by a different evaluator than the one who performed the first evaluation. Internal consistency, inter-rater reliability and convergent validity with other clinical instruments of the adapted version of the FIM+FAM were determined.ResultsThe internal consistency of the adapted version of the FIM+FAM was excellent, as evidenced by Cronbach's α values that exceeded 0.973. The inter-rater reliability was likewise excellent, with correlations above 0.990 in all domains and subscales. Additionally, the convergent validity of the scale adaptation with clinical instruments was variable, with values ranging from 0.264 to 0.983, but consistent with the construct assessed in the different instruments examined.ConclusionsThe internal consistency, inter-rater reliability and convergent validity of the Spanish-adapted version of the FIM+FAM Scale showed excellent reliability and validity of the adaptation, which supports its use to assess functional independence after stroke.Clinical rehabilitation impactAvailability of a valid adaptation for the evaluation of functional independence after stroke in Spanish population.

Dataset Information

Examining the factor structure, reliability, and validity of the main outcome measure used in mentalization-based therapy skills training.

Background and aims

Methods

Results

Publications

Examining the factor structure, reliability, and validity of the main outcome measure used in mentalization-based therapy skills training.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets