Content Validation of a Practice-Based Work Capacity Assessment Instrument Using ICF Core Sets.
Ontology highlight
ABSTRACT: Purpose
A shift from providing long-term disability benefits to promoting work reintegration of people with remaining work capacity in many countries requires new instruments for work capacity assessments. Recently, a practice-based instrument addressing biopsychosocial aspects of functioning, the Social Medical Work Capacity instrument (SMWC), was developed. Our aim was to examine the content validity of the SMWC using ICF core sets.Methods
First, we conducted a systematic search to identify relevant ICF core sets for the working age population. Second the content of these core sets were mapped to assess the relevance and comprehensiveness of the SMWC. Next, we compared the content of the SMWC with the ICF-core sets.Results
Two work-related core sets and 31 disease-specific core sets were identified. The SMWC and the two work-related core sets overlap on 47 categories. Compared to the work-related core sets, the Body Functions and Activities and Participation are well represented in the new instrument, while the component Environmental factors is under-represented. Compared to the disease-specific core sets, items related to the social and domestic environmental factors are under-represented, while the SMWC included work-related factors complementary to the ICF.Conclusion
The SMWC content seems relevant, but could be more comprehensive for the purpose of individual work capacity assessments. To improve assessing relevant biopsychosocial aspects, it is recommended to extend the instrument by adding personal and environmental (work- and social-related) factors as well as a more tailored use of the SMWC for assessing work capacity of persons with specific diseases or underlying illness.
SUBMITTER: Sengers JH
PROVIDER: S-EPMC8172508 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:AimTo report on the results of the online international consensus process to develop the comprehensive and brief International Classification of Functioning, Disability and Health (ICF) Core Sets for adults with cerebral palsy (CP).MethodAn online iterative decision-making and consensus process involved 25 experts, including clinicians and researchers working with adults with CP, an adult with CP, and the parents of adults with CP from all six regions of the World Health Organization. The most relevant categories were selected from a list of 154 unique second-level candidate categories to develop the ICF Core Sets for adults with CP. This list resulted from evidence gathered during four preparatory studies, that is, a systematic literature review, a qualitative study, an expert survey, and an empirical study.ResultsThe consensus process resulted in the comprehensive ICF Core Set containing 120 second-level ICF categories: 33 body functions; eight body structures; 50 activities and participation; and 29 environmental factors, from which the most essential categories, 33 in total, were selected for the brief ICF Core Set. For body functions, most of the categories were mental functions and neuromusculoskeletal and movement-related functions. Body structures were mostly related to movement. All the chapters of the activities and participation component were represented, with mobility and self-care as the most frequently covered chapters. For environmental factors, most of the categories addressed products and technology and services, systems, and policies.InterpretationThe comprehensive and brief ICF Core Sets for adults with CP were created using a new online version of an established ICF Core Set consensus process. These Core Sets complement the age-specific ICF Core Sets for children and young people with CP and will promote standardized data collection worldwide.
| S-EPMC9299033 | biostudies-literature
Project description:ObjectiveInsurers frequently commission medical experts to estimate the degree of the remaining work capacity (RWC) in claimants for disability benefits. The social functioning scale Mini-ICF-APP allows for a rating of activity and participation limitations in thirteen capacity domains, considered as particularly relevant for work ability. The current study sought to evaluate the role of the Mini-ICF-APP ratings in psychiatric work disability evaluations, by examining how the capacity limitation ratings varied with the claimants' primary psychiatric diagnoses and how the ratings were related to RWC estimates.MethodsMedical experts estimated the RWC of 946 claimants with mental disorders and rated their activity and participation limitations using the Mini-ICF-APP, with higher ratings reflecting more severe limitations. The ratings were compared between claimants with different psychiatric diagnoses by analyses of variance. The mean Mini-ICF-APP rating across all capacity domains as well as all capacity-specific ratings were entered in simple or multiple regression models to predict the RWC in an alternative job.ResultsThe Mini-ICF-APP capacity limitation ratings in all domains but mobility were higher for claimants with personality and behavior disorders as compared to those with mood disorders or with neurotic, stress-related and somatoform disorders. The largest differences were observed in social capacities (e.g. group integration: F 2, 847 = 78.300, P < 0.001). In claimants with depression, all ratings increased with the severity of the diagnosis (all Fs 2, 203 > 16.393, all Ps < 0.001). In the overall sample, the mean Mini-ICF-APP rating showed a strong negative correlation with the estimated RWC (r = -.720, P < 0.001). Adding the capacity-specific ratings to the prediction model improved this prediction only marginally.DiscussionThe Mini-ICF-APP allows for documenting claimants' activity and participation limitations, which is likely to increase the transparency of medical experts' RWC estimates and enables them to check the plausibility of such estimates. However, our study showed that despite the strong association between RWC and Mini-ICF-APP ratings, half of the RWC variance was unrelated to the capacity limitations documented in the Mini-ICF-APP.
| S-EPMC8485557 | biostudies-literature
Project description:This masterclass introduces the topic of core outcome sets, describing rationale and methods for developing them, and providing some examples that are relevant for clinical research and practice.A core outcome set is a minimum consensus-based set of outcomes that should be measured and reported in all clinical trials for a specific health condition and/or intervention. Issues surrounding outcome assessment, such as selective reporting and inconsistency across studies, can be addressed by the development of a core set. As suggested by key initiatives in this field (i.e. OMERACT and COMET), the development requires achieving consensus on: (1) core outcome domains and (2) core outcome measurement instruments. Different methods can be used to reach consensus, including: literature systematic reviews to inform the process, qualitative research with clinicians and patients, group discussions (e.g. nominal group technique), and structured surveys (e.g. Delphi technique). Various stakeholders should be involved in the process, with particular attention to patients.Several COSs have been developed for musculoskeletal conditions including a longstanding one for low back pain, IMMPACT recommendations on outcomes for chronic pain, and OMERACT COSs for hip, knee and hand osteoarthritis. There is a lack of COSs for neurological, geriatric, cardio-respiratory and pediatric conditions, therefore, future research could determine the value of developing COSs for these conditions.
| S-EPMC5537457 | biostudies-other
Project description:ObjectivesAccording to the International Classification of Functioning, Disability and Health (ICF), functioning reflects the interplay between an individual's body structures and functions, activities, participation, environmental, and personal factors. To be useful in clinical practice, these concepts need to be operationalized into a practical and integral instrument. The Brief ICF Core Set for Hearing Loss (CSHL) provides a minimum standard for the assessment of functioning in adults with hearing loss. The objective of the present study was to operationalize the Brief CSHL into a digital intake tool that could be used in the otology-audiology practice for adults with ear and hearing problems as part of their intake assessment.DesignA three-step approach was followed: (1) Selecting and formulating questionnaire items and response formats, using the 27 categories of the Brief CSHL as a basis. Additional categories were selected based on relevant literature and clinical expertise. Items were selected from existing, commonly used disease-specific questionnaires, generic questionnaires, or the WHO's official descriptions of ICF categories. The response format was based on the existing item's response categories or on the ICF qualifiers. (2) Carrying out an expert survey and a pilot study (using the three-step test interview. Relevant stakeholders and patients were asked to comment on the relevance, comprehensiveness, and comprehensibility of the items. Results were discussed in the project group, and items were modified based on consensus. (3) Integration of the intake tool into a computer-based system for use in clinical routine.ResultsThe Brief CSHL was operationalized into 62 items, clustered into six domains: (1) general information, including reason for visit, sociodemographic, and medical background; (2) general body functions; (3) ear and hearing structures and functions; (4) activities and participation (A&P); (5) environmental factors (EF); and (6) personal factors (mastery and coping). Based on stakeholders' responses, the instructions of the items on A&P and EF were adapted. The three-step test interview showed that the tool had sufficient content validity but that some items on EF were redundant. Overall, the stakeholders and patients indicated that the intake tool was relevant and had a logical and clear structure. The tool was integrated in an online portal.ConclusionsIn the current study, an ICF-based e-intake tool was developed that aims to screen self-reported functioning problems in adults with an ear/hearing problem. The relevance, comprehensiveness, and comprehensibility of the originally proposed item list was supported, although the stakeholder and patient feedback resulted into some changes of the tool on item-level. Ultimately, the functioning information obtained with the tool could be used to promote patient-centered ear and hearing care taking a biopsychosocial perspective into account.
| S-EPMC7722460 | biostudies-literature
Project description:BackgroundThis study aimed to examine the associations among the International Classification of Functioning, Disability, and Health (ICF) core sets relevant to chronic ischemic heart disease (CIHD) using the least absolute shrinkage and selection operator (LASSO) model based on the ICF core sets scale in Chinese patients.MethodsThis was a prospective study of 120 patients with CIHD selected from January 2013 to June 2014 at the Fada Institute of Forensic Medicine & Science (Beijing, China). Functioning was qualified using the ICF core sets checklist for CIHD (Chinese version). The variables of core set categories of the ICF assessment scale for CIHD were entered into the LASSO model for mining dependencies among those variables. Graphical modeling was applied using LASSO generalized linear models.Results"Muscle endurance functions", "sensations associated with cardiovascular and respiratory functions", "blood vessel functions", and "heart functions" were the most injured in CIHD status. "Recreation and leisure" and "intimate relationships" were the most affected in CIHD status. "General social support services, systems, and policies" and "acquaintances, peers, colleagues, neighbors, and community members" were important for the outcome of functional status of the CIHD patient. "Economic self-sufficiency" and "family relationships" of the CIHD patient were not undermined in most cases.ConclusionsGraphical modeling can be used to describe associations between different areas of functioning in CIHD patients. The results suggest that these associations could be used as basis to improve rehabilitation and provide a deeper understanding of functioning in Chinese CIHD patients.
| S-EPMC6042460 | biostudies-literature
Project description:The purpose of this study was to validate the construct and reliability of an instrument to assess the work environment as a single tool based on quality of life (QL), quality of work life (QWL), and organizational climate (OC). The methodology tested the construct validity through Exploratory Factor Analysis (EFA) and reliability through Cronbach's alpha. The EFA returned a Kaiser-Meyer-Olkin (KMO) value of 0.917; which demonstrated that the data were adequate for the factor analysis; and a significant Bartlett's test of sphericity (χ² = 7465.349; Df = 1225; p ≤ 0.000). After the EFA; the varimax rotation method was employed for a factor through commonality analysis; reducing the 14 initial factors to 10. Only question 30 presented commonality lower than 0.5; and the other questions returned values higher than 0.5 in the commonality analysis. Regarding the reliability of the instrument; all of the questions presented reliability as the values varied between 0.953 and 0.956. Thus; the instrument demonstrated construct validity and reliability.
| S-EPMC7600521 | biostudies-literature
Project description:Background and purposeStroke preparedness interventions are limited by the lack of psychometrically sound intermediate end points. We sought to develop and assess the reliability and validity of the video-Stroke Action Test (video-STAT) an English and a Spanish video-based test to assess people's ability to recognize and react to stroke signs.MethodsVideo-STAT development and testing was divided into 4 phases: (1) video development and community-generated response options, (2) pilot testing in community health centers, (3) administration in a national sample, bilingual sample, and neurologist sample, and (4) administration before and after a stroke preparedness intervention.ResultsThe final version of the video-STAT included 8 videos: 4 acute stroke/emergency, 2 prior stroke/nonemergency, 1 nonstroke/emergency, and 1 nonstroke/nonemergency. Acute stroke recognition and action response were queried after each vignette. Video-STAT scoring was based on the acute stroke vignettes only (score range 0-12 best). The national sample consisted of 598 participants, 438 who took the video-STAT in English and 160 who took the video-STAT in Spanish. There was adequate internal consistency (Cronbach α=0.72). The average video-STAT score was 5.6 (SD=3.6), whereas the average neurologist score was 11.4 (SD=1.3). There was no difference in video-STAT scores between the 116 bilingual video-STAT participants who took the video-STAT in English or Spanish. Compared with baseline scores, the video-STAT scores increased after a stroke preparedness intervention (6.2 versus 8.9, P<0.01) among a sample of 101 black adults and youth.ConclusionsThe video-STAT yields reliable scores that seem to be valid measures of stroke preparedness.
| S-EPMC5373967 | biostudies-literature
Project description:BACKGROUND:Employees insured in pension insurance, who are incapable of working due to ill health, are entitled to a disability pension. To assess whether an individual meets the medical requirements to be considered as disabled, a work capacity evaluation is conducted. However, there are no official guidelines on how to perform an external quality assurance for this evaluation process. Furthermore, the quality of medical reports in the field of insurance medicine can vary substantially, and systematic evaluations are scarce. Reliability studies using peer review have repeatedly shown insufficient ability to distinguish between high, moderate and low quality. Considering literature recommendations, we developed an instrument to examine the quality of medical experts' reports. METHODS:The peer review manual developed contains six quality domains (formal structure, clarity, transparency, completeness, medical-scientific principles, and efficiency) comprising 22 items. In addition, a superordinate criterion (survey confirmability) rank the overall quality and usefulness of a report. This criterion evaluates problems of inner logic and reasoning. Development of the manual was assisted by experienced physicians in a pre-test. We examined the observable variance in peer judgements and reliability as the most important outcome criteria. To evaluate inter-rater reliability, 20 anonymous experts' reports detailing the work capacity evaluation were reviewed by 19 trained raters (peers). Percentage agreement and Kendall's W, a reliability measure of concordance between two or more peers, were calculated. A total of 325 reviews were conducted. RESULTS:Agreement of peer judgements with respect to the superordinate criterion ranged from 29.2 to 87.5%. Kendall's W for the quality domain items varied greatly, ranging from 0.09 to 0.88. With respect to the superordinate criterion, Kendall's W was 0.39, which indicates fair agreement. The results of the percentage agreement revealed systemic peer preferences for certain deficit scale categories. CONCLUSION:The superordinate criterion was not sufficiently reliable. However, in comparison to other reliability studies, this criterion showed an equivalent reliability value. This report aims to encourage further efforts to improve evaluation instruments. To reduce disagreement between peer judgments, we propose the revision of the peer review instrument and the development and implementation of a standardized rater training to improve reliability.
| S-EPMC6688267 | biostudies-other
Project description:BACKGROUND:Although a main task in the sickness certification process, physicians' clinical practice when assessing work capacity has not been thoroughly described. Increased knowledge on the matter is needed to better understand and support the certification process. In this review, we aimed to synthesise existing qualitative evidence to provide a clearer description of the assessment of work capacity as practiced by physicians. METHOD:Seven electronic databases were searched systematically for qualitative studies examining what and how physicians do when they assess work capacity. Data was analysed and integrated using thematic synthesis. RESULTS:Twelve articles were included. Results show that physicians seek to form a knowledge base including understanding the condition, the patient and the patient's workplace. They consider both medical and non-medical aspects to affect work capacity. To acquire and process the information they use various skills, methods and resources. Medical competence is an important basis, but not enough. Time, trust, intuition and reasoning are also used to assess the patient's claims and to translate the findings into a final assessment. The depth and focus of the information seeking and processing vary depending on several factors. CONCLUSION:The assessment of work capacity is a complex task where physicians rely on their non-medical skills to a higher degree than in ordinary clinical work. These skills are highly relevant but need to be complemented with access to appropriate resources such as understanding of the associations between health, work and social security, enough time in daily work for the assessment and ways to better understand the patient's work place. Also, the notion of an "objective" evaluation is questioned, calling for a greater appreciation of the complexity of the assessment and the role of professional judgement.
| S-EPMC7187489 | biostudies-literature
Project description:The ability of an individual to participate in courtroom proceedings is assessed by clinicians using legal 'fitness to plead' criteria. Findings of 'unfitness' are so rare that there is considerable professional unease concerning the utility of the current subjective assessment process. As a result, mentally disordered defendants may be subjected unfairly to criminal trials. The Law Commission in England and Wales has proposed legal reform, as well as the utilisation of a defined psychiatric instrument to assist in fitness to plead assessments. Similar legal reforms are occurring in other jurisdictions. Our objective was to produce and validate a standardised assessment instrument of fitness to plead employing a filmed vignette of criminal proceedings. The instrument was developed in consultation with legal and clinical professionals, and was refined using standard item reduction methods in two initial rounds of testing (n = 212). The factorial structure, test-retest reliability and convergent validity of the resultant instrument were assessed in a further round (n = 160). As a result of this iterative process a 25-item scale was produced, with an underlying two-factor structure representing the foundational and decision-making abilities underpinning fitness to plead. The sub-scales demonstrate good internal consistency (factor 1: 0·76; factor 2: 0·65) and test-retest stability (0·7) as well as excellent convergent validity with scores of intelligence, executive function and mentalising abilities (p?0·01 in all domains). Overall the standardised Fitness to Plead Assessment instrument has good psychometric properties. It has the potential to ensure that the significant numbers of mentally ill and cognitively impaired individuals who face trial are objectively assessed, and the courtroom process critically informed.
| S-EPMC5919482 | biostudies-literature