A Systematic Review of the Quality and Utility of Observer-Based Instruments for Assessing Medical Professionalism.
Ontology highlight
ABSTRACT:
SUBMITTER: Kwan YH
PROVIDER: S-EPMC6314360 | biostudies-literature | 2018 Dec
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundOver the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments' measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations.MethodsA systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990-2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument's usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee's criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments.ResultsAfter screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar's instrument for nursing students, Nurse Practitioners' Roles and Competencies Scale, and Perceived Faculty Competency Inventory.ConclusionAlthough instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies.
| S-EPMC5428933 | biostudies-literature
Project description:Back pain in athletes varies with sport, age, and sex, which can impair athletic performance, thereby contributing to retirement. Studies on back pain in this population use questionnaires to assess components, such as pain intensity and location and factors associated with pain, among others. This study aimed to review validated questionnaires that have assessed back pain in athletes. This systematic review was conducted according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) by searching the databases Embase, MEDLINE, SPORTDiscus, CINAHL, and Scopus. The articles were selected regardless of language and date of publication. Titles and abstracts were independently selected by two reviewers; disagreements were resolved by a third reviewer. All the steps were conducted using the software Rayyan. The methodological quality of the questionnaire validation articles was assessed using a critical appraisal tool checklist proposed by Brink and Louw. The search returned 4748 articles, of which 60 were selected for this review, including 5 questionnaire validation studies. These articles were published between 2004 and 2022, which were performed in more than 20 countries, particularly Germany (14) and Sweden (5). Thirteen different instruments were identified, of which 46.1% were developed in Europe. The most commonly used questionnaires were the Oswestry Disability Index and Nordic Standardized Questionnaire. In addition, five questionnaire validation studies were selected for methodological quality assessment, with only two studies demonstrating high methodological quality. The following three instruments were identified for assessing back pain specifically in athletes: Micheli Functional Scale, Persian Functional Rating Index, and Athlete Disability Index. This review confirmed that all three instruments were specifically designed to assess this condition.
| S-EPMC10624266 | biostudies-literature
Project description:BackgroundCulinary skills are important objects of study in the field of Public Health. Studies that propose to develop instruments for assessing such construct show lack of methodological uniformity to report validity and reliability of their instruments.ObjectiveTo identify studies that have developed instruments to measure culinary skills in adult population, and critically assess their psychometric properties.DesignWe conducted a systematic review according to the PRISMA statement. We searched literature PubMed/Medline, Scopus, LILACS, and Web of Science databases until January 2021, and consulted Google Scholar for relevant grey literature. Two reviewers independently selected the studies, conducted data extraction, and assessed the psychometric quality of the instruments. A third reviewer resolved any doubts or disagreements in all steps of the systematic review.ResultsThe search identified 1148 potentially relevant studies, out of which 9 met the inclusion criteria. In addition, we included 3 studies by searching the related articles and the reference lists of these studies, totaling 12 included studies in this review. Ten studies reported the development of tools measuring culinary skills in adults and 2 studies performed cross-cultural adaptations of original instruments. We considered adequate quality of internal consistency reliability in four studies. One study received adequate rating for test-retest reliability. No studies presented adequate rating for content validity and four studies showed satisfactory results for at least one type of construct validity. One study reported criterion validity and the quality of this psychometric property was inadequate.ConclusionsWe identified many studies that surveyed culinary skills. Although the isolated measures appraised in this review show good promise in terms of quality of psychometric properties, no studies presented adequate measures for each aspect of reliability and validity. A more consistent and consensual definition of culinary skills is recommended. The flaws observed in these studies show that there is a need for ongoing research in the area of the psychometric properties of instruments assessing culinary skills.
| S-EPMC8351978 | biostudies-literature
Project description:BackgroundAgainst a backdrop of population aging and improving survival rates for chronic noncommunicable diseases (CNCD), researchers are placing growing emphasis on health-related quality of life (HRQoL). The aim of this study was to identify the QoL assessment instruments used in population-based studies with adults conducted around the world.MethodsA systematic review of original research published in all languages between 2008 and 2018 was conducted. Systematic reviews and meta-analyses were excluded.ResultsSixty-three articles (38.1% conducted in the Americas) fitted the eligibility criteria. Based on the AHRQ checklist for cross-sectional studies and the Newcastle-Ottawa scale for cohort studies, methodological quality was shown to be fair in the majority of studies (55.6%) and good in 44.4%. The country with the highest number of publications was Brazil (20.6%). Twelve types of generic instruments and 11 specific instruments were identified. The generic instrument SF-36 was the most frequently used measure (33.3% of studies). In-home interviewing was exclusively used by 47.6% of the studies, while 39 studies (61.9%) reported the use of self-administered questionnaires. Over two-thirds of the studies (34.9%) used questionnaires to investigate the association between chronic diseases and/or associated factors.ConclusionsIt was concluded that the wide range of instruments and modes of questionnaire administration used by the studies may hinder comparisons between population groups with the same characteristics or needs. There is a lack of research on QoL and the factors affecting productive capacity. Studies of QoL in older persons should focus not only on the effects of disease and treatment, but also on the determinants of active aging and actions designed to promote it. Further research is recommended to determine which QoL instruments are best suited for population-based studies.
| S-EPMC7329518 | biostudies-literature
Project description:PURPOSE:In contemporary pharmacy, the role of pharmacists has become more multifaceted as they now handle a wider range of tasks and take more responsibility for care provision for patients than 20 years ago. Such an evolution in the pharmacist's responsibilities is accompanied by the need for pharmacists to display high-quality patient-centred care and counselling, and to demonstrate professionalism, which now needs to be taught and assessed are part of pharmacy education and practice. This workaimed at identifying definition of professionalism in pharmacy practice and critically evaluatingpublished instruments for assessing professionalism in pharmacy practice. METHODS:We searched the medical literature listed in Scopus, Medline, andPsycINFOdatabasesfrom 1 January 2000 to 31 December 2018. All papers meeting our selection criteria, were reviewed and summarised into a clear review of professionalism requirements in pharmacy practice. Details of the instruments measuring professionalism were reviewed in detail. RESULTS:There is no accepted simple definition of professionalism, although we identified several theoretical and policy frameworks required for professional pharmaceutical practice. We identified 4 instruments (Behavioural Professionalism Assessment Instrument (BPAI), Lerkiatbundit's Instrument, Pharmacy Professionalism Instrument (PPI) and Professionalism Assessment Tool (PAT) that build on these frameworks and measure professional practice in pharmacy students. These were found to be reliable and valid but had only been used and tested in student populations. CONCLUSION:Given the increasing role of community pharmacisits there is a need for assessment of professionalism in practice. Professionalism is a complex concept that is challenging to measure because it has no standardised definition and existing literature related to the topic is limited. Current instruments available focus on measuring the development of the elements of professionalism among pharmacy students rather than pharmacists.
| S-EPMC6755140 | biostudies-literature
Project description:BackgroundQuality of life (QoL) outcomes are used to monitor quality of care for older adults accessing aged care services, yet it remains unclear which QoL instruments best meet older adults', providers' and policymakers' needs. This review aimed to (1) identify QoL instruments used in aged care and describe them in terms of QoL domains measured and logistical details; (2) summarise in which aged care settings the instruments have been used and (3) discuss factors to consider in deciding on the suitability of QoL instruments for use in aged care services.DesignSystematic review.Data sourcesMEDLINE, EMBASE, PsycINFO, Cochrane Library and CINAHL from inception to 2021.Eligibility criteriaInstruments were included if they were designed for adults (>18 years), available in English, been applied in a peer-reviewed research study examining QoL outcomes in adults >65 years accessing aged care (including home/social care, residential/long-term care) and had reported psychometrics.Data extraction and synthesisTwo researchers independently reviewed the measures and extracted the data. Data synthesis was performed via narrative review of eligible instruments.Results292 articles reporting on 29 QoL instruments were included. Eight domains of QoL were addressed: physical health, mental health, emotional state, social connection, environment, autonomy and overall QoL. The period between 1990 and 2000 produced the greatest number of newly developed instruments. The EuroQoL-5 Dimensions (EQ-5D) and Short Form-series were used across multiple aged care contexts including home and residential care. More recent instruments (eg, ICEpop CAPability measure for Older people (ICECAP-O) and Adult Social Care Outcomes Toolkit (ASCOT)) tend to capture emotional sentiment towards personal circumstances and higher order care needs, in comparison with more established instruments (eg, EQ-5D) which are largely focused on health status.ConclusionsA comprehensive list of QoL instruments and their characteristics is provided to inform instrument choice for use in research or for care quality assurance in aged care settings, depending on needs and interests of users.
| S-EPMC8603300 | biostudies-literature
Project description:IntroductionThe World Organization recommends to implement National Quality Policies and Strategies in health systems, but few instruments have been proposed to assess and monitor these quality interventions at the system level. This study will map and compare instruments for the assessment of quality policies and strategies in health systems around the world.Methods and analysisThis is a scoping review protocol developed according to the Joanna Briggs Institute's manual and guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews. The search for articles will be performed in the following Embase, Medline/Pubmed, Scopus, Web of Science and Cumulative Index to Nursing and Allied Health Literature. Searches will also be conducted on Google Scholar and grey literature (www.opengrey.eu). A descriptive analysis of studies mapped by analysis categories will be performed. The results will be presented through a narrative summary of the mapped findings to verify how the results correlate with the objective and research question of the review.Ethics and disseminationThe study does not require an ethical review due to its nature. The submission of results for publication in a peer-reviewed journal and presentation at a scientific conference is expected. LINK TO THE PROTOCOL RECORD IN THE OPEN SCIENCE FRAMEWORK OSF: https://DOI.org/10.17605/OSF.IO/2KMTS.
| S-EPMC10030568 | biostudies-literature
Project description:BackgroundEvidence suggests that social networks of patients with psychotic disorders influence symptoms, quality of life and treatment outcomes. It is therefore important to assess social networks for which appropriate and preferably established instruments should be used.AimsTo identify instruments assessing social networks in studies of patients with psychotic disorders and explore their properties.MethodA systematic search of electronic databases was conducted to identify studies that used a measure of social networks in patients with psychotic disorders.ResultsEight instruments were identified, all of which had been developed before 1991. They have been used in 65 studies (total N of patients = 8,522). They assess one or more aspects of social networks such as their size, structure, dimensionality and quality. Most instruments have various shortcomings, including questionable inter-rater and test-retest reliability.ConclusionsThe assessment of social networks in patients with psychotic disorders is characterized by a variety of approaches which may reflect the complexity of the construct. Further research on social networks in patients with psychotic disorders would benefit from advanced and more precise instruments using comparable definitions of and timescales for social networks across studies.
| S-EPMC4692496 | biostudies-literature
Project description:Permanent functional impairment (PFI) of the spine is a rating system used by compensation authorities, such as workers compensation boards, to establish an appropriate level of financial compensation for persistent loss of function. Determination of PFI of the spine is commonly based on the assessment of spinal movement combined with other measures of physical and functional impairments; however, the reliability and validity of the measurement instruments used for these evaluations have yet to be established. The aim of this study is to systematically review and synthesise the literature concerning measurement properties of the various and different instruments used for assessing PFI of the spine.Three conceptual groups of terms (1) PFI, (2) spinal disorder and (3) measurement properties will be combined to search Medline, EMBASE, CINAHL, Web of Science, Scopus, PEDro, OTSeeker and Health and Safety Science Abstracts. We will examine peer-reviewed, full-text articles over the full available date range. Two reviewers will independently screen citations (title, abstract and full text) and perform data extraction. Included studies will be appraised as to their methodological quality using the COnsensus-based Standards for the selection of health Measurement INstruments criteria. Findings will be summarised and presented descriptively, with meta-analysis pursued as appropriate.This review will summarise the current level of evidence of measurement properties of instruments used for assessing PFI of the spine. Findings of this review may be applicable to clinicians, policy-makers, workers' compensation boards, other insurers and health and safety organisations. The findings will likely provide a foundation and direction for future research priorities for assessing spinal PFI.CRD42017060390.
| S-EPMC5829857 | biostudies-other
Project description:OBJECTIVE:Improving health literacy at an early age is crucial to personal health and development. Although health literacy in children and adolescents has gained momentum in the past decade, it remains an under-researched area, particularly health literacy measurement. This study aimed to examine the quality of health literacy instruments used in children and adolescents and to identify the best instrument for field use. DESIGN:Systematic review. SETTING:A wide range of settings including schools, clinics and communities. PARTICIPANTS:Children and/or adolescents aged 6-24 years. PRIMARY AND SECONDARY OUTCOME MEASURES:Measurement properties (reliability, validity and responsiveness) and other important characteristics (eg, health topics, components or scoring systems) of health literacy instruments. RESULTS:There were 29 health literacy instruments identified from the screening process. When measuring health literacy in children and adolescents, researchers mainly focus on the functional domain (basic skills in reading and writing) and consider participant characteristics of developmental change (of cognitive ability), dependency (on parents) and demographic patterns (eg, racial/ethnic backgrounds), less on differential epidemiology (of health and illness). The methodological quality of included studies as assessed via measurement properties varied from poor to excellent. More than half (62.9%) of measurement properties were unknown, due to either poor methodological quality of included studies or a lack of reporting or assessment. The 8-item Health Literacy Assessment Tool (HLAT-8) showed best evidence on construct validity, and the Health Literacy Measure for Adolescents showed best evidence on reliability. CONCLUSIONS:More rigorous and high-quality studies are needed to fill the knowledge gap in measurement properties of health literacy instruments. Although it is challenging to draw a robust conclusion about which instrument is the most reliable and the most valid, this review provides important evidence that supports the use of the HLAT-8 to measure childhood and adolescent health literacy in future school-based research.
| S-EPMC6009458 | biostudies-other