Empathy: Assessment Instruments and Psychometric Quality - A Systematic Literature Review With a Meta-Analysis of the Past Ten Years.
Ontology highlight
ABSTRACT:
SUBMITTER: de Lima FF
PROVIDER: S-EPMC8653810 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Most existing quality scales have been developed with minimal attention to accepted standards of psychometric properties. Even for those that have been used widely in medical research, limited evidence exists supporting their psychometric properties. The focus of our current study is to address this gap by evaluating the psychometrics properties of two existing quality scales that are frequently used in cancer observational research: (1) Item Bank on Risk of Bias and Precision of Observational Studies developed by the Research Triangle Institute (RTI) International and (2) Newcastle-Ottawa Quality Assessment Scale (NOQAS). We used the Rasch measurement model to evaluate the psychometric properties of two quality scales based on the ratings of 49 studies that examine firefighters' cancer incidence and mortality. Our study found that RTI and NOQAS have an acceptable item reliability. Two raters were consistent in their assessment, demonstrating high interrater reliability. We also found that NOQAS has more items that show better fit than the RTI scale. The NOQAS produced lower study quality scores with a smaller variation, suggesting that NOQAS items are much easier to rate. Our findings accord with a previous study, which conclude that the RTI scale was harder to apply and thus produces more heterogenous quality scores than NOQAS. Although both RTI and NOQAS showed high item reliability, NOQAS items are better fit to the underlying construct, showing higher validity of internal structure and stronger psychometric properties. The current study adds to our understanding of the psychometric properties of NOQAS and RTI scales for future meta-analyses of observational studies, particularly in the firefighter cancer literature.
| S-EPMC10370747 | biostudies-literature
Project description:PurposeOur objectives were primarily to review the published literature on complications in neuromuscular scoliosis (NMS) surgery and secondarily, by means of a meta-analysis, to determine the overall pooled rates (PR) of various complications associated with NMS surgery.MethodsPubMed and Embase databases were searched for studies reporting the outcomes and complications of NMS surgery, published from 1997 to May 2011. We focused on NMS as defined by the Scoliosis Research Society's classification. We measured the pooled estimate of the overall complication rates (PR) using a random effects meta-analytic model. This model considers both intra- and inter-study variation in calculating PR.ResultsSystematic review and meta-analysis were performed for 68 cohort and case-control studies with a total of 15,218 NMS patients. Pulmonary complications were the most reported (PR = 22.71 %) followed by implant complications (PR = 12.51 %), infections (PR = 10.91 %), neurological complications (PR = 3.01 %) and pseudoarthrosis (PR = 1.88 %). Revision, removal and extension of implant had highest PR (7.87 %) followed by malplacement of the pedicle screws (4.81 %). Rates of individual studies have moderate to high variability. The studies were heterogeneous in methodology and outcome types, which are plausible explanations for the variability; sensitivity analysis with respect to age at surgery, sample size, publication year and diagnosis could also partly explain this variability. In regard to surgical complications affiliated with various surgical techniques in NMS, the level of evidence of published literature ranges between 2+ to 2-; the subsequent recommendations are level C.ConclusionNMS patients have diverse and high complication rates after scoliosis surgery. High PRs of complications warrant more attention from the surgical community. Although the PR of all complications are affected by heterogeneity, they nevertheless provide valuable insights into the impact of methodological settings (sample size), patient characteristics (age at surgery), and continual advances in patient care on complication rates.
| S-EPMC3676557 | biostudies-literature
Project description:ObjectivesDoctors who wish to become general practitioners (GPs) in China are required to attend and complete general practice resident training. In the early stages of the standardized GP training system, GP training supervisors play important roles. This study aims to explore how GP residents perceive their GP supervisors, factors that affect GP residents' satisfaction level, as well as to offer suggestions based on the implications of this study.DesignWe conducted a mixed quantitative and qualitative study. Firstly, with respect to the quantitative research, we conducted a survey to investigate training satisfaction through questionnaires, then extracted and analyzed the factors that influence training satisfaction. In the qualitative study, we conducted in-depth, semistructured interviews using qualitative research criteria (COREQ)--a 32-item checklist for interviews.ParticipantsParticipants in the quantitative survey included 1172 GPs whose training time wasbetween 2008 and 2017. Afterwards, 100 participants were selected from this sample , filtered by stratified random sampling and by having provided extreme answers on the quantitative survey (less than 5% of the total sample). They were chosen for the qualitative research to conduct a more detailed investigation., This stratified random sampling was based on residents' grades, regions, and training levels (city level or county level). Extreme answers were identified as answers of "extremely good" or "extremely bad" to questions from the initial comprehensive survey of 1172 participants. Consequently, 30 participants with extreme answers were found, while the remaining 70 participants in the interviews were selected by stratified random sampling. Ultimately, this sample of participants met our information collection and sample estimation requirements.ResultsThe results show that satisfaction with GP theoretical training supervisors, GP hospital-based training supervisors, and GP community-based training supervisors differed. Considering long-term averages, the hierarchy of satisfaction is as follows: GP theoretical training supervisors > GP community-based training supervisors > GP hospital-based training supervisors. GP hospital-based training supervisors need to improve their conception of GPs, teaching methods and conscientiousness. GP community-based training supervisors need to improve their teaching methods, knowledge of clinical theory and practice ability.ConclusionsOn the one hand, teams of GP supervisors in China have gradually been established over time. On the other hand,the satisfaction tendencies of residents with respect to their GP supervisors are quite different, and teams of GP supervisors must be promoted and improved.
| S-EPMC9158279 | biostudies-literature
Project description:PurposeResearch shows that the professional healthcare working environment influences the quality of care, safety climate, productivity, and motivation, happiness, and health of staff. The purpose of this systematic literature review was to assess instruments that provide valid, reliable and succinct measures of health care professionals' work environment (WE) in hospitals.Data sourcesEmbase, Medline Ovid, Web of Science, Cochrane CENTRAL, CINAHL EBSCOhost and Google Scholar were systematically searched from inception through December 2018.Study selectionPre-defined eligibility criteria (written in English, original work-environment instrument for healthcare professionals and not a translation, describing psychometric properties as construct validity and reliability) were used to detect studies describing instruments developed to measure the working environment.Data extractionAfter screening 6397 titles and abstracts, we included 37 papers. Two reviewers independently assessed the 37 instruments on content and psychometric quality following the COSMIN guideline.Results of data synthesisOur paper analysis revealed a diversity of items measured. The items were mapped into 48 elements on aspects of the healthcare professional's WE. Quality assessment also revealed a wide range of methodological flaws in all studies.ConclusionsWe found a large variety of instruments that measure the professional healthcare environment. Analysis uncovered content diversity and diverse methodological flaws in available instruments. Two succinct, interprofessional instruments scored best on psychometrical quality and are promising for the measurement of the working environment in hospitals. However, further psychometric validation and an evaluation of their content is recommended.
| S-EPMC7654380 | biostudies-literature
Project description:BackgroundSickle cell disease (SCD) is a chronic condition associated with high mortality and morbidity. It is characterized by acute clinical symptoms such as painful vaso-occlusive crises, which can impair health-related quality of life (HRQL). This study was conducted to identify validated patient-reported outcome (PRO) instruments for use in future trials of potential treatments for SCD.MethodsA systematic literature review (SLR) was performed using MEDLINE and EMBASE to identify United States (US)-based studies published in English between 1997 and 2017 that reported on validated PRO instruments used in randomized controlled trials and real-world settings. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to assess the quality of PRO instruments.ResultsThe SLR included 21 studies assessing the psychometric properties of 24 PRO instruments. Fifteen of those instruments were developed and validated for adults and 10 for children (one instrument was used in both children and young adults aged up to 21 years). Only five of the 15 adult instruments and three of the 10 pediatric instruments were developed specifically for SCD. For most instruments, there were few or no data on validation conducted in SCD development cohorts. Of the 24 PRO instruments identified, 16 had strong internal reliability (Cronbach's α ≥0.80). There was often insufficient information to assess the content validity, construct validity, responsiveness, or test-retest reliability of the instruments identified for both child and adult populations. No validated PRO instruments measuring caregiver burden in SCD were identified.ConclusionsThe evidence on the psychometric properties of PRO instruments was limited. However, the results of this SLR provide key information on such tools to help inform the design of future clinical trials for patients with SCD in the US.
| S-EPMC5963009 | biostudies-literature
Project description:BackgroundOutcome after nerve repair of the hand needs standardized psychometrically robust measures. We aimed to systematically review the psychometric properties of available functional, motor, and sensory assessment instruments after nerve repair.MethodsThis systematic review of health measurement instruments searched databases from 1966 to 2017. Pairs of raters conducted data extraction and quality assessment using a structured tool for clinical measurement studies. Kappa correlation was used to define the agreement prior to consensus for individual items, and intraclass correlation coefficient (ICC) was used to assess reliability between raters. A narrative synthesis described quality and content of the evidence.ResultsSixteen studies were included for final critical appraisal scores. Kappa ranged from 0.31 to 0.82 and ICC was 0.81. Motor domain had manual muscle testing with Kappa from 0.72 to 0.93 and a dynamometer ICC reliability between 0.92 and 0.98. Sensory domain had touch threshold Semmes-Weinstein monofilaments (SWM) as the most responsive measure while two-point discrimination (2PD) was the least responsive (effect size 1.2 and 0.1). A stereognosis test, Shape and Texture Identification (STI), had Kappa test-retest reliability of 0.79 and inter-rater reliability of 0.61, with excellent sensibility and specificity. Manual tactile test had moderate to mild correlation with 2PD and SWM. Function domain presented Rosén-Lundborg score with Spearman correlations of 0.83 for total score. Patient-reported outcomes measurements had ICC of 0.85 and internal consistency from 0.88 to 0.96 with Patient-Rated Wrist and Hand Evaluation with higher score for reliability and Spearman correlation between 0.38 and 0.89 for validity.ConclusionsFew studies included nerve repair in their sample for the psychometric analysis of outcome measures, so moderate evidence could be confirmed. Manual muscle test and Rotterdam Intrinsic Hand Myometer dynamometer had excellent reliability but insufficient data on validity or responsiveness. Touch threshold testing was more responsive than 2PD test. The locognosia test and STI had limited but positive supporting data related to validity. Rosén-Lundborg score had emerging evidence of reliability and validity as a comprehensive outcome following nerve repair. Few questionnaires were considered reliable and valid to assess cold intolerance. There is no patient-reported outcome measurement following nerve repair that provides comprehensive assessment of symptoms and function by patient perspective.
| S-EPMC6204279 | biostudies-literature
Project description:BackgroundInfluenza A (H3N2) virus (A/H3N2) has complex antigenic evolution, resulting in frequent vaccine strain updates. We aimed to evaluate the protective effect of the vaccine strains on the circulating strains from past ten years and provide a basis for finding a broader and more efficient A/H3N2 vaccine strain.MethodsEighty-four representative circulating A/H3N2 strains were selected from 65,791 deposited sequences in 2011-2020 and pseudotyped viruses were constructed with the VSV vector. We immunized guinea pigs with DNA vaccine containing the A/H3N2 components of the vaccine strains from 2011 to 2021 and tested neutralizing antibody against the pseudotyped viruses. We used a hierarchical clustering method to classify the eighty-four representative strains into different antigenic clusters. We also immunized animals with monovalent vaccine stock of the vaccine strains for the 2020-2021 and 2021-2022 seasons and tested neutralizing antibody against the pseudotyped viruses.FindingsThe vaccine strains PE/09, VI/11 and TE/12 induced higher levels of neutralizing antibody against representative strains circulating in recommended year and the year immediately prior whereas vaccine strains HK/14, HK/19 and CA/20 induced poor neutralization against all representative strains. The representative strains were divided into five antigenic clusters (AgV), which were not identical to gene clades. The AgV5 strains were most difficult to be protected among the five clusters. Compared with single-dose immunization, three doses of monovalent vaccine stock (HK/19 or CA/20) could induce stronger and broader neutralizing antibodies against strains in each of the antigenic clusters.InterpretationThe protective effect of vaccine strains indicated that the accurate selection of A/H3N2 vaccine strains must remain a top priority. By increasing the frequency of immunization, stronger and broader neutralizing antibodies against strains in all antigenic clusters were induced, which provides direction for a new immunization strategy.FundingThis work was supported by a grant from National Key R&D Program of China (No. 2021YFC2301700).
| S-EPMC9678686 | biostudies-literature
Project description:BackgroundBone-anchored hearing systems (BAHSs) are widely used for hearing rehabilitation and are indicated in cases of conductive and mixed hearing loss and in single-sided deafness. The Ponto system, that is one available option, has been on the market since 2009.Objective of reviewThe aim of this study is to systematically review the literature reporting on the Ponto system, with regard to audiological and surgical outcomes and patient's quality-of-life scores.Type of reviewA systematic literature search was performed in the PubMed database 2009-July 2019.Search strategySearch term: ((osseointegrated hearing aid) OR (bone conduction implant) OR (bone anchored hearing) OR BAHA OR BAHS OR BAHI). Pre-defined inclusion and exclusion criteria were applied.Evaluation methodEnglish-language articles reporting original clinical data (audiological, surgical or quality-of-life outcomes) on the Ponto system were included. Articles reporting on Ponto and another BAHS system where the results on Ponto constituted less than 50% of the patient population or including only results on testband or softband devices were excluded.ResultsAudiological outcomes were discussed in 20 publications. Improvement against the unaided thresholds was demonstrated. The functional improvement was on average 33.9 dB. The effective gain or remaining air-bone gap was on average 6.7 dB. All evaluated data showed aided speech reception thresholds significantly below normal speech level. Twenty-seven publications reported surgical and follow-up data for the Ponto system. Implant survival was 97.7%, adverse skin reactions (Holgers ≥ 2) were 5% across visits and 15% across patients. No complications were life-threatening, causing permanent disability/damage or requiring a hospitalisation. Five studies reported quality of life using the Glasgow benefit inventory, 98% reported an improvement when analysing the score on an individual level.ConclusionsThe outcomes of this systematic review confirm that percutaneous systems provide consistent audiological benefits and improved quality of life for patients. Further, the review demonstrates that the percutaneous systems are safe, with relatively low complication rates. Skin-related complications are the most common complication type and are experienced by approximately one patient out of seven, or in less than one of 20 follow-up visits.
| S-EPMC7496709 | biostudies-literature
Project description:BackgroundCulinary skills are important objects of study in the field of Public Health. Studies that propose to develop instruments for assessing such construct show lack of methodological uniformity to report validity and reliability of their instruments.ObjectiveTo identify studies that have developed instruments to measure culinary skills in adult population, and critically assess their psychometric properties.DesignWe conducted a systematic review according to the PRISMA statement. We searched literature PubMed/Medline, Scopus, LILACS, and Web of Science databases until January 2021, and consulted Google Scholar for relevant grey literature. Two reviewers independently selected the studies, conducted data extraction, and assessed the psychometric quality of the instruments. A third reviewer resolved any doubts or disagreements in all steps of the systematic review.ResultsThe search identified 1148 potentially relevant studies, out of which 9 met the inclusion criteria. In addition, we included 3 studies by searching the related articles and the reference lists of these studies, totaling 12 included studies in this review. Ten studies reported the development of tools measuring culinary skills in adults and 2 studies performed cross-cultural adaptations of original instruments. We considered adequate quality of internal consistency reliability in four studies. One study received adequate rating for test-retest reliability. No studies presented adequate rating for content validity and four studies showed satisfactory results for at least one type of construct validity. One study reported criterion validity and the quality of this psychometric property was inadequate.ConclusionsWe identified many studies that surveyed culinary skills. Although the isolated measures appraised in this review show good promise in terms of quality of psychometric properties, no studies presented adequate measures for each aspect of reliability and validity. A more consistent and consensual definition of culinary skills is recommended. The flaws observed in these studies show that there is a need for ongoing research in the area of the psychometric properties of instruments assessing culinary skills.
| S-EPMC8351978 | biostudies-literature
Project description:PurposeOpioid dependence is a chronic relapsing disorder. Despite increasing research on quality of life (QOL) in people with opioid dependence, little attention has been paid to the instruments used. This systematic review examines the suitability of QOL instruments for use in opioid-dependent populations and the instruments' quality.MethodsA systematic search was performed in the databases Medline, PsycInfo, The Cochrane Library, and CINAHL. Articles were eligible if they assessed QOL of opioid-dependent populations using a validated QOL instrument. Item content relevance to opioid-dependent people was evaluated by means of content analysis, and instrument properties were assessed using minimum standards for patient-reported outcome measures.ResultsEighty-nine articles were retrieved, yielding sixteen QOL instruments, of which ten were assessed in this review. Of the ten instruments, six were disease specific, but none for opioid dependence. Two instruments had good item content relevance. The conceptual and measurement model were described in seven instruments. Four instruments were developed with input from the respective target population. Eight instruments had low respondent and administrator burden. Psychometric properties were either not assessed in opioid-dependent populations or were inconclusive or moderate.ConclusionsNo instrument scored perfectly on both the content and properties. The limited suitability of instruments for opioid-dependent people hinders accurate and sensitive measurement of QOL in this population. Future research is in need of an opioid dependence-specific QOL instrument to measure the true impact of the disease on people's lives and to evaluate treatment-related services.
| S-EPMC5681984 | biostudies-literature