Shrinkage estimators for a composite measure of quality conceptualized as a formative construct.
Ontology highlight
ABSTRACT: Objective
To demonstrate the value of shrinkage estimators when calculating a composite quality measure as the weighted average of a set of individual quality indicators.Data sources
Rates of 28 quality indicators (QIs) calculated from the minimum dataset from residents of 112 Veterans Health Administration nursing homes in fiscal years 2005-2008.Study design
We compared composite scores calculated from the 28 QIs using both observed rates and shrunken rates derived from a Bayesian multivariate normal-binomial model.Principal findings
Shrunken-rate composite scores, because they take into account unreliability of estimates from small samples and the correlation among QIs, have more intuitive appeal than observed-rate composite scores. Facilities can be profiled based on more policy-relevant measures than point estimates of composite scores, and interval estimates can be calculated without assuming the QIs are independent. Usually, shrunken-rate composite scores in 1 year are better able to predict the observed total number of QI events or the observed-rate composite scores in the following year than the initial year observed-rate composite scores.Conclusion
Shrinkage estimators can be useful when a composite measure is conceptualized as a formative construct.
SUBMITTER: Shwartz M
PROVIDER: S-EPMC3589966 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BACKGROUND:The Observable Movement Quality (OMQ) Scale measures generic movement quality. Each item of the OMQ Scale focuses on a different element; together, the 15 items assess the whole construct of movement quality. OBJECTIVE:The aim of this study was to determine the construct validity of the OMQ Scale using 7 hypotheses defined to conform to the Consensus-Based Standards for the Selection of Health Measurement Instruments. DESIGN:This was an exploratory validation study. METHODS:A pediatric physical therapist assessed motor performance in 101 children using an age-specific motor test and the OMQ Scale. The direction, magnitude, and rationale for 7 hypotheses, which concerned relationships (n = 2), probability of low scores (n = 4), and difference between diagnosis subgroups (n = 1), were defined. RESULTS:The results confirmed 6 of the 7 hypotheses, indicating sufficient construct validity. Significant positive relationships were found between OMQ Scale total scores and the severity of motor disabilities (r = 0.72) and z scores on motor tests (r = 0.60). Probabilities for low scores on OMQ Scale items-exceeding the chi-square critical value-were confirmed for children diagnosed with spasticity, psychomotor retardation, mitochondrial diseases, and ataxia; however, probabilities for low OMQ Scale item scores on strength regulation in children with ataxia were not confirmed. OMQ Scale total scores for children who were not ambulatory because of neurological conditions were significantly different from those for children who were not ambulatory because of fatigue (r = 0.66). LIMITATIONS:The sample of children was based on theoretical assumptions about relevant variations in clinical representations; on the basis of the results, it appears that children with low strength regulation were underrepresented. CONCLUSION:The confirmation of nearly all hypotheses supported the validity of the OMQ Scale for measuring movement quality in clinical practice in addition to standardized age-adequate motor performance tests.
| S-EPMC7246075 | biostudies-literature
Project description:BackgroundThe delivery of high-quality service in nursing homes and homecare requires collaboration and shared understanding among managers, employees, users and policy makers from across the healthcare system. However, conceptualizing healthcare professionals' perception of quality beyond hospital settings (e.g., its perspectives, defining attributes, quality dimensions, contextual factors, dilemmas) has rarely been done. This study therefore explores the meaning of "quality" among healthcare managers and staff in nursing homes and homecare.MethodsThe study applies a cross-sectional qualitative design with focus groups and individual interviews, to capture both depth and breadth of conceptualization of quality from healthcare professionals in nursing homes and homecare. We draw our data from 65 managers and staff in nursing homes and homecare services in Norway and the Netherlands. The participants worked as managers (n?=?40), registered nurses (RNs) or assistant nurses (n?=?25).ResultsThe analysis identified the two categories and four sub-categories: "Professional issues: more than firefighting" (subcategories "professional pride" and "competence") and "patient-centered approach: more than covering basic needs" (subcategories "dignity" and "continuity"). Quality in nursing homes and homecare is conceptualized as an ongoing process based on having the "right competence," good cooperation across professional groups, and patient-centered care, in line with professional pride and dignity for the patients.ConclusionBased on the understanding of quality among the healthcare professionals in our study, quality should encompass the softer dimensions of professional pride and competence, as well as a patient-centered approach to care. These dimensions should be factors in improvement activities and in daily practice.
| S-EPMC7847031 | biostudies-literature
Project description:PurposeTo evaluate the construct (convergent and known group) validity of the Quality-of-Life-Aged Care Consumer (QOL-ACC), an older-person-specific quality-of-life measure designed for application in quality assessment and economic evaluation in aged care.MethodsConvergent validity was assessed by examining relationships with other validated preference-based measures (EQ-5D-5L, ASCOT), quality of aged care experience (QCE-ACC) and life satisfaction (PWI) through an online survey. Known-group validity was assessed by testing the ability to discriminate varying levels of care needs, self-reported health and quality of life.ResultsOlder people (aged ≥ 65 years) receiving community-aged care (N = 313) responded; 54.6% were female, 41.8% were living alone and 56.8% were receiving higher-level care. The QOL-ACC and its six dimensions were low to moderately and significantly correlated with the EQ-5D-5L (correlation co-efficient range, ρ = 0.39-0.56). The QOL-ACC demonstrated moderate and statistically significant correlations with ASCOT (ρ = 0.61), the QCE-ACC (ρ = 0.51) and the PWI (ρ = 0.70). Respondents with poorer self-reported health status, quality of life and/or higher-level care needs demonstrated lower QOL-ACC scores (P < 0.001), providing evidence of known-group validity.ConclusionsThe study provides evidence of the construct validity of the QOL-ACC descriptive system. A preference-weighted value set is currently being developed for the QOL-ACC, which when finalised will be subjected to further validation assessments.
| S-EPMC9181894 | biostudies-literature
Project description:BACKGROUND:A poor quality diet is a well-known risk factor for many chronic diseases. However, eating a healthful diet is not always simple as many underlying factors can impede adherence. Individuals with fewer barriers are more likely to eat a healthful diet than those who have more barriers. Accurately measuring barriers to eating a healthful diet could inform personalized interventions, particularly those aiming to prevent chronic diseases. The aim of this study was to establish content validity for selected items obtained from the National Health and Nutrition Examination Survey (NHANES) database to be considered for inclusion as items on the conceptualized Dietary Health Status (DHS) instrument, which is designed to measure barriers to eating a healthful diet in adults. METHODS:The Behavioral Change Wheel hub COM-B and the Theoretical Domains Framework (TDF) were the two theoretical frameworks underpinning the development of the DHS instrument. Seven steps were conducted to create the instrument: 1) development of operational definitions for each TDF domain; 2) identification of items from the NHANES database 2011-2012; 3) screening of items to ensure inclusion of all relevant items; 4) assigning items to a theory-based domain; 5) evaluation of the items against inclusion/exclusion criteria; 6) solicitation of feedback from expert reviewers to reach consensus on inclusion into a domain; and 7) validation of items. RESULTS:A total of 170 items representing twelve domains were identified as potential barriers to eating a healthful diet-- knowledge, optimism, beliefs about consequences, beliefs about capabilities, reinforcement, memory, attention and decision processes, environmental context and resources, social influences, emotion, behavioral regulation, health identity, and functional status. CONCLUSION:Expert review consultation and a consensus approach established content validity for 12 theory-based domains comprised of 170 items identified as potential barriers to eating a healthful diet. The use of these explanatory domains may: assist researchers to better understand barriers to adult dietary practices; inform the development of a screening tool that could be used in a community setting to measure barriers to eating a healthful diet; and inform individualized interventions.
| S-EPMC6966857 | biostudies-literature
Project description:The aim of this study was to investigate the relationship between textbook outcome and survival in patients with surgically treated colon cancer. A total of 804 surgical cases were enrolled between June 1, 2010 and December 31, 2014. Textbook outcome was defined as patients who had colon cancer surgery and met the six healthcare parameters of surgery within 6 weeks, radical resection, lymph node (LN) yield ≥12, no ostomy, no adverse outcome and colonoscopy before/after surgery within 6 months. The effect of textbook outcome on 5-year disease-specific survival (DSS) was calculated using the Kaplan-Meier method. A Cox regression model was used to find significant independent variables and stratified analysis used to determine whether text-book outcome had a survival benefit. A textbook outcome was achieved in 59.5% of patients undergoing colon cancer surgery. Important obstacles to achieving textbook outcome were no stomy, no adverse outcome and LN yield ≥12. Patients with text-book outcome had statistically significant better 5-year DSS compared to those with-out (80.1% vs. 58.3%). Multivariate analyses indicated that colon cancer patients with textbook outcome had better 5-year DSS after adjusting for various confounders ([aHR], 0.44; 95% CI, 0.34-0.57). Thus, besides being an index of short-term quality of care, textbook outcomes could be used as a prognosticator of long-term outcomes, such as 5-year survival rates.
| S-EPMC7535643 | biostudies-literature
Project description:BackgroundComposite indices are single measures that combine the strengths of two or more individual measures and provide broader, easy-to-use measures for evaluation of provider performance and comparisons across units and hospitals to support quality improvement.ObjectiveThe study objective was to develop a unit-level inpatient composite nursing care quality performance index-the Pressure Ulcer and Fall Rate Quality Composite Index.DesignTwo-phase measure development study.Settings5144 patient care units in 857 United States hospitals participating in the National Database of Nursing Quality Indictors® during the year 2013.MethodsThe Pressure Ulcer and Fall Rate Quality Composite Index was developed in two phases. In Phase 1 the formula was generated using a utility function and generalized penalty analysis. Experts with experience in healthcare quality measurement provided the point of indicator equivalence. In Phase 2 initial validity evidence was gathered based on hypothesized relationships between the Pressure Ulcer and Fall Rate Quality Composite Index and other variables using two-level (unit, hospital) hierarchical linear mixed modeling.ResultsThe Pressure Ulcer and Fall Rate Quality Composite Index=100-PUR-FR, where PUR is pressure ulcer rate and FR is total fall rate. Higher scores indicate better quality. Bland-Altman plots demonstrated agreement between pairs of experts and provided evidence for inter-rater reliability of the formula. The validation process demonstrated that higher registered nurse skill mix, higher percent of registered nurses with a baccalaureate in nursing or higher degree, higher percent of registered nurses with national specialty certification, and lower percent of hours supplied by agency staff were significantly associated with higher Pressure Ulcer and Fall Rate Quality Composite Index scores. Higher percentages of unit patients at risk for a hospital-acquired pressure ulcer and higher unit rates of physical restraint use were not associated with higher Pressure Ulcer and Fall Rate Quality Composite Index scores.ConclusionsThe Pressure Ulcer and Fall Rate Quality Composite Index is a step toward providing a more holistic perspective of unit level nursing quality than individual measures and may help nurses nursing administrators obtain a broader view of which patient care units are the higher and lower performers. Further study is needed to examine the usability of the Pressure Ulcer and Fall Rate Quality Composite Index.
| S-EPMC5154684 | biostudies-literature
Project description:INTRODUCTION:We developed an evaluator-administered functional facioscapulohumeral muscular dystrophy composite outcome measure (FSHD-COM) comprising patient-identified areas of functional burden for future clinical trials. METHODS:We performed a prospective observational study of 41 patients with FSHD at 2 sites. The FSHD-COM includes functional assessment of the legs, shoulders and arms, trunk, hands, and balance/mobility. We determined the test-retest reliability and convergent validity compared to established FSHD disease metrics. RESULTS:The FSHD-COM demonstrated excellent test-retest reliability (intraclass correlation coefficient [ICC] 0.96; subscale ICC range, 0.90-0.94). Cross-sectional associations between the FSHD-COM and disease duration, clinical severity, and strength were moderate to strong (Pearson correlation coefficient range |0.51-0.92|). DISCUSSION:The FSHD-COM is a disease-relevant, functional composite outcome measure suitable for future FSHD clinical trials that shows excellent test-retest reliability and cross-sectional associations to disease measures. Future directions include determining multisite reliability, sensitivity to change, and the minimal clinically important change in the FSHD-COM. Muscle Nerve, 2018.
| S-EPMC6066464 | biostudies-literature
Project description:ObjectiveThe effect of filler content in dental restorative composites on the polymerization shrinkage stress (PS) is not straightforward and has caused much debate in the literature. Our objective in this study was to clarify the PS/filler content relationship based on analytical and experimental approaches, so that guidelines for materials comparison in terms of PS and clinical selection of dental composites with various filler content can be provided.MethodsAnalytically, a simplified model based on linear elasticity was utilized to predict PS as a function of filler content under various compliances of the testing system, a cantilever beam-based instrument used in this study. The predictions were validated by measuring PS of composites synthesized using 50/50 mixtures of two common dimethacrylate resins with a variety of filler contents.ResultsBoth experiments and predictions indicated that the influence of filler content on the PS highly depended on the compliance of the testing system. Within the clinic-relevant range of compliances and for the specific sample configuration tested, the PS increased with increasing filler content at low compliance of instrument, while increasing the compliance caused the effect of filler content on the PS to gradually diminish. Eventually, at high compliance, the PS inverted and decreased with increasing filler content.SignificanceThis compliance-dependent effect of filler content on PS suggests: (1) for materials comparison in terms of PS, the specific compliance at which the comparison being done should always be reported and (2) clinically, composites with relatively lower filler content could be selected for such cavities with relatively lower compliance (e.g. a Class-I cavity with thick tooth walls or the basal part in a cavity) and vice versa in order to reduce the final PS.
| S-EPMC4861160 | biostudies-literature
Project description:Strategic interactions have been studied extensively in the area of judgment and decision-making. However, so far no specific measure of a decision-maker's ability to be successful in strategic interactions has been proposed and tested. Our contribution is the development of a measure of strategic ability that borrows from both game theory and psychology. Such measure is aimed at providing an estimation of the likelihood of success in many social activities that involve strategic interaction among multiple decision-makers. To construct a reliable measure of strategic ability, that we propose to call "Strategic Quotient" (SQ), we designed a test where each item is a game and where, therefore, the individual obtained score depends on the distribution of choices of other decision-makers taking the test. The test is designed to provide information on the abilities related to two dimensions, mentalization and rationality, that we argue are crucial to strategic success, with each dimension being characterized by two main factors. Principal component analysis on preliminary data shows that indeed four factors (two for rationality, two for mentalization) account for strategic success in most of the strategically simpler games of the test. Moreover, two more strategically sophisticated games are inserted in the test and are used to investigate if and to what extent the four factors obtained by simpler games can predict strategic success in more sophisticated strategic interactions. Overall, the collected empirical evidence points to the possibility of building a SQ measure using only simple games designed to capture information about the four identified factors.
| S-EPMC6345706 | biostudies-literature
Project description:Several definitions and measures of financial well-being (FWB) have been proposed in the scientific literature. The Multidimensional Subjective Financial Well-being Scale (MSFWBS) stands out among these measures in its ability to account for the conceptual richness of FWB. However, the original validation study based on a confirmatory factor analytic model indicated that the factor structure of scores obtained on this instrument was acceptable at best, revealing factor correlations high enough to question the discriminant validity of the factors. To improve conceptual and operational clarity of FWB, this study assesses the psychometric properties of the MSFWBS among French-Canadian adults (n = 454), using statistical models better suited to the examination of multidimensional constructs (exploratory structural equation modeling-ESEM, and bifactor-ESEM). Our results supported a bifactor-ESEM representation of scores on the MSFWBS, and their measurement invariance across groups of participants defined on the basis of their age, sex, personal income and household income. Our results also supported the convergent (with other measures of FWB) and criterion-related (with measures of life satisfaction, perceived stress, and psychological distress) validity of scores obtained on the MSFWBS (particularly the global FWB factor). By providing an optimized measure of FWB, our study contributes to advancing research on FWB.
| S-EPMC9412911 | biostudies-literature