Assessing the maturity of the healthcare system for integrated care: testing measurement properties of the SCIROCCO tool.
Ontology highlight
ABSTRACT:
SUBMITTER: Grooten L
PROVIDER: S-EPMC6423766 | biostudies-literature | 2019 Mar
REPOSITORIES: biostudies-literature
Publications
Assessing the maturity of the healthcare system for integrated care: testing measurement properties of the SCIROCCO tool.
Grooten Liset L Vrijhoef Hubertus Johannes Maria HJM Calciolari Stefano S Ortiz Laura Guadalupe González LGG Janečková Marcela M Minkman Mirella M N MMN Devroey Dirk D
BMC medical research methodology 20190318 1
<h4>Background</h4>The Scaling Integrated Care in Context (SCIROCCO) tool has been developed to facilitate knowledge transfer and learning about the implementation and scaling-up of integrated care in European regions. To adequately test the functionality of the tool in assessing the maturity for integrated care within regions, this study evaluated its structural validity, internal consistency and convergent validity.<h4>Methods</h4>Exploratory factor analysis was used to investigate the structu ...[more]
Similar Datasets
Project description:ObjectivesTo assess the maturity of the Swiss healthcare system for integrated care and to explore whether this maturity varied according to several variables.DesignA Swiss nationwide individual electronic survey in November 2019.Setting and populationStakeholders identified via lists of the Swiss Forum for Integrated Care and of the integrated care unit of the Swiss Federal Office of Public Health, and representatives of 26 cantonal public health departments, were invited to participate.Primary outcome measureThe outcome was the maturity of the Swiss healthcare system for integrated care, measured with the Scaling Integrated Care in Context maturity model tool (SCIROCCO tool), which comprises 12 dimensions and questions rated on a 6-point scale.AnalysisUnivariate analyses were first performed, followed by bivariate analyses, to find out whether maturity varied according to working linguistic region, healthcare profession, main domain of professional activity, implication in integrated care, attitude towards integrated care and attitude towards the Swiss healthcare system.ResultsThe 642 respondents were 53.7 years on average, 42.5% were women, 60.0% and 20.7% worked in the German and French-speaking parts of Switzerland, respectively. Overall, the maturity of the Swiss healthcare system for integrated care was evaluated as low, with dimension means ranging from 1.0 (±1.0) for the 'Funding' dimension to a maximum of 2.7 (±1.1) for 'eHealth Services'. Results only varied according to the working linguistic region.ConclusionsResults highlight a limited maturity of the Swiss healthcare system for integrated care, as assessed at a national level by a large and varied number of healthcare stakeholders. They represent important information for the further development of integrated care in Switzerland, and should help identify areas requiring attention for a successful transformation of the Swiss healthcare system towards more integrated care.
| S-EPMC7907879 | biostudies-literature
Project description:BACKGROUND:The science of measuring and reporting on the performance of healthcare systems is rapidly evolving. In the past decade, across many jurisdictions, organisations tasked with monitoring progress towards reform targets have broadened their purview to take a more system-functioning approach. Their aim is to bring clarity to performance assessment, using relevant and robust concepts - and avoiding reductionist measures - to build a whole-of-system view of performance. Existing performance frameworks are not fully aligned with these developments. METHODS:An eight stage process to develop a conceptual framework incorporated literature review, mapping, categorisation, integration, synthesis and validation of performance constructs that have been used by organisations and researchers in order to assess, reflect and report on healthcare performance. RESULTS:A total of 19 performance frameworks were identified and included in the review. Existing frameworks mostly adopted either a logic model (inputs, outputs and outcomes), a functional, or a goal-achievement approach. The mapping process identified 110 performance terms and concepts. These were integrated, synthesised and resynthesised to produce a framework that features 12 derived constructs reflecting combinations of patients' needs and expectations; healthcare resources and structures; receipt and experience of healthcare services; healthcare processes, functions and context; and healthcare outcomes. The 12 constructs gauge performance in terms of coverage, accessibility, appropriateness, effectiveness, safety, productivity, efficiency, impact, sustainability, resilience, adaptability and equity. They reflect four performance perspectives (patient, population, delivery organisation and system). CONCLUSIONS:Internationally, healthcare systems and researchers have used a variety of terms to categorise indicators of healthcare performance, however few frameworks are based on a theoretically-based conceptual underpinning. The proposed framework incorporates a manageable number of performance domains that together provide a comprehensive assessment, as well as conceptual and operational clarity and coherence that support multifaceted measurement systems for healthcare.
| S-EPMC6950882 | biostudies-literature
Project description:BACKGROUND: Interpreter services for medical care increase physician-patient communication and safety, yet a "formal certification" process to demonstrate interpreter competence does not exist. Testing and training is left to individual health care facilities nationwide. Bilingual staff are often used to interpret, without any assessment of their skills. Assessing interpreters' linguistic competence and setting standards for testing is a priority. OBJECTIVE: To assess dual-role staff interpreter linguistic competence in an integrated health care system to determine skill qualification to work as medical interpreters. DESIGN: Dual-role staff interpreters voluntarily completed a linguistic competency assessment using a test developed by a language school to measure comprehension, completeness, and vocabulary through written and oral assessment in English and the second language. Pass levels were predetermined by school as not passing, basic (limited ability to read, write, and speak English and the second language) and medical interpreter level. Five staff-interpreter focus groups discussed experiences as interpreters and with language test. RESULTS: A total of 840 dual-role staff interpreters were tested for Spanish (75%), Chinese (12%), and Russian (5%) language competence. Most dual-role interpreters serve as administrative assistants (39%), medical assistants (27%), and clinical staff (17%). Two percent did not pass, 21% passed at basic level, 77% passed at medical interpreter level. Staff that passed at the basic level was prone to interpretation errors, including omissions and word confusion. Focus groups revealed acceptance of exam process and feelings of increased validation in interpreter role. CONCLUSIONS: We found that about 1 in 5 dual-role staff interpreters at a large health care organization had insufficient bilingual skills to serve as interpreters in a medical encounter. Health care organizations that depend on dual-role staff interpreters should consider assessing staff English and second language skills.
| S-EPMC2078538 | biostudies-other
Project description:Policy Points: Investigations on systematic methodologies for measuring integrated care should coincide with the growing interest in this field of research. A systematic review of instruments provides insights into integrated care measurement, including setting the research agenda for validating available instruments and informing the decision to develop new ones. This study is the first systematic review of instruments measuring integrated care with an evidence synthesis of the measurement properties. We found 209 index instruments measuring different constructs related to integrated care; the strength of evidence on the adequacy of the majority of their measurement properties remained largely unassessed.Integrated care is an important strategy for increasing health system performance. Despite its growing significance, detailed evidence on the measurement properties of integrated care instruments remains vague and limited. Our systematic review aims to provide evidence on the state of the art in measuring integrated care.Our comprehensive systematic review framework builds on the Rainbow Model for Integrated Care (RMIC). We searched MEDLINE/PubMed for published articles on the measurement properties of instruments measuring integrated care and identified eligible articles using a standard set of selection criteria. We assessed the methodological quality of every validation study reported using the COSMIN checklist and extracted data on study and instrument characteristics. We also evaluated the measurement properties of each examined instrument per validation study and provided a best evidence synthesis on the adequacy of measurement properties of the index instruments.From the 300 eligible articles, we assessed the methodological quality of 379 validation studies from which we identified 209 index instruments measuring integrated care constructs. The majority of studies reported on instruments measuring constructs related to care integration (33%) and patient-centered care (49%); fewer studies measured care continuity/comprehensive care (15%) and care coordination/case management (3%). We mapped 84% of the measured constructs to the clinical integration domain of the RMIC, with fewer constructs related to the domains of professional (3.7%), organizational (3.4%), and functional (0.5%) integration. Only 8% of the instruments were mapped to a combination of domains; none were mapped exclusively to the system or normative integration domains. The majority of instruments were administered to either patients (60%) or health care providers (20%). Of the measurement properties, responsiveness (4%), measurement error (7%), and criterion (12%) and cross-cultural validity (14%) were less commonly reported. We found <50% of the validation studies to be of good or excellent quality for any of the measurement properties. Only a minority of index instruments showed strong evidence of positive findings for internal consistency (15%), content validity (19%), and structural validity (7%); with moderate evidence of positive findings for internal consistency (14%) and construct validity (14%).Our results suggest that the quality of measurement properties of instruments measuring integrated care is in need of improvement with the less-studied constructs and domains to become part of newly developed instruments.
| S-EPMC5192798 | biostudies-other
Project description:ObjectiveThe sleep of healthcare students is worth discovering. Mental health and self-rated health are thought to be associated with sleep quality. As such, valid instruments to assess sleep quality in healthcare students are crucial and irreplaceable. This study aimed to investigate the measurement properties of the Sleep Quality Questionnaire (SQQ) for Chinese healthcare students.MethodsTwo longitudinal assessments were undertaken among healthcare students, with a total of 595, between December 2020 and January 2021. Measures include the Chinese version of the SQQ, Patient Health Questionnaire-4 (PHQ-4), Self-Rated Health Questionnaire (SRHQ), and sociodemographic questionnaire. Structural validity through confirmatory factor analysis (CFA) was conducted to examine factor structure of the SQQ. T-tests and ANOVAs were used to examine sociodemographic differences in sleep quality scores. Multi Group CFA and longitudinal CFA were respectively used to assess cross-sectional invariance and longitudinal invariance across two-time interval, i.e., cross-cultural validity. Construct validity, internal consistency, and test-retest reliability were correspondingly examined via Spearman correlation, Cronbach's alpha and McDonald's omega, and intraclass correlation coefficient. Multiple linear regression analysis was performed to examine incremental validity of the SQQ based on the PHQ-4 and SRHQ as indicators of the criterion variables.ResultsCFA results suggested that the two-factor model of the SQQ-9 (item 2 excluded) had the best fit. The SQQ-9 scores differed significantly by age, grade, academic stage, hobby, stress coping strategy, anxiety, depression, and self-rated health subgroups. Measurement invariance was supported in terms of aforesaid subgroups and across two time intervals. In correlation and regression analyses, anxiety, depression, and self-rated health were moderately strong predictors of sleep quality. The SQQ-9 had good internal consistency and test-retest reliability.ConclusionGood measurement properties suggest that the SQQ is a promising and practical measurement instrument for assessing sleep quality of Chinese healthcare students.
| S-EPMC10799451 | biostudies-literature
Project description:ObjectivesNon-traumatic extremity injuries are particularly common in sports, representing a significant economic, academic, and psychosocial burden on athletes. Proposed musculoskeletal risk factors for increased injury and decreased performance in athletes include movement pattern inefficiency, decreased regional stability, decreased mobility, and asymmetrical movement. The Movement System Screening Tool (MSST) is a comprehensive screening tool designed to assess these factors. Thus, the purpose of this study was to describe the development and determine the content and construct validity and inter-rater reliability of the MSST.MethodsA modified Delphi panel of experts determined content validity. 80 athletes (40 with and 40 without a current non-traumatic shoulder injury) completed 21 clinical tests, with exploratory factor analysis and known group analysis performed to determine construct validity. Two independent raters were used to establish individual item and composite score inter-rater reliability.ResultsExploratory factor analysis identified three of the four apriori constructs over 7 factors (14 tests), representing 63% of the variance. Known group analysis revealed a significantly lower composite score in athletes with vs. without a current non-traumatic shoulder injury (56.9±5.8 vs. 62.7±4.5, respectively). A preliminary cut score of 62 was chosen with sensitivity of 85% and specificity of 44%. Composite score inter-rater reliability was excellent ICC (2,1)=0.94, 95% CI (0.91, 0.96) and item reliability ranged from κ=.57 to 1.00.ConclusionsThe MSST possesses constructs representative of injury risk and measurement properties acceptable for use in clinical settings. Comprehensive screens with construct validity and known measurement error are needed not only to identify athletes at risk of injury, but also provide an instrument that can be used in studies that seek to validate training approaches proposed to change movement impairment and injury risk in athletes.
| S-EPMC7779966 | biostudies-literature
Project description:Introduction: Care integration in primary elderly care is suboptimal. Validated instruments are needed to enable the implementation of integrated primary care. We aimed to assess construct validity of the Rainbow Model of Integrated Care measurement tool (RMIC-MT) for healthcare professionals working in an integrated primary elderly care setting in the Netherlands. Methods: In a cross-sectional study, the RMIC-MT, a 36-item questionnaire covering all domains of the Rainbow Model of Integrated Care (RMIC), was sent out to local networks of primary elderly care professionals. Confirmatory factor analysis with maximum likelihood estimation was used for the validation of the factor structure of the RMIC-MT. Model fit was assessed by the chi-square test and fit indices. Results: The RMIC-MT was completed by 323 professionals, primarily general practitioners, community nurses, practice nurses, and case managers. Confirmatory factor analysis and corresponding fit indices showed moderate to good fit, thereby confirming a nine factor model with a total of 36 items. Conclusions: The RMIC-MT is promising for the primary elderly care setting in the Netherlands. It can be used for evaluating integrated care initiatives in a primary care setting, thereby contributing to implementation of integrated primary elderly care.
| S-EPMC9936912 | biostudies-literature
Project description:ObjectiveWe assessed equity in the uptake of remote foot temperature monitoring (RTM) for amputation prevention throughout a large, integrated US healthcare system between 2019 and 2021, including comparisons across facilities and between patients enrolled and eligible patients not enrolled in RTM focusing on the Reach and Adoption dimensions of the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework.Material and methodsTo assess whether there was equitable use of RTM across facilities, we examined distributions of patient demographic, geographic, and facility characteristics across facility RTM use categories (e.g., no RTM use, and low, moderate, and high RTM use) among all eligible patients (n = 46,294). Second, to understand whether, among facilities using RTM, there was equitable enrollment of patients in RTM, we compared characteristics of patients enrolled in RTM (n = 1066) relative to a group of eligible patients not enrolled in RTM (n = 27,166) using logistic regression and including all covariates.ResultsRTM use increased substantially from an average of 11 patients per month to over 40 patients per month between 2019 and 2021. High-use RTM facilities had higher complexity and a lower ratio of patients per podiatrist but did not have consistent evidence of better footcare process measures. Among facilities offering RTM, enrollment varied by age, was inversely associated with Black race (vs. white), low income, living far from specialty care, and being in the highest quartiles of telehealth use prior to enrollment. Enrollment was positively associated with having osteomyelitis, Charcot foot, a partial foot amputation, BMI≥30 kg/m2, and high outpatient utilization.ConclusionsRTM growth was concentrated in a small number of higher-resourced facilities, with evidence of lower enrollment among those who were Black and lived farther from specialty care. Future studies are needed to identify and address barriers to uptake of new interventions like RTM to prevent exacerbating existing ulceration and amputation disparities.
| S-EPMC10984545 | biostudies-literature
Project description:IntroductionLessons captured from interviews with 12 European regions are represented in a new instrument, the B3-Maturity Model (B3-MM). B3-MM aims to assess maturity along 12 dimensions reflecting the various aspects that need to be managed in order to deliver integrated care. The objective of the study was to test the content validity of B3-MM as part of SCIROCCO (Scaling Integrated Care into Context), a European Union funded project.MethodsA literature review was conducted to compare B3-MM's 12 dimensions and their measurement scales with existing measures and instruments that focus on assessing the development of integrated care. Subsequently, a three-round survey conducted through a Delphi study with international experts in the field of integrated care was performed to test the relevance of: 1) the dimensions, 2) the maturity indicators and 3) the assessment scale used in B3-MM.ResultsThe 11 articles included in the literature review confirmed all the dimensions described in the original version of B3-MM. The Delphi study rounds resulted in various phrasing amendments of indicators and assessment scale. Full agreement among the experts on the relevance of the 12 B3-MM dimensions, their indicators, and assessment scale was reached after the third Delphi round.Conclusion and discussionThe B3-MM dimensions, maturity indicators and assessment scale showed satisfactory content validity. While the B3-MM is a unique instrument based on existing knowledge and experiences of regions in integrated care, further testing is needed to explore other measurement properties of B3-MM.
| S-EPMC5853880 | biostudies-literature
Project description:BackgroundHealth insurance literacy (HIL) is crucial for individuals to make informed-decisions and navigate complex choice-based health insurance systems. However, there is a lack of evidence on HIL in countries outside the US, with Switzerland no exception.MethodsUsing the HILM-CH, a survey instrument developed to measure HIL in Switzerland, this study first describes the answers to the HILM-CH. Second, the study uses ordinary least squares and quantile regressions to investigate the associations between the HIL score and demographic, socioeconomic, health, and preference factors in the German, French, and Italian Swiss regions.ResultsA third of the population faces difficulties in finding health insurance information. Understanding it and managing the financial aspects of the Swiss health insurance system pose the biggest barriers to the population. The HIL score significantly and positively correlates with age and financial risk, while non-Swiss individuals have lower HIL scores. No association was found between HIL, gender, education and time preference. There is a small health gradient, with more doctor visits associated with higher HIL in the lowest quantiles of the HIL score. Similarly, wealthier individuals in the Swiss German part of Switzerland have a higher HIL when choosing their health insurance.ConclusionThis study provides important insights into Swiss HIL and its associated factors. These findings contribute to the international literature on HIL and highlight the importance of understanding variations in HIL and various factors in choice-based health insurance systems.
| S-EPMC10990528 | biostudies-literature