Dataset Information

Validation of the Lean Healthcare Implementation Self-Assessment Instrument (LHISI) in the finnish healthcare context.

ABSTRACT:

Background

Lean management is growing in popularity in the healthcare sector worldwide, yet healthcare organizations are struggling with assessing the maturity of their Lean implementation and monitoring its change over time. Most existing methods for such assessments are time consuming, require site visits by external consultants, and lack frontline involvement. The original Lean Healthcare Implementation Self-Assessment Instrument (LHISI) was developed by the Center for Lean Engagement and Research (CLEAR), University of California, Berkeley as a Lean principles-based survey instrument that avoids the above problems. We validated the original LHISI in the context of Finnish healthcare.

Methods

The original HISI survey was sent over a secure organizational email system to the over 26,000 employees of the Hospital District of Helsinki and Uusimaa in March 2020. The data were randomly split with one part used to carry out an exploratory factor analysis (EFA), and the other for testing the resulting model using confirmatory factor analysis (CFA).

Results

A total of 6073 employees responded to the LHISI survey, for an overall response rate of 23%. The results indicated that the 43 items used in the original LHISI can be reduced to 25 items, and these items measure a five-dimensional model of the progress of Lean implementation: leadership, commitment, standard work, communication, and daily management system. In comparison with a single-factor model, the fit measures for the 5-factor model were better: smaller X², larger comparative fit index (CFI), smaller root mean square error of approximation (RMSEA), and smaller standardized root mean square residual (SRMR).

Conclusions

The 25 item LHISI is valid and feasible to use in the context of Finnish healthcare. The LHISI allows the organization to self-monitor the progress of its Lean implementation and provides the leadership with actionable knowledge to guide the path towards Lean maturity across the organization. Our findings encourage further studies on the adoption and validation of the LHISI in healthcare organizations worldwide.

SUBMITTER: Reponen E

PROVIDER: S-EPMC8638099 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe National Immunization Program Information System (SIPNI - Sistema de Informação do Programa Nacional de Imunização) in Brazil is a technological innovation management tool that enhances the performance of managers and health professionals in the evaluation and monitoring of immunization activities. In the country, the decentralization of the System is at an advanced stage, but it still faces challenges regarding its operation and use, impacting on its results. This study aims to evaluate the deployment of SIPNI in the state of Minas Gerais, in 2017.MethodCross-section study performed in Primary Healthcare vaccination rooms in 54 municipalities in the Brazilian state of Minas Gerais, in 2017. A multidimensional questionnaire was used with nursing professionals who work in vaccination rooms, containing questions about the structure (presence of an internet-connected computer, instruction manual, software version, IT professional for technical support, trained healthcare professional, use of communication channels to obtain system information) and the process (activities performed by the staff to operate the immunization information system) of their work. Those questions refer to the components of the information system: system management, immunized-patient records, and Movement of Immunobiological. Implementation Degree (ID) was defined by a score system with different weights for each criterion, according to the importance level observed in it, with a rating of: adequate, partially adequate, inadequate and critically inadequate. For data analysis, median was used as the summary measure, and Pearson's Chi-Squared Test was used for proportion comparison.ResultsMunicipal SIPNI is not adequately implemented and that results mainly from the actions performed in health service units, indicating problems in the use of technology by professionals working in vaccination rooms. The structure was better evaluated than the process, presenting IDs of 70.9 and 59.5%, respectively. Insufficient internet access, inadequate use of communication channels, and lack of professional qualification were some of the identified structural issues. "Movement of Immunobiological" was the best-ranked component (ID = 68.5%), followed by "immunized patient records" (ID = 59.3%) and "SIPNI management" (ID = 50.7%). Partial performance of SIPNI is independent of population size in the municipality and of FSH coverage.ConclusionsSIPNI is still an underutilized technological innovation. There are challenges that must be overcome, such as implementation of the final web version, internet connectivity, and capabilities aimed at the use of information generated by technology. Nevertheless, perspectives regarding SIPNI are positive, with functionalities to optimize activities in vaccination rooms.

Project description:BackgroundThe implementation of evidence-based healthcare interventions is challenging, with a 17-year gap identified between the generation of evidence and its implementation in routine practice. Although contextual factors such as culture and leadership are strong influences for successful implementation, context remains poorly understood, with a lack of consensus regarding how it should be defined and captured within research. This study addresses this issue by providing insight into how context is defined and assessed within healthcare implementation science literature and develops a definition to enable effective measurement of context.MethodsMedline, PsychInfo, CINAHL and EMBASE were searched. Articles were included if studies were empirical and evaluated context during the implementation of a healthcare initiative. These English language articles were published in the previous 10 years and included a definition and assessment of context. Results were synthesised using a narrative approach.ResultsThree thousand and twenty-one search records were obtained of which 64 met the eligibility criteria and were included in the review. Studies used a variety of definitions in terms of the level of detail and explanation provided. Some listed contextual factors (n = 19) while others documented sub-elements of a framework that included context (n = 19). The remaining studies provide a rich definition of general context (n = 11) or aspects of context (n = 15). The Alberta Context Tool was the most frequently used quantitative measure (n = 4), while qualitative papers used a range of frameworks to evaluate context. Mixed methods studies used diverse approaches; some used frameworks to inform the methods chosen while others used quantitative measures to inform qualitative data collection. Most studies (n = 50) applied the chosen measure to all aspects of study design with a majority analysing context at an individual level (n = 29).ConclusionsThis review highlighted inconsistencies in defining and measuring context which emphasised the need to develop an operational definition. By providing this consensus, improvements in implementation processes may result, as a common understanding will help researchers to appropriately account for context in research.

Project description:BackgroundSelf-reported mood is a valuable clinical data source regarding disease state and course in patients with mood disorders. However, validated, quick, and scalable digital self-report measures that can also detect relapse are still not available for clinical care.ObjectiveIn this study, we aim to validate the newly developed ASERT (Aktibipo Self-rating) questionnaire-a 10-item, mobile app-based, self-report mood questionnaire consisting of 4 depression, 4 mania, and 2 nonspecific symptom items, each with 5 possible answers. The validation data set is a subset of the ongoing observational longitudinal AKTIBIPO400 study for the long-term monitoring of mood and activity (via actigraphy) in patients with bipolar disorder (BD). Patients with confirmed BD are included and monitored with weekly ASERT questionnaires and monthly clinical scales (Montgomery-Åsberg Depression Rating Scale [MADRS] and Young Mania Rating Scale [YMRS]).MethodsThe content validity of the ASERT questionnaire was assessed using principal component analysis, and the Cronbach α was used to assess the internal consistency of each factor. The convergent validity of the depressive or manic items of the ASERT questionnaire with the MADRS and YMRS, respectively, was assessed using a linear mixed-effects model and linear correlation analyses. In addition, we investigated the capability of the ASERT questionnaire to distinguish relapse (YMRS≥15 and MADRS≥15) from a nonrelapse (interepisode) state (YMRS<15 and MADRS<15) using a logistic mixed-effects model.ResultsA total of 99 patients with BD were included in this study (follow-up: mean 754 days, SD 266) and completed an average of 78.1% (SD 18.3%) of the requested ASERT assessments (completion time for the 10 ASERT questions: median 24.0 seconds) across all patients in this study. The ASERT depression items were highly associated with MADRS total scores (P<.001; bootstrap). Similarly, ASERT mania items were highly associated with YMRS total scores (P<.001; bootstrap). Furthermore, the logistic mixed-effects regression model for scale-based relapse detection showed high detection accuracy in a repeated holdout validation for both depression (accuracy=85%; sensitivity=69.9%; specificity=88.4%; area under the receiver operating characteristic curve=0.880) and mania (accuracy=87.5%; sensitivity=64.9%; specificity=89.9%; area under the receiver operating characteristic curve=0.844).ConclusionsThe ASERT questionnaire is a quick and acceptable mood monitoring tool that is administered via a smartphone app. The questionnaire has a good capability to detect the worsening of clinical symptoms in a long-term monitoring scenario.