Challenges using electronic nursing routine data for outcome analyses: A mixed methods study.
Ontology highlight
ABSTRACT: Objectives
To explore the challenges of secondary use of routinely collected data for analyzing nursing-sensitive outcomes in Austrian acute care hospitals.Method
A convergent parallel mixed methods design was performed. We conducted a quantitative representative survey with nursing managers from 32 Austrian general acute care hospitals and 11 qualitative semi-structured interviews with nursing quality management experts. Both results were first analyzed independently and afterward merged in the discussion.Results
On average, 76% of nursing documentation is already electronically supported in the surveyed Austrian hospitals. However, existing nursing data is seldom used for secondary purposes such as nursing-sensitive outcome analyses. This is due to four major reasons: First, hospitals often do not have a data strategy for the secondary use of routine data. Second, hospitals partly lack the use of standardized and uniform nursing terminologies, especially for nursing evaluation. Third, routine nursing data is often not documented correctly and completely. Fourth, data on nursing-sensitive outcomes is usually collected in specific documentation forms not integrated into routine documentation.Conclusion
The awareness of the possibilities for secondary use of nursing data for nursing-sensitive outcome analyses in Austrian hospitals is still in its infancy. Therefore, nursing staff and nursing management must be trained to understand how to collect and process nursing data for nursing-sensitive outcome analyses. Further studies would be interesting in order to determine the factors that influence the decision-making processes for the secondary use of nursing data for outcome analyses.
SUBMITTER: Nantschev R
PROVIDER: S-EPMC8766780 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Motivated by two case studies using primary care records from the Clinical Practice Research Datalink, we describe statistical methods that facilitate the analysis of tall data, with very large numbers of observations. Our focus is on investigating the association between patient characteristics and an outcome of interest, while allowing for variation among general practices. We explore ways to fit mixed-effects models to tall data, including predictors of interest and confounding factors as covariates, and including random intercepts to allow for heterogeneity in outcome among practices. We introduce (1) weighted regression and (2) meta-analysis of estimated regression coefficients from each practice. Both methods reduce the size of the dataset, thus decreasing the time required for statistical analysis. We compare the methods to an existing subsampling approach. All methods give similar point estimates, and weighted regression and meta-analysis give similar standard errors for point estimates to analysis of the entire dataset, but the subsampling method gives larger standard errors. Where all data are discrete, weighted regression is equivalent to fitting the mixed model to the entire dataset. In the presence of a continuous covariate, meta-analysis is useful. Both methods are easy to implement in standard statistical software.
| S-EPMC6240345 | biostudies-literature
Project description:BackgroundRoutine data are increasingly used in randomised controlled trials evaluating healthcare interventions. They can aid participant identification, outcome assessment, and intervention delivery. Randomised implementation trials evaluate the effect of implementation strategies on implementation outcomes. Implementation strategies, such as reminders, are used to increase the uptake of evidence-based interventions into practice, while implementation outcomes, such as adoption, are key measures of the implementation process. The use of routine data in effectiveness trials has been explored; however, there are no reviews on implementation trials. We therefore aimed to describe how routine data have been used in randomised implementation trials and the design characteristics of these trials.MethodsWe searched MEDLINE (Ovid) and Cochrane Central Register of Controlled Trials from Jan 2000 to Dec 2021 and manually searched protocols from trial registers. We included implementation trials and type II and type III hybrid effectiveness-implementation trials conducted using routine data. We extracted quantitative and qualitative data and narratively synthesised findings.ResultsFrom 4206 titles, we included 80 trials, of which 22.5% targeted implementation of evidence-based clinical guidelines. Multicomponent implementation strategies were more commonly evaluated (70.0%) than single strategies. Most trials assessed adoption as the primary outcome (65.0%). The majority of trials extracted data from electronic health records (EHRs) (62.5%), and 91.3% used routine data for outcome ascertainment. Reported reasons for using routine data were increasing efficiency, assessing outcomes, reducing research burden, improving quality of care, identifying study samples, confirming findings, and assessing representativeness. Data quality, the EHR system, research governance, and external factors such as government policy could act either as facilitators or barriers.ConclusionsAdherence to guidance on designing and reporting implementation studies, and specifically to harmonise the language used in describing implementation strategies and implementation outcomes, would aid identification of studies and data extraction. Routine healthcare data are widely used for participant identification, outcome assessment and intervention delivery. Researchers should familiarise themselves with the barriers and facilitators to using routine data, and efforts could be made to improve data quality to overcome some of the barriers.RegistrationPROSPERO CRD42022292321.
| S-EPMC10544368 | biostudies-literature
Project description:Backgroundfrailty is an especially problematic expression of population ageing. International guidelines recommend routine identification of frailty to provide evidence-based treatment, but currently available tools require additional resource.Objectivesto develop and validate an electronic frailty index (eFI) using routinely available primary care electronic health record data.Study design and settingretrospective cohort study. Development and internal validation cohorts were established using a randomly split sample of the ResearchOne primary care database. External validation cohort established using THIN database.Participantspatients aged 65-95, registered with a ResearchOne or THIN practice on 14 October 2008.Predictorswe constructed the eFI using the cumulative deficit frailty model as our theoretical framework. The eFI score is calculated by the presence or absence of individual deficits as a proportion of the total possible. Categories of fit, mild, moderate and severe frailty were defined using population quartiles.Outcomesoutcomes were 1-, 3- and 5-year mortality, hospitalisation and nursing home admission.Statistical analysishazard ratios (HRs) were estimated using bivariate and multivariate Cox regression analyses. Discrimination was assessed using receiver operating characteristic (ROC) curves. Calibration was assessed using pseudo-R(2) estimates.Resultswe include data from a total of 931,541 patients. The eFI incorporates 36 deficits constructed using 2,171 CTV3 codes. One-year adjusted HR for mortality was 1.92 (95% CI 1.81-2.04) for mild frailty, 3.10 (95% CI 2.91-3.31) for moderate frailty and 4.52 (95% CI 4.16-4.91) for severe frailty. Corresponding estimates for hospitalisation were 1.93 (95% CI 1.86-2.01), 3.04 (95% CI 2.90-3.19) and 4.73 (95% CI 4.43-5.06) and for nursing home admission were 1.89 (95% CI 1.63-2.15), 3.19 (95% CI 2.73-3.73) and 4.76 (95% CI 3.92-5.77), with good to moderate discrimination but low calibration estimates.Conclusionsthe eFI uses routine data to identify older people with mild, moderate and severe frailty, with robust predictive validity for outcomes of mortality, hospitalisation and nursing home admission. Routine implementation of the eFI could enable delivery of evidence-based interventions to improve outcomes for this vulnerable group.
| S-EPMC4846793 | biostudies-literature
Project description:Deep learning has recently gained popularity in digital pathology due to its high prediction quality. However, the medical domain requires explanation and insight for a better understanding beyond standard quantitative performance evaluation. Recently, many explanation methods have emerged. This work shows how heatmaps generated by these explanation methods allow to resolve common challenges encountered in deep learning-based digital histopathology analyses. We elaborate on biases which are typically inherent in histopathological image data. In the binary classification task of tumour tissue discrimination in publicly available haematoxylin-eosin-stained images of various tumour entities, we investigate three types of biases: (1) biases which affect the entire dataset, (2) biases which are by chance correlated with class labels and (3) sampling biases. While standard analyses focus on patch-level evaluation, we advocate pixel-wise heatmaps, which offer a more precise and versatile diagnostic instrument. This insight is shown to not only be helpful to detect but also to remove the effects of common hidden biases, which improves generalisation within and across datasets. For example, we could see a trend of improved area under the receiver operating characteristic (ROC) curve by 5% when reducing a labelling bias. Explanation techniques are thus demonstrated to be a helpful and highly relevant tool for the development and the deployment phases within the life cycle of real-world applications in digital pathology.
| S-EPMC7156509 | biostudies-literature
Project description:BackgroundTeaching assistants (TAs) serve an important role in schools of nursing, but their educational needs are poorly understood.PurposeTo better prepare TAs, our School of Nursing identified and evaluated current TA practices to create tailored educational materials.MethodsA 16-item survey captured how faculty used TAs. Focus groups with current faculty and former TAs explored the TA role and identified areas to target for future training. Focus groups were analyzed using thematic content analysis.ResultsSurvey response rate was high (88%). Most faculty meet with TAs before the semester, and typical TA duties included attending lecture (71%) and facilitating examination review sessions (64%). Qualitative themes focused on faculty/TA communication, faculty guidance, knowing the policies, and TA/student boundary negotiation.ConclusionsFindings demonstrate the importance of preparing TAs. Since this study, the university and school of nursing have each developed educational materials to better prepare TAs and faculty.
| S-EPMC8435036 | biostudies-literature
Project description:ObjectiveA routine health information system (RHIS) enables decision making in the healthcare system. We aimed to analyse data quality at the district and regional level and explore factors and perceptions affecting the quality and use of routine data.DesignThis was a mixed-methods study. We used the WHO toolkit for analysing data quality and interviewed staff at the point of data generation and along with the flow of data. Data were analysed using the Performance of Routine Information System Management framework.SettingThis study was performed in eight districts in four regions of Ethiopia. The study was nested within a 2-year programme of the Operational Research and Coaching for government Analysts.ParticipantsWe visited 45 health posts, 1 district hospital, 16 health centres and 8 district offices for analysis of routine RHIS data and interviewed 117 staff members for the qualitative assessment.Outcome measuresWe assessed availability of source documents, completeness, timeliness and accuracy of reporting of routine data, and explored data quality and use perceptions.ResultsThere was variable quality of both indicator and data element. Data on maternal health and immunisation were of higher quality than data on child nutrition. Issues ranged from simple organisational factors, such as availability of register books, to intricate technical issues, like complexity of indicators and choice of denominators based on population estimates. Respondents showed knowledge of the reporting procedures, but also demonstrated limited skills, lack of supportive supervision and reporting to please the next level. We saw limited examples of the use of data by the staff who were responsible for data reporting.ConclusionWe identified important organisational, technical, behavioural and process factors that need further attention to improve the quality and use of RHIS data in Ethiopia.
| S-EPMC8710857 | biostudies-literature
Project description:BackgroundAntibiotics are frequently prescribed in nursing homes; national data describing facility-level antibiotic use are lacking. The objective of this analysis was to describe variability in antibiotic use in nursing homes across the United States using electronic health record orders.MethodsA retrospective cohort study of antibiotic orders for 309,884 residents in 1,664 US nursing homes in 2016 were included in the analysis. Antibiotic use rates were calculated as antibiotic days of therapy (DOT) per 1,000 resident days and were compared by type of stay (short stay ≤100 days vs long stay >100 days). Prescribing indications and the duration of nursing home-initiated antibiotic orders were described. Facility-level correlations of antibiotic use, adjusting for resident health and facility characteristics, were assessed using multivariate linear regression models.ResultsIn 2016, 54% of residents received at least 1 systemic antibiotic. The overall rate of antibiotic use was 88 DOT per 1,000 resident days. The 3 most common antibiotic classes prescribed were fluoroquinolones (18%), cephalosporins (18%), and urinary anti-infectives (9%). Antibiotics were most frequently prescribed for urinary tract infections, and the median duration of an antibiotic course was 7 days (interquartile range, 5-10). Higher facility antibiotic use rates correlated positively with higher proportions of short-stay residents, for-profit ownership, residents with low cognitive performance, and having at least 1 resident on a ventilator. Available facility-level characteristics only predicted a small proportion of variability observed (Model R2 version 0.24 software).ConclusionsUsing electronic health record orders, variability was found among US nursing-home antibiotic prescribing practices, highlighting potential opportunities for targeted improvement of prescribing practices.
| S-EPMC9495428 | biostudies-literature
Project description:Background and objectivesPatient-reported outcome measures invite patients to self-report aspects of their quality of life and have been reported to enhance communication with clinicians. We aimed to examine how routine use of patient-reported outcome measures in in-center hemodialysis units influenced patient-clinician communication.Design, setting, participants, & measurementsA concurrent, longitudinal, mixed-methods approach was used. We used data from a cluster randomized controlled trial of 17 hemodialysis units in northern Alberta that introduced a patient-reported outcome measures intervention. Patient-clinician communication was assessed using a modified Communication Assessment Tool. Using interpretive description, we explored patients' and nurses' perceptions of communication pertaining to routine patient-reported outcome measure use. Through purposeful sampling, we interviewed ten patients and eight nurses and conducted six observations in the dialysis units, which were documented in field notes. We reviewed 779 patient responses to open-ended survey questions from randomized controlled trial data. Qualitative data were thematically analyzed.ResultsOverall, patient-reported outcome measure use did not substantively improve patient-clinician communication. There was a small positive change in mean total Communication Assessment Tool scores (range, 1-5) from baseline to 12 months in patient-reported outcome measure use units (0.25) but little difference from control group units that did not use patient-reported outcome measures (0.21). The qualitative findings provide in-depth insights into why patient-reported outcome measure use did not improve patient-clinician communication. The purpose of patient-reported outcome measure use was not always understood by patients and clinicians; patient-reported outcome measures were not implemented as originally intended in the trial, despite clinician training; there were challenges using patient-reported outcome measures as a means to communicate; and patient-reported outcome measure use was perceived to have limited value.ConclusionsWhile patient-reported outcome measures use did not improve patient-clinician communication, qualitative data suggest implementation challenges, including limited clarity of purpose and perceived limited value, that may have limited the effectiveness of the intervention.
| S-EPMC9718041 | biostudies-literature
Project description:BackgroundIncreased pressure for evidence-based practice in nursing necessitates that researchers use effective approaches. Mixed-methods research (MMR) has potential to improve the knowledge and implementation of evidence-based nursing (EBN) by generating outcome-based and contextually-focused evidence.AimsTo identify methodological trends in how MMR is used in EBN research.MethodsSearches were completed in PubMed, CINAHL, and Google Scholar using the terms "nursing", "mixed-methods", and "evidence-based". Seventy-two articles using MMR to address EBN and published 2000-2021 were reviewed across content themes and methodological domains of the Socio-Ecological Framework for MMR.ResultsMixed-methods research has been used to study how EBN strategies are perceived, developed and assessed, and implemented or evaluated. A few studies provided an MMR definition reflecting the methods perspective, and the dominant MMR rationale was gaining a comprehensive understanding of the issue. The leading design was concurrent, and half of studies intersected MMR with evaluation, action/participatory, and/or case-study approaches. Research quality was primarily assessed using criteria specific to quantitative and qualitative approaches.ConclusionsMixed-methods research has great potential to enhance EBN research by generating more clinically useful findings and helping nurses understand how to identify and implement the best available research evidence in practice.
| S-EPMC9669941 | biostudies-literature
Project description:BackgroundTo realize the broader benefits of electronic patient-reported outcome measures (ePROMs) in routine care, we used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to inform the translation of a clinically effective ePROM system (hereafter referred to as the PRM system) into practice. The study aimed to evaluate the processes and success of implementing the PRM system in the routine care of patients diagnosed with lung cancer.MethodA controlled before-and-after mixed-methods study was undertaken. Data sources included a self-report questionnaire and interviews with healthcare providers, electronic health record data for PRMs patients and historical controls, and field notes. Descriptive statistics, logistic regression modelling, negative binomial models, generalized estimating equations and repeated measures ANOVA were used to analyze quantitative data. Qualitative data was thematically analyzed.ResultsA total of 48/79 eligible people diagnosed with lung cancer completed 90 assessments during the 5-month implementation period (RE-AIM reach). Every assessment breached the pre-defined threshold and care coordinators reviewed and actioned 95.6% of breaches, resulting in 146 referrals to allied health services, most frequently for social work (25.3%), dietetics (18.5%), physiotherapy (18.5%) and occupational therapy (17.1%). PRMs patients had significantly fewer visits to the cancer assessment unit for problematic symptoms (M = 0.23 vs. M = 0.43; p = 0.035), and were significantly more likely to be offered referrals (71% vs. 29%, p < 0.0001) than historical controls (RE-AIM effect). The levels of 'organizational readiness for implementing change' (ORIC) did not show much differences between baseline and follow-up, though this was already high at baseline; but significantly more staff reported improved confidence when asking patients to complete assessments (64.7% at baseline vs. 88.2% at follow-up, p = 0.0046), and when describing the assessment tool to patients (64.7% at baseline vs. 76.47% at follow-up, p = 0.0018) (RE-AIM adoption). A total of 78 staff received PRM system training, and 95.6% of the PRM system alerts were actioned (RE-AIM implementation); and all lung cancer care coordinators were engaged with the PRM system beyond the end of the study period (RE-AIM maintenance).ConclusionThis study demonstrates the potential of the PRM system in enhancing the routine care of lung cancer patients, through leveraging the capabilities of automated web-based care options. Research has shown the clear benefits of using electronically collected patient-reported outcome measures (ePROMs) for cancer patients and health services. However, we need to better understand how to implement ePROMs as part of routine care. This study evaluated the processes and outcomes of implementing an ePROMs system in the routine care of patients diagnosed with lung cancer. Key findings included: (a) a majority of eligible patients completed the scheduled assessments; (b) patient concerns were identified in every assessment, and care coordinators reviewed and actioned almost all of these, including making significantly more referrals to allied health services; (c) patients completing assessments regularly were less likely to present to the cancer assessment unit with problematic symptoms, suggesting that ePROMs identified patient concerns early and this led to a timely response to concerns; (d) staff training and engagement was high, and staff reporting increased confidence when asking patients to complete assessments and when describing the assessment tool to patients at the end of the implementation period. This study shows that implementing ePROMs in routine care is feasible and can lead to improvements in patient care.
| S-EPMC9207870 | biostudies-literature