Efficiency and safety of speech recognition for documentation in the electronic health record.
Ontology highlight
ABSTRACT:
SUBMITTER: Hodgson T
PROVIDER: S-EPMC7651984 | biostudies-literature | 2017 Nov
REPOSITORIES: biostudies-literature
Publications
Efficiency and safety of speech recognition for documentation in the electronic health record.
Hodgson Tobias T Magrabi Farah F Coiera Enrico E
Journal of the American Medical Informatics Association : JAMIA 20171101 6
<h4>Objective</h4>To compare the efficiency and safety of using speech recognition (SR) assisted clinical documentation within an electronic health record (EHR) system with use of keyboard and mouse (KBM).<h4>Methods</h4>Thirty-five emergency department clinicians undertook randomly allocated clinical documentation tasks using KBM or SR on a commercial EHR system. Tasks were simple or complex, and with or without interruption. Outcome measures included task completion times and observed errors. ...[more]
Similar Datasets
Project description:ObjectiveTo conduct a replication study to validate previously identified significant risks and inefficiencies associated with the use of speech recognition (SR) for documentation within an electronic health record (EHR) system.MethodsThirty-five emergency department clinicians undertook randomly allocated clinical documentation tasks using keyboard and mouse (KBM) or SR using a commercial EHR system. The experiment design, setting, and tasks (E2) replicated an earlier study (E1), while technical integration issues that may have led to poorer SR performance were addressed.ResultsComplex tasks were significantly slower to complete using SR (16.94%) than KBM (KBM: 191.9 s, SR: 224.4 s; p = 0.009; CI, 11.9-48.3), replicating task completion times observed in the earlier experiment. Errors (non-typographical) were significantly higher with SR compared with KBM for both simple (KBM: 3, SR: 84; p < 0.001; CI, 1.5-2.5) and complex tasks (KBM: 23, SR: 53; p = 0.001; CI, 0.5-1.0), again replicating earlier results (E1: 170, E2: 163; p = 0.660; CI, 0.0-0.0). Typographical errors were reduced significantly in the new study (E1: 465, E2: 150; p < 0.001; CI, 2.0-3.0).DiscussionThe results of this study replicate those reported earlier. The use of SR for clinical documentation within an EHR system appears to be consistently associated with decreased time efficiencies and increased errors. Modifications implemented to optimize SR integration in the EHR seem to have resulted in minor improvements that did not fundamentally change overall results.ConclusionThis replication study adds further evidence for the poor performance of SR-assisted clinical documentation within an EHR. Replication studies remain rare in informatics literature, especially where study results are unexpected or have significant implication; such studies are clearly needed to avoid overdependence on the results of a single study.
| S-EPMC5955718 | biostudies-literature
Project description:ObjectivesDocumentation of allergies in a coded, non-free-text format in the electronic health record (EHR) triggers clinical decision support to prevent adverse events. Health system-wide patient safety initiatives to improve EHR allergy documentation by specifically decreasing free-text allergy entries have not been reported. The goal of this initiative was to systematically reduce free-text allergen entries in the EHR allergy module.MethodsWe assessed free-text allergy entries in a commercial EHR used at a multihospital integrated health care system in the greater Boston area. Using both manual and automated methods, a multidisciplinary consensus group prioritized high-risk and frequently used free-text allergens for conversion to coded entries, added new allergen entries, and deleted duplicate allergen entries. Environmental allergies were moved to the patient problem list.ResultsWe identified 242,330 free-text entries, which included a variety of environmental allergies (42%), food allergies (18%), contrast media allergies (13%), "no known allergy" (12%), drug allergies (2%), and "no contrast allergy" (2%). Most free-text entries were entered by medical assistants in ambulatory settings (34%) and registered nurses in perioperative settings (20%). We remediated a total of 52,206 free-text entries with automated methods and 79,578 free-text entries with manual methods.ConclusionsThrough this multidisciplinary intervention, we identified and remediated 131,784 free-text entries in our EHR to improve clinical decision support and patient safety. Additional strategies are required to completely eliminate free-text allergy entry, and establish systematic, consistent, and safe guidelines for documenting allergies.
| S-EPMC7704710 | biostudies-literature
Project description:The use of electronic cigarettes (e-cigarettes) can affect patient health and clinical care. However, the current documentation of e-cigarette use in the electronic health records (EHR) is inconsistent. This report outlines how the ambulatory clinical practices of a large U.S. hospital system optimized its electronic health records (EHR) framework to better record e-cigarettes used by patients. The new EHR section for e-cigarette information was implemented for outpatient appointments. During a 30-week evaluation period post-implementation, 638,804 patients (12 yrs and older) completed ambulatory appointments within the health system; of these, the new section contained e-cigarette use information for 37,906 (6%) patients. Among these patients, 1005 (2.7%) were identified as current e-cigarette users (current every day or current some day e-cigarette use), 941 (2.5%) were reported as former e-cigarette users, and 35,960 (94%) had never used e-cigarettes. A separate EHR section to document e-cigarette use is feasible within existing clinical practice models. Utilization of the new section was modest in routine clinical practice, indicating the need for more intensive implementation strategies that emphasize the health effects of e-cigarette use, and how consistent ascertainment could improve clinical practice.
| S-EPMC7460036 | biostudies-literature
Project description:BackgroundTaiwan has insufficient nursing resources due to the high turnover rate of health care providers. Therefore, reducing the heavy workload of these employees is essential. Herein, speech transcription, which has various potential clinical applications, was employed for the documentation of nursing records. The requirement of including only one speaker per transcription facilitated data collection and system development. Moreover, authorization from patients was unnecessary.ObjectiveThe aim of this study was to construct a speech recognition system for nursing records such that health care providers can complete nursing records without typing or with only a few edits.MethodsNursing records in Taiwan are mainly written in Mandarin, with technical terms and abbreviations presented in both Mandarin and English. Therefore, the training set consisted of English code-switching information. Next, transfer learning (TL) and meta-TL (MTL) methods, which perform favorably in code-switching scenarios, were applied.ResultsAs of September 2021, the China Medical University Hospital Artificial Intelligence Speech (CMaiSpeech) data set was established by manually annotating approximately 100 hours of recordings from 525 speakers. The word error rate (WER) of the benchmark model of syllable-based TL was 29.54% in code-switching. The WER of the proposed model of syllable-based MTL was 22.20% in code-switching. The test set comprised 17,247 words. Moreover, in a clinical case, the proposed model of syllable-based MTL yielded a WER of 31.06% in code-switching. The clinical test set contained 1159 words.ConclusionsThis paper has two main contributions. First, the CMaiSpeech data set-a Mandarin-English corpus-has been established. Health care providers in Taiwan are often compelled to use a mixture of Mandarin and English in nursing records. Second, an automatic speech recognition system for nursing record document conversion was proposed. The proposed system can shorten the work handover time and further reduce the workload of health care providers.
| S-EPMC9773023 | biostudies-literature
Project description:Physicians who more intensively interact with electronic health records (EHRs) through their documentation style may pay greater attention to coded fields and clinical decision support and thus may deliver higher quality care. We measured the quality of care of physicians who used three predominating EHR documentation styles: dictation, structured documentation, and free text.We conducted a retrospective analysis of visits by patients with coronary artery disease and diabetes to the Partners Primary Care Practice Based Research Network. The main outcome measures were 15 EHR-based coronary artery disease and diabetes measures assessed 30 days after primary care visits.During the 9-month study period, 7000 coronary artery disease and diabetes patients made 18?569 visits to 234 primary care physicians of whom 20 (9%) predominantly dictated their notes, 68 (29%) predominantly used structured documentation, and 146 (62%) predominantly typed free text notes. In multivariable modeling adjusted for clustering by patient and physician, quality of care appeared significantly worse for dictators than for physicians using the other two documentation styles on three of 15 measures (antiplatelet medication, tobacco use documentation, and diabetic eye exam); better for structured documenters for three measures (blood pressure documentation, body mass index documentation, and diabetic foot exam); and better for free text documenters on one measure (influenza vaccination). There was no measure for which dictators had higher quality of care than physicians using the other two documentation styles.EHR-assessed quality is necessarily documentation-dependent, but physicians who dictated their notes appeared to have worse quality of care than physicians who used structured EHR documentation.ClinicalTrials.gov Identifier: NCT00235040.
| S-EPMC3534457 | biostudies-literature
Project description:ImportanceElectronic health records are a potentially valuable source of information for identifying patients with opioid use disorder (OUD).ObjectiveTo evaluate whether proxy measures from electronic health record data can be used reliably to identify patients with probable OUD based on Diagnostic and Statistical Manual of Mental Disorders (Fifth Edition) (DSM-5) criteria.Design, setting, and participantsThis retrospective cross-sectional study analyzed individuals within the Geisinger health system who were prescribed opioids between December 31, 2000, and May 31, 2017, using a mixed-methods approach. The cohort was identified from 16 253 patients enrolled in a contract-based, Geisinger-specific medication monitoring program (GMMP) for opioid use, including patients who maintained or violated contract terms, as well as a demographically matched control group of 16 253 patients who were prescribed opioids but not enrolled in the GMMP. Substance use diagnoses and psychiatric comorbidities were assessed using automated electronic health record summaries. A manual medical record review procedure using DSM-5 criteria for OUD was completed for a subset of patients. The analysis was conducted beginning from June 5, 2017, until May 29, 2020.Main outcomes and measuresThe primary outcome was the prevalence of OUD as defined by proxy measures for DSM-5 criteria for OUD as well as the prevalence of comorbidities among patients prescribed opioids within an integrated health system.ResultsAmong the 16 253 patients enrolled in the GMMP (9309 women [57%]; mean [SD] age, 52 [14] years), OUD diagnoses as defined by diagnostic codes were present at a much lower rate than expected (291 [2%]), indicating the necessity for alternative diagnostic strategies. The DSM-5 criteria for OUD can be assessed using manual medical record review; a manual review of 200 patients in the GMMP and 200 control patients identifed a larger percentage of patients with probable moderate to severe OUD (GMMP, 145 of 200 [73%]; and control, 27 of 200 [14%]) compared with the prevalence of OUD assessed using diagnostic codes.Conclusions and relevanceThese results suggest that patients with OUD may be identified using information available in the electronic health record, even when diagnostic codes do not reflect this diagnosis. Furthermore, the study demonstrates the utility of coding for DSM-5 criteria from medical records to generate a quantitative DSM-5 score that is associated with OUD severity.
| S-EPMC7489858 | biostudies-literature
Project description:BackgroundThe rapid expansion in the use of electronic health records (EHR) has increased the number of medical errors originating in health information systems (HIS). The sociotechnical approach helps in understanding risks in the development, implementation, and use of EHR and health information technology (HIT) while accounting for complex interactions of technology within the health care system.ObjectiveThis study addresses two important questions: (1) "which of the common EHR error types are associated with perceived high- and extreme-risk severity ratings among EHR users?", and (2) "which variables are associated with high- and extreme-risk severity ratings?"MethodsThis study was a quantitative, non-experimental, descriptive study of EHR users. We conducted a cross-sectional web-based questionnaire study at the largest hospital district in Finland. Statistical tests included the reliability of the summative scales tested with Cronbach's alpha. Logistic regression served to assess the association of the independent variables to each of the eight risk factors examined.ResultsA total of 2864 eligible respondents provided the final data. Almost half of the respondents reported a high level of risk related to the error type "extended EHR unavailability". The lowest overall risk level was associated with "selecting incorrectly from a list of items". In multivariate analyses, profession and clinical unit proved to be the strongest predictors for high perceived risk. Physicians perceived risk levels to be the highest ( P<.001 in six of eight error types), while emergency departments, operating rooms, and procedure units were associated with higher perceived risk levels ( P<.001 in four of eight error types). Previous participation in eLearning courses on EHR-use was associated with lower risk for some of the risk factors.ConclusionsBased on a large number of Finnish EHR users in hospitals, this study indicates that HIT safety hazards should be taken very seriously, particularly in operating rooms, procedure units, emergency departments, and intensive care units/critical care units. Health care organizations should use proactive and systematic assessments of EHR risks before harmful events occur. An EHR training program should be compulsory for all EHR users in order to address EHR safety concerns resulting from the failure to use HIT appropriately.
| S-EPMC4890731 | biostudies-literature
Project description:Although complete and accurate clinical records do not guarantee the provision of excellent dental care, they do provide an opportunity to evaluate the quality of care provided. However, a lack of universally accepted documentation standards, incomplete record-keeping practices, and unfriendly electronic health care record (EHR) user interfaces are factors that have allowed for persistent poor dental patient record keeping.Using 2 different methods-a validated survey, and a 2-round Delphi process-involving 2 appropriately different sets of participants, we explored what a dental clinical record should contain and the frequency of update of each clinical entry.For both the closed-ended survey questions and the open-ended Delphi process questions, respondents had a significant degree of agreement on the "clinical entry" components of an adequate clinical record. There was, however, variance on how frequently each of those clinical entries should be updated.Dental providers agree that complete and accurate record keeping is essential and that items such as histories, examination findings, diagnosis, radiographs, treatment plans, consents, and clinic notes should be documented. There, however, does not seem to be universal agreement how frequently such items should be recorded.As the dental profession moves towards prevalent use of electronic health care records, the issue of standardization and interoperability becomes ever more pressing. Settling issues of standardization, including record documentation, must begin with guideline-creating dental professional bodies, who need to clearly define and disseminate what these standards should be and everyday dentists who will ultimately ensure that these standards are met and kept.
| S-EPMC5119920 | biostudies-literature
Project description:ObjectiveUsing Failure Mode and Effects Analysis (FMEA) as an example quality improvement approach, our objective was to evaluate whether secondary use of orders, forms, and notes recorded by the electronic health record (EHR) during daily practice can enhance the accuracy of process maps used to guide improvement. We examined discrepancies between expected and observed activities and individuals involved in a high-risk process and devised diagnostic measures for understanding discrepancies that may be used to inform quality improvement planning.MethodsInpatient cardiology unit staff developed a process map of discharge from the unit. We matched activities and providers identified on the process map to EHR data. Using four diagnostic measures, we analyzed discrepancies between expectation and observation.ResultsEHR data showed that 35% of activities were completed by unexpected providers, including providers from 12 categories not identified as part of the discharge workflow. The EHR also revealed sub-components of process activities not identified on the process map. Additional information from the EHR was used to revise the process map and show differences between expectation and observation.ConclusionFindings suggest EHR data may reveal gaps in process maps used for quality improvement and identify characteristics about workflow activities that can identify perspectives for inclusion in an FMEA. Organizations with access to EHR data may be able to leverage clinical documentation to enhance process maps used for quality improvement. While focused on FMEA protocols, findings from this study may be applicable to other quality activities that require process maps.
| S-EPMC5391722 | biostudies-literature
Project description:PurposeWe sought to evaluate sexual history documentation and corresponding Chlamydia trachomatis screening practices across a large pediatric primary care network in the context of patient and clinic characteristics.MethodsDemographic, chlamydia screening, and provider note data were collected via electronic health record and manual chart audit for females aged 15-19 years attending annual well-adolescent visits, from February 1 to 28, 2019. Inductive qualitative textual analysis evaluated sexual history documentation as informative (containing clear indication of patient as sexually active or not) or noninformative and identified documentation subtypes. We examined patient and clinic characteristics by sexual history documentation type (informative or noninformative) and chlamydia screening status and documentation subtypes across clinic types using chi-square and Fisher's exact tests. A multilevel logistic regression model considering clinic-specific random effects evaluated predictors of informative sexual history documentation.ResultsChart notes were examined for 1,062 patients across 31 unique clinics. Only 34.7% of chart notes were found to have informative sexual history documentation. Older patients (odds ratio: 1.51, 95% confidence interval: 0.99-2.31) and patients seen at clinics receiving U.S. Department of Health and Human Services Title-X funding (odds ratio: 11.05, 95% confidence interval: 1.34-90.86) had higher rates of informative documentation. The overall Chlamydia screening rate was 13.1%.ConclusionSexual history documentation varied widely across clinics, and the majority of chart notes were found to have noninformative documentation. Understanding and addressing barriers to informative sexual history documentation and comprehensive sexual health care is fundamental to improve adolescent sexual health outcomes, particularly given recently enacted federal electronic health record transparency policies.
| S-EPMC8860853 | biostudies-literature