Dataset Information

Readability Formulas and User Perceptions of Electronic Health Records Difficulty: A Corpus Study.

ABSTRACT:

Background

Electronic health records (EHRs) are a rich resource for developing applications to engage patients and foster patient activation, thus holding a strong potential to enhance patient-centered care. Studies have shown that providing patients with access to their own EHR notes may improve the understanding of their own clinical conditions and treatments, leading to improved health care outcomes. However, the highly technical language in EHR notes impedes patients' comprehension. Numerous studies have evaluated the difficulty of health-related text using readability formulas such as Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning-Fog Index (GFI). They conclude that the materials are often written at a grade level higher than common recommendations.

Objective

The objective of our study was to explore the relationship between the aforementioned readability formulas and the laypeople's perceived difficulty on 2 genres of text: general health information and EHR notes. We also validated the formulas' appropriateness and generalizability on predicting difficulty levels of highly complex technical documents.

Methods

We collected 140 Wikipedia articles on diabetes and 242 EHR notes with diabetes International Classification of Diseases, Ninth Revision code. We recruited 15 Amazon Mechanical Turk (AMT) users to rate difficulty levels of the documents. Correlations between laypeople's perceived difficulty levels and readability formula scores were measured, and their difference was tested. We also compared word usage and the impact of medical concepts of the 2 genres of text.

Results

The distributions of both readability formulas' scores (P<.001) and laypeople's perceptions (P=.002) on the 2 genres were different. Correlations of readability predictions and laypeople's perceptions were weak. Furthermore, despite being graded at similar levels, documents of different genres were still perceived with different difficulty (P<.001). Word usage in the 2 related genres still differed significantly (P<.001).

Conclusions

Our findings suggested that the readability formulas' predictions did not align with perceived difficulty in either text genre. The widely used readability formulas were highly correlated with each other but did not show adequate correlation with readers' perceived difficulty. Therefore, they were not appropriate to assess the readability of EHR notes.

SUBMITTER: Zheng J

PROVIDER: S-EPMC5355629 | biostudies-literature | 2017 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Readability Formulas and User Perceptions of Electronic Health Records Difficulty: A Corpus Study.

Zheng Jiaping J Yu Hong H

Journal of medical Internet research 20170302 3

<h4>Background</h4>Electronic health records (EHRs) are a rich resource for developing applications to engage patients and foster patient activation, thus holding a strong potential to enhance patient-centered care. Studies have shown that providing patients with access to their own EHR notes may improve the understanding of their own clinical conditions and treatments, leading to improved health care outcomes. However, the highly technical language in EHR notes impedes patients' comprehension. ...[more]

PMID: 28254738

Similar Datasets

Project description:BackgroundDespite the rapid adoption of electronic health records (EHRs) resulting from the reimbursement program of the US government, EHR adoption in behavioral hospitals is still slow, and there remains a lack of evidence regarding barriers and facilitators to the implementation of mental health care EHRs.ObjectiveThe aim of this study is to analyze the experience of mental health professionals to explore the perceived barriers, facilitators, and critical ideas influencing the implementation and usability of a mental health care EHR.MethodsIn this phenomenological qualitative study, we interviewed physicians, nurses, pharmacists, mental health clinicians, and administrative professionals separately at 4 behavioral hospitals in the United States. We conducted semistructured interviews (N=43) from behavioral hospitals involved in the adoption of the mental health care EHR. Purposeful sampling was used to maximize the diversity. Transcripts were coded and analyzed for emergent domains. An exploratory data analysis was conducted.ResultsContent analyses revealed 7 barriers and 4 facilitators. The most important barriers to implementing the mental health care EHR were the low levels of computer proficiency among nurses, complexity of the system, alert fatigue, and resistance because of legacy systems. This led to poor usability, low acceptability, and distrust toward the system. The major facilitators to implementing the mental health care EHR were well-executed training programs, improved productivity, better quality of care, and the good usability of the mental health care EHR.ConclusionsHealth care professionals expected to enhance their work productivity and interprofessional collaboration by introducing the mental health care EHR. Routine education for end users is an essential starting point for the successful implementation of mental health care EHR electronic decision support. When adopting the mental health care EHR, managers need to focus on common practices in behavioral hospitals, such as documenting structured data in their organizations and adopting a seamless workflow of mental health care into the system.

Project description:BackgroundSuicide is a serious public health issue, accounting for 1.4% of all deaths worldwide. Current risk assessment tools are reported as performing little better than chance in predicting suicide. New methods for studying dynamic features in electronic health records (EHRs) are being increasingly explored. One avenue of research involves using sentiment analysis to examine clinicians' subjective judgments when reporting on patients. Several recent studies have used general-purpose sentiment analysis tools to automatically identify negative and positive words within EHRs to test correlations between sentiment extracted from the texts and specific medical outcomes (eg, risk of suicide or in-hospital mortality). However, little attention has been paid to analyzing the specific words identified by general-purpose sentiment lexicons when applied to EHR corpora.ObjectiveThis study aims to quantitatively and qualitatively evaluate the coverage of six general-purpose sentiment lexicons against a corpus of EHR texts to ascertain the extent to which such lexical resources are fit for use in suicide risk assessment.MethodsThe data for this study were a corpus of 198,451 EHR texts made up of two subcorpora drawn from a 1:4 case-control study comparing clinical notes written over the period leading up to a suicide attempt (cases, n=2913) with those not preceding such an attempt (controls, n=14,727). We calculated word frequency distributions within each subcorpus to identify representative keywords for both the case and control subcorpora. We quantified the relative coverage of the 6 lexicons with respect to this list of representative keywords in terms of weighted precision, recall, and F score.ResultsThe six lexicons achieved reasonable precision (0.53-0.68) but very low recall (0.04-0.36). Many of the most representative keywords in the suicide-related (case) subcorpus were not identified by any of the lexicons. The sentiment-bearing status of these keywords for this use case is thus doubtful.ConclusionsOur findings indicate that these 6 sentiment lexicons are not optimal for use in suicide risk assessment. We propose a set of guidelines for the creation of more suitable lexical resources for distinguishing suicide-related from non-suicide-related EHR texts.

Project description:BACKGROUND:The number of electronic cigarette (e-cigarette) users has been increasing rapidly in recent years, especially among youth and young adults. More e-cigarette products have become available, including e-liquids with various brands and flavors. Various e-liquid flavors have been frequently discussed by e-cigarette users on social media. OBJECTIVE:This study aimed to examine the longitudinal prevalence of mentions of electronic cigarette liquid (e-liquid) flavors and user perceptions on social media. METHODS:We applied a data-driven approach to analyze the trends and macro-level user sentiments of different e-cigarette flavors on social media. With data collected from web-based stores, e-liquid flavors were classified into categories in a flavor hierarchy based on their ingredients. The e-cigarette-related posts were collected from social media platforms, including Reddit and Twitter, using e-cigarette-related keywords. The temporal trend of mentions of e-liquid flavor categories was compiled using Reddit data from January 2013 to April 2019. Twitter data were analyzed using a sentiment analysis from May to August 2019 to explore the opinions of e-cigarette users toward each flavor category. RESULTS:More than 1000 e-liquid flavors were classified into 7 major flavor categories. The fruit and sweets categories were the 2 most frequently discussed e-liquid flavors on Reddit, contributing to approximately 58% and 15%, respectively, of all flavor-related posts. We showed that mentions of the fruit flavor category had a steady overall upward trend compared with other flavor categories that did not show much change over time. Results from the sentiment analysis demonstrated that most e-liquid flavor categories had significant positive sentiments, except for the beverage and tobacco categories. CONCLUSIONS:The most updated information about the popular e-liquid flavors mentioned on social media was investigated, which showed that the prevalence of mentions of e-liquid flavors and user perceptions on social media were different. Fruit was the most frequently discussed flavor category on social media. Our study provides valuable information for future regulation of flavored e-cigarettes.

Project description:BackgroundElectronic health record (EHR) implementation is currently underway in Canada, as in many other countries. These ambitious projects involve many stakeholders with unique perceptions of the implementation process. EHR users have an important role to play as they must integrate the EHR system into their work environments and use it in their everyday activities. Users hold valuable, first-hand knowledge of what can limit or contribute to the success of EHR implementation projects. A comprehensive synthesis of EHR users' perceptions is key to successful future implementation. This systematic literature review was aimed to synthesize current knowledge of the barriers and facilitators influencing shared EHR implementation among its various users.MethodsCovering a period from 1999 to 2009, a literature search was conducted on nine electronic databases. Studies were included if they reported on users' perceived barriers and facilitators to shared EHR implementation, in healthcare settings comparable to Canada. Studies in all languages with an empirical study design were included. Quality and relevance of the studies were assessed. Four EHR user groups were targeted: physicians, other health care professionals, managers, and patients/public. Content analysis was performed independently by two authors using a validated extraction grid with pre-established categorization of barriers and facilitators for each group of EHR users.ResultsOf a total of 5,695 potentially relevant publications identified, 117 full text publications were obtained after screening titles and abstracts. After review of the full articles, 60 publications, corresponding to 52 studies, met the inclusion criteria. The most frequent adoption factors common to all user groups were design and technical concerns, ease of use, interoperability, privacy and security, costs, productivity, familiarity and ability with EHR, motivation to use EHR, patient and health professional interaction, and lack of time and workload. Each user group also identified factors specific to their professional and individual priorities.ConclusionsThis systematic review presents innovative research on the barriers and facilitators to EHR implementation. While important similarities between user groups are highlighted, differences between them demonstrate that each user group also has a unique perspective of the implementation process that should be taken into account.

Dataset Information

Readability Formulas and User Perceptions of Electronic Health Records Difficulty: A Corpus Study.

Background

Objective

Methods

Results

Conclusions

Publications

Readability Formulas and User Perceptions of Electronic Health Records Difficulty: A Corpus Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets