Dataset Information

Development and empirical user-centered evaluation of semantically-based query recommendation for an electronic health record search engine.

ABSTRACT: OBJECTIVE:The utility of biomedical information retrieval environments can be severely limited when users lack expertise in constructing effective search queries. To address this issue, we developed a computer-based query recommendation algorithm that suggests semantically interchangeable terms based on an initial user-entered query. In this study, we assessed the value of this approach, which has broad applicability in biomedical information retrieval, by demonstrating its application as part of a search engine that facilitates retrieval of information from electronic health records (EHRs). MATERIALS AND METHODS:The query recommendation algorithm utilizes MetaMap to identify medical concepts from search queries and indexed EHR documents. Synonym variants from UMLS are used to expand the concepts along with a synonym set curated from historical EHR search logs. The empirical study involved 33 clinicians and staff who evaluated the system through a set of simulated EHR search tasks. User acceptance was assessed using the widely used technology acceptance model. RESULTS:The search engine's performance was rated consistently higher with the query recommendation feature turned on vs. off. The relevance of computer-recommended search terms was also rated high, and in most cases the participants had not thought of these terms on their own. The questions on perceived usefulness and perceived ease of use received overwhelmingly positive responses. A vast majority of the participants wanted the query recommendation feature to be available to assist in their day-to-day EHR search tasks. DISCUSSION AND CONCLUSION:Challenges persist for users to construct effective search queries when retrieving information from biomedical documents including those from EHRs. This study demonstrates that semantically-based query recommendation is a viable solution to addressing this challenge.

SUBMITTER: Hanauer DA

PROVIDER: S-EPMC5378386 | biostudies-literature | 2017 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and empirical user-centered evaluation of semantically-based query recommendation for an electronic health record search engine.

Hanauer David A DA Wu Danny T Y DT Yang Lei L Mei Qiaozhu Q Murkowski-Steffy Katherine B KB Vydiswaran V G Vinod VG Zheng Kai K

Journal of biomedical informatics 20170125

<h4>Objective</h4>The utility of biomedical information retrieval environments can be severely limited when users lack expertise in constructing effective search queries. To address this issue, we developed a computer-based query recommendation algorithm that suggests semantically interchangeable terms based on an initial user-entered query. In this study, we assessed the value of this approach, which has broad applicability in biomedical information retrieval, by demonstrating its application a ...[more]

PMID: 28131722

Similar Datasets

Project description:BackgroundThe COVID-19 pandemic has shined a harsh light on a critical deficiency in our health care system: our inability to access important information about patients' values, goals, and preferences in the electronic health record (EHR). At Memorial Sloan Kettering Cancer Center (MSK), we have integrated and systematized health-related values discussions led by oncology nurses for newly diagnosed cancer patients as part of routine comprehensive cancer care. Such conversations include not only the patient's wishes for care at the end of life but also more holistic personal values, including sources of strength, concerns, hopes, and their definition of an acceptable quality of life. In addition, health care providers use a structured template to document their discussions of patient goals of care.ObjectiveTo provide ready access to key information about the patient as a person with individual values, goals, and preferences, we undertook the creation of the Patient Values Tab in our center's EHR to display this information in a single, central location. Here, we describe the interprofessional, interdisciplinary, iterative process and user-centered design methodology that we applied to build this novel functionality as well as our initial implementation experience and plans for evaluation.MethodsWe first convened a working group of experts from multiple departments, including medical oncology, health informatics, information systems, nursing informatics, nursing education, and supportive care, and a user experience designer. We conducted in-depth, semistructured, audiorecorded interviews of over 100 key stakeholders. The working group sought consensus on the tab's main content, homing in on high-priority areas identified by the stakeholders. The core content was mapped to various EHR data sources. We established a set of high-level design principles to guide our process. Our user experience designer then created wireframes of the tab design. The designer conducted usability testing with physicians, nurses, and other health professionals. Data validation testing was conducted.ResultsWe have already deployed the Patient Values Tab to a pilot sample of users in the MSK Gastrointestinal Medical Oncology Service, including physicians, advanced practice providers, nurses, and administrative staff. We have early evidence of the positive impact of this EHR innovation. Audit logs show increasing use. Many of the initial user comments have been enthusiastically positive, while others have provided constructive suggestions for additional tab refinements with respect to format and content.ConclusionsIt is our challenge and obligation to enrich the EHR with information about the patient as a person. Realization of this capability is a pressing public health need requiring the collaboration of technological experts with a broad range of clinical leaders, users, patients, and families to achieve solutions that are both principled and practical. Our new Patient Values Tab represents a step forward in this important direction.

Project description:BackgroundTo improve chronic disease outcomes, self-management is an effective strategy. An electronic personal health record (ePHR) is a promising tool with the potential to support chronic patient's education, counseling, and self-management. Fitting ePHRs within the daily practices of chronic care providers and chronic patients requires user-centered design approaches. We aimed to understand users' needs and requirements in chronic kidney disease (CKD) care to consider in the design of an ePHR to facilitate its implementation, adoption, and use.MethodsA qualitative study was conducted in a major Iranian nephrology center including inpatient and outpatient settings in 2019. We conducted 28 semi-structured interviews with CKD patients, nurses, and adult nephrologists. To confirm or modify the requirements extracted from the interviews, a focus group was also held. Data were analyzed to extract especially those requirements that can facilitate implementation, adoption, and sustained use based on the PHR adoption model and the unified theory of acceptance and use of technology.ResultsParticipants requested an ePHR that provides access to up to date patient information, facilitates patient-provider communication, and increases awareness about patient individualized conditions. Participants expected a system that is able to cater to low patient e-health literacy and high provider workload. They requested the ePHR to include purposeful documentation of medical history, diagnostic and therapeutic procedures, tailored educational content, and scheduled care reminders. Messaging function, tailored educational content to individual patients' conditions, and controlled access to information were highly valued in order to facilitate its implementation, adoption, and use.ConclusionsWe focused on the ePHR's content and functionalities in the face of facilitators and/or barriers envisioned for its adoption in nephrology care. Designers and implementers should value CKD patients' needs and requirements for self-management such as providing personalized education and counseling (on the basis of their condition and risk factors), health literacy, and disease progression levels. The socio-technical aspects of care also need further attention to facilitate ePHR's adoption.

Project description:BackgroundUp to 60% of health care providers experience one or more symptoms of burnout. Perceived clinician burden resulting in burnout arises from factors such as electronic health record (EHR) usability or lack thereof, perceived loss of autonomy, and documentation burden leading to less clinical time with patients. Burnout can have detrimental effects on health care quality and contributes to increased medical errors, decreased patient satisfaction, substance use, workforce attrition, and suicide.ObjectiveThis project aims to improve the user-centered design of the EHR by obtaining direct input from clinicians about deficiencies. Fixing identified deficiencies via user-centered design has the potential to improve usability, thereby increasing satisfaction by reducing EHR-induced burnout.MethodsQuantitative and qualitative data will be obtained from clinician EHR users. The input will be received through a form built in a REDCap database via a link embedded in the home page of the EHR. The REDCap data will be analyzed in 2 main dimensions, based on nature of the input, what section of the EHR is affected, and what is required to fix the issue(s). Identified issues will be escalated to relevant stakeholders responsible for rectifying the problems identified. Data analysis, project evaluation, and lessons learned from the evaluation will be incorporated in a Plan-Do-Study-Act (PDSA) manner every 4-6 weeks.ResultsThe pilot phase of the study began in October 2020 in the Gastroenterology Division at Mount Sinai Hospital, New York City, NY, which includes 39 physicians and 15 nurses. The pilot is expected to run over a 4-6-month period. The results of the REDCap data analysis will be reported within 1 month of completing the pilot phase. We will analyze the nature of requests received and the impact of rectified issues on the clinician EHR user. We expect that the results will reveal which sections of the EHR have the highest deficiencies while also highlighting issues about workflow difficulties. Perceived impact of the project on provider engagement, patient safety, and workflow efficiency will also be captured by evaluation survey and other qualitative methods where possible.ConclusionsThe project aims to improve user-centered design of the EHR by soliciting direct input from clinician EHR users. The ultimate goal is to improve efficiency, reduce EHR inefficiencies with the possibility of improving staff engagement, and lessen EHR-induced clinician burnout. Our project implementation includes using informatics expertise to achieve the desired state of a learning health system as recommended by the National Academy of Medicine as we facilitate feedback loops and rapid cycles of improvement.International registered report identifier (irrid)PRR1-10.2196/25148.

Project description:BackgroundCurrent guidelines recommend less aggressive target hemoglobin A1c (HbA1c) levels based on older age and lower life expectancy for older adults with diabetes. The effectiveness of electronic health record (EHR) clinical decision support (CDS) in promoting guideline adherence is undermined by alert fatigue and poor workflow integration. Integrating behavioral economics (BE) and CDS tools is a novel approach to improving adherence to guidelines while minimizing clinician burden.MethodsWe will apply a systematic, user-centered design approach to incorporate BE "nudges" into a CDS module and will perform user testing in two "vanguard" sites. To accomplish this, we will conduct (1) semi-structured interviews with key informants (n = 8), (2) a 2-h, design-thinking workshop to derive and refine initial module ideas, and (3) semi-structured group interviews at each site with clinic leaders and clinicians to elicit feedback on three proposed nudge module components (navigator section, inbasket refill protocol, medication preference list). Detailed field notes will be summarized by module idea and usability theme for rapid iteration. Frequency of firing and user action taken will be assessed in the first month of implementation via EHR reporting to confirm that module components and related reporting are working as expected as well as assess utilization. To assess the utilization and feasibility of the new tools and generate estimates of clinician compliance with the Choosing Wisely guideline for diabetes management in older adults, a 6-month, single-arm pilot study of the BE-EHR module will be conducted in six outpatient primary care clinics.DiscussionWe hypothesize that a low burden, user-centered approach to design will yield a BE-driven, CDS module with relatively high utilization by clinicians. The resulting module will establish a platform for exploring the ability of BE concepts embedded within the EHR to affect guideline adherence for other use cases.

Dataset Information

Development and empirical user-centered evaluation of semantically-based query recommendation for an electronic health record search engine.

Publications

Development and empirical user-centered evaluation of semantically-based query recommendation for an electronic health record search engine.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets