Dataset Information

Technical Aspects of Developing Chatbots for Medical Applications: Scoping Review.

ABSTRACT:

Background

Chatbots are applications that can conduct natural language conversations with users. In the medical field, chatbots have been developed and used to serve different purposes. They provide patients with timely information that can be critical in some scenarios, such as access to mental health resources. Since the development of the first chatbot, ELIZA, in the late 1960s, much effort has followed to produce chatbots for various health purposes developed in different ways.

Objective

This study aimed to explore the technical aspects and development methodologies associated with chatbots used in the medical field to explain the best methods of development and support chatbot development researchers on their future work.

Methods

We searched for relevant articles in 8 literature databases (IEEE, ACM, Springer, ScienceDirect, Embase, MEDLINE, PsycINFO, and Google Scholar). We also performed forward and backward reference checking of the selected articles. Study selection was performed by one reviewer, and 50% of the selected studies were randomly checked by a second reviewer. A narrative approach was used for result synthesis. Chatbots were classified based on the different technical aspects of their development. The main chatbot components were identified in addition to the different techniques for implementing each module.

Results

The original search returned 2481 publications, of which we identified 45 studies that matched our inclusion and exclusion criteria. The most common language of communication between users and chatbots was English (n=23). We identified 4 main modules: text understanding module, dialog management module, database layer, and text generation module. The most common technique for developing text understanding and dialogue management is the pattern matching method (n=18 and n=25, respectively). The most common text generation is fixed output (n=36). Very few studies relied on generating original output. Most studies kept a medical knowledge base to be used by the chatbot for different purposes throughout the conversations. A few studies kept conversation scripts and collected user data and previous conversations.

Conclusions

Many chatbots have been developed for medical use, at an increasing rate. There is a recent, apparent shift in adopting machine learning-based approaches for developing chatbot systems. Further research can be conducted to link clinical outcomes to different chatbot development techniques and technical characteristics.

SUBMITTER: Safi Z

PROVIDER: S-EPMC7775817 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Technical Aspects of Developing Chatbots for Medical Applications: Scoping Review.

Safi Zeineb Z Abd-Alrazaq Alaa A Khalifa Mohamed M Househ Mowafa M

Journal of medical Internet research 20201218 12

<h4>Background</h4>Chatbots are applications that can conduct natural language conversations with users. In the medical field, chatbots have been developed and used to serve different purposes. They provide patients with timely information that can be critical in some scenarios, such as access to mental health resources. Since the development of the first chatbot, ELIZA, in the late 1960s, much effort has followed to produce chatbots for various health purposes developed in different ways.<h4>Ob ...[more]

PMID: 33337337

Similar Datasets

Project description:BACKGROUND:Dialog agents (chatbots) have a long history of application in health care, where they have been used for tasks such as supporting patient self-management and providing counseling. Their use is expected to grow with increasing demands on health systems and improving artificial intelligence (AI) capability. Approaches to the evaluation of health care chatbots, however, appear to be diverse and haphazard, resulting in a potential barrier to the advancement of the field. OBJECTIVE:This study aims to identify the technical (nonclinical) metrics used by previous studies to evaluate health care chatbots. METHODS:Studies were identified by searching 7 bibliographic databases (eg, MEDLINE and PsycINFO) in addition to conducting backward and forward reference list checking of the included studies and relevant reviews. The studies were independently selected by two reviewers who then extracted data from the included studies. Extracted data were synthesized narratively by grouping the identified metrics into categories based on the aspect of chatbots that the metrics evaluated. RESULTS:Of the 1498 citations retrieved, 65 studies were included in this review. Chatbots were evaluated using 27 technical metrics, which were related to chatbots as a whole (eg, usability, classifier performance, speed), response generation (eg, comprehensibility, realism, repetitiveness), response understanding (eg, chatbot understanding as assessed by users, word error rate, concept error rate), and esthetics (eg, appearance of the virtual agent, background color, and content). CONCLUSIONS:The technical metrics of health chatbot studies were diverse, with survey designs and global usability metrics dominating. The lack of standardization and paucity of objective measures make it difficult to compare the performance of health chatbots and could inhibit advancement of the field. We suggest that researchers more frequently include metrics computed from conversation logs. In addition, we recommend the development of a framework of technical metrics with recommendations for specific circumstances for their inclusion in chatbot studies.

Project description:OBJECTIVE:To provide insight into how and in what clinical fields overdiagnosis is studied and give directions for further applied and methodological research. DESIGN:Scoping review. DATA SOURCES:Medline up to August 2017. STUDY SELECTION:All English studies on humans, in which overdiagnosis was discussed as a dominant theme. DATA EXTRACTION:Studies were assessed on clinical field, study aim (ie, methodological or non-methodological), article type (eg, primary study, review), the type and role of diagnostic test(s) studied and the context in which these studies discussed overdiagnosis. RESULTS:From 4896 studies, 1851 were included for analysis. Half of all studies on overdiagnosis were performed in the field of oncology (50%). Other prevalent clinical fields included mental disorders, infectious diseases and cardiovascular diseases accounting for 9%, 8% and 6% of studies, respectively. Overdiagnosis was addressed from a methodological perspective in 20% of studies. Primary studies were the most common article type (58%). The type of diagnostic tests most commonly studied were imaging tests (32%), although these were predominantly seen in oncology and cardiovascular disease (84%). Diagnostic tests were studied in a screening setting in 43% of all studies, but as high as 75% of all oncological studies. The context in which studies addressed overdiagnosis related most frequently to its estimation, accounting for 53%. Methodology on overdiagnosis estimation and definition provided a source for extensive discussion. Other contexts of discussion included definition of disease, overdiagnosis communication, trends in increasing disease prevalence, drivers and consequences of overdiagnosis, incidental findings and genomics. CONCLUSIONS:Overdiagnosis is discussed across virtually all clinical fields and in different contexts. The variability in characteristics between studies and lack of consensus on overdiagnosis definition indicate the need for a uniform typology to improve coherence and comparability of studies on overdiagnosis.

Project description:ObjectivesOver the last two decades, the number of scoping reviews in core medical education journals has increased by 4200%. Despite this growth, research on scoping reviews provides limited information about their nature, including how they are conducted or why medical educators undertake this knowledge synthesis type. This gap makes it difficult to know where the field stands and may hamper attempts to improve the conduct, reporting and utility of scoping reviews. Thus, this review characterises the nature of medical education scoping reviews to identify areas for improvement and highlight future research opportunities.MethodThe authors searched PubMed for scoping reviews published between 1/1999 and 4/2020 in 14 medical education journals. The authors extracted and summarised key bibliometric data, the rationales given for conducting a scoping review, the research questions and key reporting elements as described in the PRISMA-ScR. Rationales and research questions were mapped to Arksey and O'Malley's reasons for conducting a scoping review.ResultsOne hundred and one scoping reviews were included. On average, 10.1 scoping reviews (SD = 13.1, median = 4) were published annually with the most reviews published in 2019 (n = 42). Authors described multiple reasons for undertaking scoping reviews; the most prevalent being to summarise and disseminate research findings (n = 77). In 11 reviews, the rationales for the scoping review and the research questions aligned. No review addressed all elements of the PRISMA-ScR, with few authors publishing a protocol (n = 2) or including stakeholders (n = 20). Authors identified shortcomings of scoping reviews, including lack of critical appraisal.ConclusionsScoping reviews are increasingly conducted in medical education and published by most core journals. Scoping reviews aim to map the depth and breadth of emerging topics; as such, they have the potential to play a critical role in the practice, policy and research of medical education. However, these results suggest improvements are needed for this role to be fully realised.

Project description:BACKGROUND:Space technology has an impact on many domains of activity on earth, including in the field of global health. With the recent adoption of the United Nations' Sustainable Development Goals that highlight the need for strengthening partnerships in different domains, it is useful to better characterize the relationship between space technology and global health. OBJECTIVE:The aim of this study was to identify the applications of space technologies to global health, the key stakeholders in the field, as well as gaps and challenges. METHODS:We used a scoping review methodology, including a literature review and the involvement of stakeholders, via a brief self-administered, open-response questionnaire. A distinct search on several search engines was conducted for each of the four key technological domains that were previously identified by the UN Office for Outer Space Affairs' Expert Group on Space and Global Health (Domain A: remote sensing; Domain B: global navigation satellite systems; Domain C: satellite communication; and Domain D: human space flight). Themes in which space technologies are of benefit to global health were extracted. Key stakeholders, as well as gaps, challenges, and perspectives were identified. RESULTS:A total of 222 sources were included for Domain A, 82 sources for Domain B, 144 sources for Domain C, and 31 sources for Domain D. A total of 3 questionnaires out of 16 sent were answered. Global navigation satellite systems and geographic information systems are used for the study and forecasting of communicable and noncommunicable diseases; satellite communication and global navigation satellite systems for disaster response; satellite communication for telemedicine and tele-education; and global navigation satellite systems for autonomy improvement, access to health care, as well as for safe and efficient transportation. Various health research and technologies developed for inhabited space flights have been adapted for terrestrial use. CONCLUSIONS:Although numerous examples of space technology applications to global health exist, improved awareness, training, and collaboration of the research community is needed.

Dataset Information

Technical Aspects of Developing Chatbots for Medical Applications: Scoping Review.

Background

Objective

Methods

Results

Conclusions

Publications

Technical Aspects of Developing Chatbots for Medical Applications: Scoping Review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets