Dataset Information

Adoption of Machine Learning Systems for Medical Diagnostics in Clinics: Qualitative Interview Study.

ABSTRACT:

Background

Recently, machine learning (ML) has been transforming our daily lives by enabling intelligent voice assistants, personalized support for purchase decisions, and efficient credit card fraud detection. In addition to its everyday applications, ML holds the potential to improve medicine as well, especially with regard to diagnostics in clinics. In a world characterized by population growth, demographic change, and the global COVID-19 pandemic, ML systems offer the opportunity to make diagnostics more effective and efficient, leading to a high interest of clinics in such systems. However, despite the high potential of ML, only a few ML systems have been deployed in clinics yet, as their adoption process differs significantly from the integration of prior health information technologies given the specific characteristics of ML.

Objective

This study aims to explore the factors that influence the adoption process of ML systems for medical diagnostics in clinics to foster the adoption of these systems in clinics. Furthermore, this study provides insight into how these factors can be used to determine the ML maturity score of clinics, which can be applied by practitioners to measure the clinic status quo in the adoption process of ML systems.

Methods

To gain more insight into the adoption process of ML systems for medical diagnostics in clinics, we conducted a qualitative study by interviewing 22 selected medical experts from clinics and their suppliers with profound knowledge in the field of ML. We used a semistructured interview guideline, asked open-ended questions, and transcribed the interviews verbatim. To analyze the transcripts, we first used a content analysis approach based on the health care-specific framework of nonadoption, abandonment, scale-up, spread, and sustainability. Then, we drew on the results of the content analysis to create a maturity model for ML adoption in clinics according to an established development process.

Results

With the help of the interviews, we were able to identify 13 ML-specific factors that influence the adoption process of ML systems in clinics. We categorized these factors according to 7 domains that form a holistic ML adoption framework for clinics. In addition, we created an applicable maturity model that could help practitioners assess their current state in the ML adoption process.

Conclusions

Many clinics still face major problems in adopting ML systems for medical diagnostics; thus, they do not benefit from the potential of these systems. Therefore, both the ML adoption framework and the maturity model for ML systems in clinics can not only guide future research that seeks to explore the promises and challenges associated with ML systems in a medical setting but also be a practical reference point for clinicians.

SUBMITTER: Pumplun L

PROVIDER: S-EPMC8556641 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThird-party cloud-based data analysis applications are proliferating in electronic health (eHealth) because of the expertise offered and their monetary advantage. However, privacy and security are critical concerns when handling sensitive medical data in the cloud. Technical advances based on "crypto magic" in privacy-preserving machine learning (ML) enable data analysis in encrypted form for maintaining confidentiality. Such privacy-enhancing technologies (PETs) could be counterintuitive to relevant stakeholders in eHealth, which could in turn hinder adoption; thus, more attention is needed on human factors for establishing trust and transparency.ObjectiveThe aim of this study was to analyze eHealth expert stakeholders' perspectives and the perceived tradeoffs in regard to data analysis on encrypted medical data in the cloud, and to derive user requirements for development of a privacy-preserving data analysis tool.MethodsWe used semistructured interviews and report on 14 interviews with individuals having medical, technical, or research expertise in eHealth. We used thematic analysis for analyzing interview data. In addition, we conducted a workshop for eliciting requirements.ResultsOur results show differences in the understanding of and in trusting the technology; caution is advised by technical experts, whereas patient safety assurances are required by medical experts. Themes were identified with general perspectives on data privacy and practices (eg, acceptance of using external services), as well as themes highlighting specific perspectives (eg, data protection drawbacks and concerns of the data analysis on encrypted data). The latter themes result in requiring assurances and conformance testing for trusting tools such as the proposed ML-based tool. Communicating privacy, and utility benefits and tradeoffs with stakeholders is essential for trust. Furthermore, stakeholders and their organizations share accountability of patient data. Finally, stakeholders stressed the importance of informing patients about the privacy of their data.ConclusionsUnderstanding the benefits and risks of using eHealth PETs is crucial, and collaboration among diverse stakeholders is essential. Assurances of the tool's privacy, accuracy, and patient safety should be in place for establishing trust of ML-based PETs, especially if used in the cloud.

Project description:BACKGROUND:Experiential learning plays a critical role in learner development. Kolb's 4-part experiential learning model consists of concrete experience, reflective observation, abstract conceptualization, and active experimentation in a recurring cycle. Most clinical environments provide opportunities for experiences and active experimentation but rarely offer structured means for reflection and abstract conceptualization that are crucial for learners to learn through experience. We created Learning Moment, a novel Web-based educational tool that integrates principles of asynchronous learning and learning portfolios to fulfill the reflection and abstract conceptualization aspects of Kolb's learning cycle in the modern clinical learning environment. Medical students log concise clinical "pearls" in the form of "learning moments" for reflection, review, and sharing with peers in a community of practice. OBJECTIVE:We sought to evaluate learners' experiences with Learning Moment via a qualitative study. METHODS:We employed purposive sampling to recruit medical students who used Learning Moment during their rotation. We conducted 13 semistructured interviews (10 individual interviews and one 3-person group interview) between January and March 2017 using an ethnographic approach and utilized a general inductive method to analyze and code for potential themes. RESULTS:A total of 13 students (five in their third year of medical school and eight in their fourth year) voluntarily participated in our qualitative interviews. Five of the 13 (38%) students intended to pursue emergency medicine as their chosen field of specialty. The median number of "learning moments" logged by these students is 6. From our analysis, three key themes emerged relating to the perceived impact of Learning Moment on student learning: (1) logging "learning moments" enhanced memorization, (2) improved learning through reflection, and (3) sharing of knowledge and experiences in a community of practice. CONCLUSIONS:Learning Moment was successfully implemented into the educational infrastructure in our department. Students identified three mechanisms by which the application optimizes experiential learning, including enabling the logging of "learning moments" to promote memorization, encouraging reflection to facilitate learning, and fostering the sharing of knowledge and experiences within a community of practice. The Learning Moment concept is potentially scalable to other departments, disciplines, and institutions as we seek to optimize experiential learning ecosystems for all trainees.