Dataset Information

Usability evaluation of an integrated electronic medication management system implemented in an oncology setting using the unified theory of the acceptance and use of technology.

ABSTRACT:

Background

Medication management processes in an Oncology setting are complex and difficult to examine in isolation from interrelated processes and contextual factors. This qualitative study aims to evaluate the usability of an Electronic Medication Management System (EMMS) implemented in a specialised oncology unit using the Unified Theory of Acceptance and Use of Technology (UTAUT) framework.

Methods

The study was conducted in a 12-bed outpatient Oncology unit of a major teaching hospital 6 months following implementation of a commercial EMMS. In-depth semi-structured interviews were conducted with doctors, nurses and pharmacists using the system to assess usability. The UTAUT framework was used to analyse the results, which facilitated evaluation of interrelated aspects and provided a structured summary of user experience and usability factors.

Results

Direct cross-comparison between user groups illustrated that doctors and pharmacists were generally satisfied with the facilitating conditions (hardware and training), but had divergent perceptions of performance (automation, standardised protocols and communication and documented) and effort (mental and temporal demand) expectancy. In counterpoint, nurses were generally satisfied across all constructs. Prior experience using an alternative EMMS influenced performance and effort expectancy and was related to early dissatisfaction with the EMMS. Furthermore, whilst not originally designed for the healthcare setting, the flexibility of the UTAUT allowed for translation to the hospital environment.

Conclusion

Nurses demonstrated overall satisfaction with the EMMS, whilst doctors and pharmacists perceived usability problems, particularly related to restricted automaticity and system complexity, which hindered perceived EMMS success. The study demonstrates the feasibility and utility of the UTAUT framework to evaluate usability of an EMMS for multiple user groups in the Oncology setting.

SUBMITTER: Dabliz R

PROVIDER: S-EPMC7789263 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Usability evaluation of an integrated electronic medication management system implemented in an oncology setting using the unified theory of the acceptance and use of technology.

Dabliz Racha R Poon Simon K SK Ritchie Angus A Burke Rosemary R Penm Jonathan J

BMC medical informatics and decision making 20210106 1

<h4>Background</h4>Medication management processes in an Oncology setting are complex and difficult to examine in isolation from interrelated processes and contextual factors. This qualitative study aims to evaluate the usability of an Electronic Medication Management System (EMMS) implemented in a specialised oncology unit using the Unified Theory of Acceptance and Use of Technology (UTAUT) framework.<h4>Methods</h4>The study was conducted in a 12-bed outpatient Oncology unit of a major teachin ...[more]

PMID: 33407411

Similar Datasets

Project description:BACKGROUND:Technology-based physical activity suggests new opportunities for public health initiatives. Yet only 45% of technology interventions are theoretically based, and the acceptability mechanisms have been insufficiently studied. Acceptability and acceptance theories have provided interesting insights, particularly the unified theory of acceptance and use of technology 2 (UTAUT2). In several studies, the psychometric qualities of acceptability scales have not been well demonstrated. OBJECTIVE:The aim of this study was to adapt the UTAUT2 to the electronic health (eHealth) context and provide a preliminary validation of the eHealth acceptability scale in a French sample. METHODS:In line with the reference validation methodologies, we carried out the following stages of validating the scale with a total of 576 volunteers: translation and adaptation, dimensionality tests, reliability tests, and construct validity tests. We used confirmatory factor analysis to validate a 22-item instrument with 7 subscales: Performance Expectancy, Effort Expectancy, Social Influence, Facilitating Conditions, Hedonic Motivation, Price Value, and Habit. RESULTS:The dimensionality tests showed that the bifactor confirmatory model presented the best fit indexes: ?2173=434.86 (P<.001), ?2/df=2.51, comparative fit index=.97, Tucker-Lewis index=.95, and root mean square error of approximation=.053 (90% CI .047-.059). The invariance tests of the eHealth acceptability factor structure by sex demonstrated no significant differences between models, except for the strict model. The partial strict model demonstrated no difference from the strong model. Cronbach alphas ranged from .77 to .95 for the 7 factors. We measured the internal reliability with a 4-week interval. The intraclass correlation coefficients for each subscale ranged from .62 to .88, and there were no significant differences in the t tests from time 1 to time 2. Assessments for convergent validity demonstrated that the eHealth acceptability constructs were significantly and positively related to behavioral intention, usage, and constructs from the technology acceptance model and the theory of planned behavior. CONCLUSIONS:The 22-item French-language eHealth acceptability scale, divided into 7 subscales, showed good psychometric qualities. This scale is thus a valid and reliable tool to assess the acceptability of eHealth technology in French-speaking samples and offers promising avenues in research, clinical practice, and marketing.

Project description:BackgroundChronic pain is a complex disease with high prevalence rates, and many individuals who are affected do not receive adequate treatment. As a complement to conventional therapies, eHealth interventions could provide many benefits to a multimodal treatment approach for patients with chronic pain, whereby future use is associated with the acceptance of these interventions.ObjectiveThis study aims to assess the acceptance of eHealth pain management interventions among patients with chronic pain and identify the influencing factors on acceptance. A further objective of the study is to evaluate the viability of the Unified Theory of Acceptance and Use of Technology (UTAUT) model and compare it with its extended version in terms of explained variance of acceptance.MethodsWe performed a cross-sectional web-based study. In total, 307 participants with chronic pain, as defined according to the International Association for the Study of Pain criteria, were recruited through flyers, posters, and web-based inquiries between December 2020 and July 2021. In addition to sociodemographic and medical data, the assessment included validated psychometric instruments and an extended version of the well-established UTAUT model. For statistical analyses, group comparisons and multiple hierarchical regression analyses were performed.ResultsThe acceptance of eHealth pain management interventions among patients with chronic pain was overall moderate to high (mean 3.67, SD 0.89). There was significant difference in acceptance among age groups (W=9674.0; r=0.156; P=.04). Effort expectancy (β=.37; P<.001), performance expectancy (β=.33; P<.001), and social influence (β=.34; P<.001) proved to be the most important predictors of acceptance. The extended UTAUT (including the original UTAUT factors as well as sociodemographic, medical, and eHealth-related factors) model explained 66.4% of the variance in acceptance, thus supporting the viability of the model. Compared with the original UTAUT model (performance expectancy, effort expectancy, and social influence), the extended model explained significantly more variance (F25,278=1.74; P=.02).ConclusionsGiven the association between acceptance and future use, the knowledge of the influencing factors on acceptance should be used in the development and promotion of eHealth pain management interventions. Overall, the acceptance of eHealth pain management interventions was moderate to high. In total, 8 predictors proved to be significant predictors of acceptance. The UTAUT model is a valuable instrument for determining acceptance as well as the factors that influence acceptance of eHealth pain management interventions among patients with chronic pain. The extended UTAUT model provided the greatest predictive value for acceptance.

Project description:BackgroundDigital games-based learning is a method of using digital games to impart knowledge. Virtual reality (VR) programs are a practical application of this method. Due to demographic changes, the nursing profession will become increasingly important. These VR applications can be of use in training nurses for future professional challenges they may encounter. The continuous development of VR applications enables trainees to encounter simulated real life effectively and to experience increasingly concrete situations. This can be of great importance in nursing education, since 3-dimensionality enables a better visualization of many fields of activity and can prevent potential future errors. In addition to this learning effect, VR applications also bring an element of fun to learning.ObjectiveThe aim of this qualitative research effort is to observe the degree of acceptance of VR applications by nursing students in Germany. Various factors, including social influences, performance expectations, and effort expectations, are taken into consideration.MethodsWith a qualitative cohort study, the acceptance of nursing students towards VR applications in anatomy teaching was determined. The 12 participants were first asked to fill out a quantitative questionnaire on their sociodemographic characteristics and the extent to which they valued and liked using technology. The participants were then allowed to test the VR application themselves and were finally asked about their experience in a qualitative interview. For the collection of data and the analysis of results, the unified theory of acceptance and use of technology was used in this study.ResultsOverall, the study shows that the interviewed persons rated the VR application quite positively. The greatest influence in this was the personal attitude towards technology; the higher this affinity is, the more useful the VR application appears. Social influences can also increase the participant's own acceptance if peers have a positive attitude towards such applications. The study shows that the trainees' motivation to learn was increased by using VR. We believe this is because each trainee could learn individually and the VR application was perceived as an enjoyable activity. Nevertheless, the cost factor of implementing VR applications in nursing training is currently still an obstacle, as not every institution has such financial capacities.ConclusionsThe extent to which the use of VR applications in the training of nursing staff is justified depends on the degree of personal acceptance. The collected results give good practice-oriented insight into the attitude of trainees towards VR. Many of the interviewed persons saw benefits in the use of VR technologies. As VR applications are constantly developing, it is necessary to conduct further studies on VR applications in nursing education and to include other possible disciplines in which these applications can be helpful.

Project description:BackgroundArtificial intelligence-enabled clinical decision support systems (AI-CDSSs) offer potential for improving health care outcomes, but their adoption among health care practitioners remains limited.ObjectiveThis meta-analysis identified predictors influencing health care practitioners' intention to use AI-CDSSs based on the Unified Theory of Acceptance and Use of Technology (UTAUT). Additional predictors were examined based on existing empirical evidence.MethodsThe literature search using electronic databases, forward searches, conference programs, and personal correspondence yielded 7731 results, of which 17 (0.22%) studies met the inclusion criteria. Random-effects meta-analysis, relative weight analyses, and meta-analytic moderation and mediation analyses were used to examine the relationships between relevant predictor variables and the intention to use AI-CDSSs.ResultsThe meta-analysis results supported the application of the UTAUT to the context of the intention to use AI-CDSSs. The results showed that performance expectancy (r=0.66), effort expectancy (r=0.55), social influence (r=0.66), and facilitating conditions (r=0.66) were positively associated with the intention to use AI-CDSSs, in line with the predictions of the UTAUT. The meta-analysis further identified positive attitude (r=0.63), trust (r=0.73), anxiety (r=-0.41), perceived risk (r=-0.21), and innovativeness (r=0.54) as additional relevant predictors. Trust emerged as the most influential predictor overall. The results of the moderation analyses show that the relationship between social influence and use intention becomes weaker with increasing age. In addition, the relationship between effort expectancy and use intention was stronger for diagnostic AI-CDSSs than for devices that combined diagnostic and treatment recommendations. Finally, the relationship between facilitating conditions and use intention was mediated through performance and effort expectancy.ConclusionsThis meta-analysis contributes to the understanding of the predictors of intention to use AI-CDSSs based on an extended UTAUT model. More research is needed to substantiate the identified relationships and explain the observed variations in effect sizes by identifying relevant moderating factors. The research findings bear important implications for the design and implementation of training programs for health care practitioners to ease the adoption of AI-CDSSs into their practice.

Project description:BACKGROUND:Electronic medical record (EMR) systems hold the exciting promise of accurate, real-time access to patient health care data and great potential to improve the quality of patient care through decision support to clinicians. This review evaluated the usability of EMR systems implemented in sub-Saharan Africa based on a usability evaluation criterion developed by the Healthcare Information and Management Systems Society (HIMSS). OBJECTIVE:This review aimed to evaluate EMR system implementations in sub-Saharan Africa against a well-defined evaluation methodology and assess their usability based on a defined set of metrics. In addition, the review aimed to identify the extent to which usability has been an enabling or hindering factor in the implementation of EMR systems in sub-Saharan Africa. METHODS:Five key metrics for evaluating EMR system usability were developed based on the methodology proposed by HIMSS. These were efficiency, effectiveness, ease of learning, cognitive load, and user satisfaction. A 5-point rating system was developed for the review. EMR systems in 19 reviewed publications were scored based on this rating system. It awarded 5 points per metric to any EMR system that was identified as excellent, 4 points for good, 3 points for fair, 2 points for poor, and 1 point for bad. In addition, each of the 5 key metrics carried a maximum weighted score of 20. The percentage scores for each metric were then computed from the weighted scores from which the final overall usability score was derived. RESULTS:In possibly contributing to the usability of implemented EMR systems, ease of learning obtained the highest percentage score of 71% (SD 1.09) followed by cognitive load in second place with a score of 68% (SD 1.62). Effectiveness followed closely in third place at 67% (SD 1.47) and efficiency was in fourth place at 64% (SD 1.04). User satisfaction came in last at 63% (SD 1.70). The overall usability score for all systems was calculated to be 66%. CONCLUSIONS:The usability of EMR systems implemented in sub-Saharan Africa has been good with ease of learning possibly being the biggest positive contributor to this rating. Cognitive load and effectiveness have also possibly positively influenced the usability of EMR systems, whereas efficiency and user satisfaction have perhaps contributed least to positively influencing EMR system usability.

Project description:BackgroundMobile health (mHealth) as an innovative form of information and communications technology can efficiently deliver high-quality health care by enhancing communication and health management, reducing costs, and increasing access to health services. An individual's internal health locus of control (HLOC) is found to be associated with the behavioral intent to adopt mHealth. However, little is known about the underlying mechanism of this association.ObjectiveThe primary objective of this study was to test the mediation influence of the Unified Theory of Acceptance and Use of Technology (UTAUT) on the relationship between internal HLOC and the behavioral intention to use mHealth.MethodsA total of 374 responses were collected from Malaysian adult users of mHealth, using convenience and snowball sampling methods. Partial least squares structural equation modeling was used to analyze the data. Data were collected for variables, including demographics, internal HLOC, and modified UTAUT constructs (ie, performance expectancy, effort expectancy, and social influence).ResultsThe results showed that there was no direct relationship between internal HLOC and the behavioral intention to use mHealth (β=-0.039, P=.32). The indirect relationship between internal HLOC and the intent to adopt mHealth was supported, indicating that the UTAUT constructs performance expectancy (β=0.104, P<.001), effort expectancy (β=0.056, P=.02), and social influence (β=0.057, P=.002) mediated this relationship. The results showed full mediation, with total variance explained at 47.2%.ConclusionsThis study developed an integrative model, where a health-related disposition (internal HLOC), mHealth-related beliefs (performance expectancy and effort expectancy), and normative pressure (social influence) were combined to explain the underlying mechanism of the behavioral intent to adopt mHealth. The results showed that the intention to adopt mHealth is mediated by the influence of UTAUT factors, while HLOC has no direct effect on adoption intention. The findings provide insights into augmenting mHealth adoption among the public by enhancing the perceived benefits of mHealth, helping design more effective and user-friendly mHealth tools, and capitalizing on social normative influence to adopt mHealth. This study utilized the constructs of the UTAUT model to determine the intention to use mHealth. Future research should focus on other health- and technology-related theories to ascertain other possible factors influencing the behavioral intent of mHealth adoption.

Project description:BackgroundSpecific learning difficulties (SpLD) include several disorders such as dyslexia, dyscalculia, and dysgraphia, and the children with these SpLD receive special education. However, the studies and the educational material so far focus mainly on one specific disorder.ObjectiveThis study's primary goal is to develop comprehensive training material for different types of SpLD, with five serious games addressing different aspects of the SpLD. The second focus is measuring the impact of adaptive difficulty level adjustment in the children's and their educators' usability and technology acceptance perception. Receiving feedback from the children and their educators, and refining the games according to their suggestions have also been essential in this two-phase study.MethodsA total of 10 SpLD educators and 23 children with different types of SpLD tested the prototypes of the five serious games (ie, Word game, Memory game, Category game, Space game, and Math game), gave detailed feedback, answered the System Usability Scale and Technology Acceptance Model (TAM) questionnaires, and applied think-aloud protocols during game play.ResultsThe games' standard and adaptive versions were analyzed in terms of average playtime and the number of false answers. Detailed analyses of the interviews, with word clouds and player performances, were also provided. The TAM questionnaires' average and mean values and box plots of each data acquisition session for the children and the educators were also reported via System Usability Scale and TAM questionnaires. The TAM results of the educators had an average of 8.41 (SD 0.87) out of 10 in the first interview and an average of 8.71 (SD 0.64) out of 10 in the second interview. The children had an average of 9.07 (SD 0.56) out of 10 in the first interview.ConclusionsBoth the educators and the children with SpLD enjoyed playing the games, gave positive feedback, and suggested new ways for improvement. The results showed that these games provide thorough training material for different types of SpLD with personalized and tailored difficulty systems. The final version of the proposed games will become a part of the special education centers' supplementary curriculum and training materials, making new enhancements and improvements possible in the future.

Dataset Information

Usability evaluation of an integrated electronic medication management system implemented in an oncology setting using the unified theory of the acceptance and use of technology.

Background

Methods

Results

Conclusion

Publications

Usability evaluation of an integrated electronic medication management system implemented in an oncology setting using the unified theory of the acceptance and use of technology.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets