Dataset Information

Exploring Usability Issues of a Smartphone-Based Physician-to-Physician Teleconsultation App in an Orthopedic Clinic: Mixed Methods Study.

ABSTRACT:

Background

Physician-to-physician teleconsultation has increasingly played an essential role in delivering optimum health care services, particularly in orthopedic practice. In this study, the usability of a smartphone app for teleconsultation among orthopedic specialists was investigated to explore issues informing further recommendations for improvement in the following iterations.

Objective

This study aimed to explore usability issues emerging from users' interactions with MEDIC app, a smartphone-based patient-centered physician-to-physician teleconsultation system.

Methods

Five attending physicians in the Department of Orthopedics in a large medical school in Bangkok, Thailand, were recruited and asked to perform 5 evaluation tasks, namely, group formation, patient registration, clinical data capturing, case record form creation, and teleconsultation. In addition, one expert user was recruited as the control participant. Think aloud was adopted while performing the tasks. Semistructured interviews were conducted after each task and prior to the exit. Quantitative and qualitative measures were used to identify usability issues in 7 domains based on the People At the Centre of Mobile Application Development model: effectiveness, efficiency, satisfaction, learnability, memorability, error, and cognitive load.

Results

Several measures indicate various aspects of usability of the app, including completion rates, time to completion, number of clicks, number of screens, errors, incidents where participants were unable to perform tasks, which had previously been completed, and perceived task difficulty. Major and critical usability issues based on participant feedback were rooted from the limitation of screen size and resolution. Errors in data input (eg, typing errors, miscalculation), action failures, and misinterpretation of data (ie, radiography) were the most critical and common issues found in this study. A few participants did not complete the assigned tasks mostly owing to the navigation design and misreading/misunderstanding icons. However, the novice users were quite positive that they would be able to become familiar with the app in a short period of time.

Conclusions

The usability issues in physician-to-physician teleconsultation systems in smartphones, in general, are derived from the limitations of smartphones and their operating systems. Although some recommendations were devised to handle these usability issues, usability evaluation for additional development should still be further investigated.

SUBMITTER: Choemprayong S

PROVIDER: S-EPMC8726029 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Each year, millions of older adults fall, with more than 1 out of 4 older people experiencing a fall annually, thereby causing a major social and economic impact. Falling once doubles one’s chances of falling again, making fall prediction an important aspect of preventative strategies. In this study, 22 older adults aged between 65 and 85 years were trained in the use of a smartphone-based fall prediction system. The system is designed to continuously assess fall risk by measuring various gait and balance parameters using a smart insole and smartphone, and is also designed to detect falls. The use case of the fall prediction system in question required the users to interact with the smartphone via an app for device syncing, data uploads, and checking system status. OBJECTIVE:The objective of this study was to observe the effect that basic smartphone training could have on the user experience of a group that is not technically proficient with smartphones when using a new connected health system. It was expected that even short rudimentary training could have a large effect on user experience and therefore increase the chances of the group accepting the new technology. METHODS:All participants received training on how to use the system smartphone app; half of the participants (training group) also received extra training on how to use basic functions of the smartphone, such as making calls and sending text messages, whereas the other half did not receive this extra training (no extra training group). Comparison of training group and no extra training group was carried out using metrics such as satisfaction rating, time taken to complete tasks, cues required to complete tasks, and errors made during tasks. RESULTS:The training group fared better in the first 3 days of using the system. There were significant recorded differences in number of cues required and errors committed between the two groups. By the fourth and fifth day of use, both groups were performing at the same level when using the system. CONCLUSIONS:Supplementary basic smartphone training may be critical in trials where a smartphone app–based system for health intervention purposes is being introduced to a population that is not proficient with technology. This training could prevent early technology rejection and increase the engagement of older participants and their overall user experience with the system.

Project description:BackgroundHealthy sleep is important not only for physical health but also for brain development in children. Several reports have revealed that Japanese adults and children have later bedtimes and shorter sleep durations compared with those in other countries, possibly because of Japanese culture and lifestyles. Therefore, an intervention tool that is suitable to the Japanese sociocultural environment is urgently needed to improve children's sleep problems in their early years.ObjectiveTo provide appropriate sleep health literacy to caregivers and change their parenting behavior, we developed a smartphone app that allows reciprocal interaction between caregivers and pediatric sleep experts. This paper describes a preliminary study to examine the app's basic design and functions and to establish its acceptability and usability in a small sample.MethodsA total of 10 caregivers and 10 infants (aged 18-28 months; 4/10, 40% boys) living in Japan participated in the study. At the start of the trial, the e-learning content regarding sleep health literacy was delivered via a smartphone. Thereafter, caregivers manually inputted recorded data about their own and their infant's sleep habits for 8 consecutive days per month for 2 months. After pediatric sleep experts retrieved this information from the Osaka University server, they specified the problems and provided multiple sleep habit improvement suggestions to caregivers. Caregivers then selected one of the feasible pieces of advice to practice and reported their child's sleep-related behaviors via the app. Actigraphy was used to monitor children's sleep behaviors objectively. The concordance between the information provided by caregivers and the actigraphy data was assessed. The acceptability and usability of the app were evaluated using self-report questionnaires completed by caregivers; qualitative feedback was obtained via semistructured interviews after the intervention.ResultsThere was no significant difference between the information provided by the caregivers and the actigraphy data for bedtimes and wake-up times (P=.13 to P=.97). However, there was a difference between the actigraphy data and the caregivers' reports of nighttime sleep duration and nighttime awakenings (P<.001 each), similar to prior findings. User feedback showed that 6 and 5 of the 10 caregivers rated the app easy to understand and easy to continue to use, respectively. Additionally, 6 of the 10 caregivers rated the app's operativity as satisfactory. Although this was a short-term trial, children's sleep habits, caregivers' sleep health consciousness, and parenting behaviors improved to some extent.ConclusionsThe present findings suggest that the app can easily be used and is acceptable by Japanese caregivers. Given the user feedback, the app has the potential to improve children's sleep habits by sending individualized advice that fits families' backgrounds and home lives. Further studies are needed to confirm the efficacy of the app and facilitate social implementation.

Project description:Obesity is a global epidemic. Behavioral change approaches towards improving nutrition, increasing physical activity level, improving sleep, and reducing sitting time are recommended as best practices in adolescent obesity management. However, access to evidence-based treatment is limited and portable technologies such as mobile apps may provide a useful platform to deliver such lifestyle interventions. No evidence-based validated app exists for obesity intervention; therefore, a novel mobile app (Reactivate) was developed for use in the Temple Street W82GO Healthy Lifestyles Program (W82GO).This study aimed to test the usability (technical effectiveness, efficiency, and user satisfaction) of the Reactivate mobile app in obese adolescents.Ten adolescents (7 males and 3 females, aged 12-17 years) who had been treated for obesity (>98th percentile for body mass index) at the Temple Street Children's University Hospital were recruited. Participants were given 8 tasks to complete in order to test the technical effectiveness of the app. A research assistant timed the user while completing each task in order to test the relative user efficiency of the app (time-on-task). The tasks fell into 5 categories and required the user to enter personal settings, find and answer surveys, create a message, use the goal setting feature, and enter details regarding their weight and height. In exploration of user satisfaction, each participant completed the standardized software usability measurement inventory (SUMI), which measures 5 aspects of user satisfaction: efficiency, effect, helpfulness, controllability, and learnability. Descriptive statistics were used to explore the mean relative user efficiency and SUMI scores.Mean age was 14.26 (SD 1.58) years. All adolescents completed each of the tasks successfully. The mean relative user efficiency scores were two to three times that of an expert user. Users responded that they would use Reactivate to monitor their growth over time, for motivation, and for goal setting. All users described Reactivate as an important mobile app.Our study describes the usability of a mobile app used in adolescent obesity management. Adolescents found Reactivate easy to use and their SUMI results indicated that the app scored high on user satisfaction. Usability testing is an important step towards refining the development of the Reactivate app, which can be used in the treatment of obesity. The study on the clinical efficacy of the Reactivate app is currently underway.

Project description:BACKGROUND:Falls have implications for older adults' health and well-being. Strength and balance interventions significantly reduce the risk of falls. However, patients do not always perform the unsupervised home exercise needed for fall reduction. OBJECTIVE:This study aims to develop motivational smartphone apps co-designed with health professionals and older adults to support patients to perform exercise proven to aid fall reduction and to explore the apps' usability and acceptability with both health professionals and patients. METHODS:There were 3 phases of app development that included analysis, design, and implementation. For analysis, we examined the literature to establish key app components and had a consultation with 12 older adults attending a strength and balance class, exercise instructors, and 3 fall services. For design, we created prototype apps and conducted 2 patient and public involvement workshops, one with 5 health professionals and the second with 8 older adults from an exercise group. The apps were revised based on the feedback. For implementation, we tested them with one fall service and their patients for 3 weeks. Participatory evaluation was used through testing, semistructured interviews, and focus groups to explore acceptability and usability. Focus groups were conducted with the service that tested the apps and two other services. Qualitative data were analyzed using the framework approach. RESULTS:On the basis of findings from the literature and consultations in the analysis phase, we selected Behavior Change Techniques, such as goal setting, action planning, and feedback on behavior, to be key parts of the app. We developed goals using familiar icons for patients to select and add while self-reporting exercise and decided to develop 2 apps, one for patients (My Activity Programme) and one for health professionals (Motivate Me). This enabled health professionals to guide patients through the goal-setting process, making it more accessible to nontechnology users. Storyboards were created during the design phase, leading to prototypes of "Motivate Me" and "My Activity Programme." Key changes from the workshops included being able to add more details about the patients' exercise program and a wider selection of goals within "Motivate Me." The overall app design was acceptable to health professionals and older adults. In total, 7 patients and 3 health professionals participated in testing in the implementation phase, with interviews conducted with 6 patients and focus groups, with 3 teams (11 health professionals). Barriers, facilitators, and further functionality were identified for both apps, with 2 cross-cutting themes around phone usability and confidence. CONCLUSIONS:The motivational apps were found to be acceptable for older adults taking part in the design stage and patients and health professionals testing the apps in a clinical setting. User-led design is important to ensure that the apps are usable and acceptable.

Project description:BackgroundReporting of medication errors is one of the essential mechanisms to identify risky health care systems and practices that lead to medication errors. Unreported medication errors are a real issue; one of the identified causes is a burdensome medication error reporting system. An anonymous and user-friendly mobile app for reporting medication errors could be an alternative method of reporting medication error in busy health care settings.ObjectiveThe objective of this paper is to report usability testing of the Medication Error Reporting App (MERA), a mobile app for reporting medication errors anonymously.MethodsQuantitative and qualitative methods were employed involving 45 different testers (pharmacists, doctors, and nurses) from a large tertiary hospital in Malaysia. Quantitative data was retrieved using task performance and rating of MERA and qualitative data were retrieved through focus group discussions. Three sessions, with 15 testers each session, were conducted from January to March 2018.ResultsThe majority of testers were pharmacists (23/45, 51%), female (35/45, 78%), and the mean age was 36 (SD 9) years. A total of 135 complete reports were successfully submitted by the testers (three reports per tester) and 79.2% (107/135) of the reports were correct. There was significant improvement in mean System Usability Scale scores in each session of the development process (P<.001) and mean time to report medication errors using the app was not significantly different between each session (P=.70) with an overall mean time of 6.7 (SD 2.4) minutes. Testers found the app easy to use, but doctors and nurses were unfamiliar with terms used especially medication process at which error occurred and type of error. Although, testers agreed the app can be used in the future for reporting, they were apprehensive about security, validation, and abuse of feedback featured in the app.ConclusionsMERA can be used to report medication errors easily by various health care personnel and it has the capacity to provide feedback on reporting. However, education on medication error reporting should be provided to doctors and nurses in Malaysia and the security of the app needs to be established to boost reporting by this method.

Project description:BackgroundInterventions delivered by smartphone apps have the potential to help drinkers reduce their consumption of alcohol. To optimize engagement and reduce the high rates of attrition associated with the use of digital interventions, it is necessary to ensure that an app's design and functionality is appropriate for its intended purposes and target population.AimsTo understand the usability of an app to help people reduce their alcohol consumption.MethodThe app, Drink Less, contains a core module focusing on goal setting, supplemented by five additional modules: self-monitoring and feedback, identity change, cognitive bias re-training, action planning, and social comparison. Two studies were conducted, a "think aloud" study performed with people using the app for the first time and a semistructured interview study performed after users had had access to the app for at least 2 weeks. A thematic analysis of the "think aloud" and interview transcripts was conducted by one coder and verified by a second.ResultsTwenty-four participants, half of whom were women and half from disadvantaged groups, took part in the two studies. Three main themes identified in the data were "Feeling lost and unsure of what to do next," "Make the app easy to use," and "Make the app beneficial and rewarding to use." These themes reflected participants' need for (i) guidance, particularly when first using the app or when entering data; (ii) the data entry process to be simple and the navigation intuitive; (iii) neither the amount of text nor range of options to be overwhelming; (iv) the app to reward them for effort and progress; and (v) it to be clear how the app could help alcohol reduction goals be reached.ConclusionFirst-time and experienced users want an alcohol reduction app to be easy, rewarding, and beneficial to use. An easy-to-use app would reduce user burden, offer ongoing help, and be esthetically pleasing. A rewarding and beneficial app would provide positive reinforcement, give feedback about progress, and demonstrate credibility. Users need help when first using the app, and they need a compelling reason to continue using it.