Dataset Information

Acceptability of an Embodied Conversational Agent for Type 2 Diabetes Self-Management Education and Support via a Smartphone App: Mixed Methods Study.

ABSTRACT:

Background

Embodied conversational agents (ECAs) are increasingly used in health care apps; however, their acceptability in type 2 diabetes (T2D) self-management apps has not yet been investigated.

Objective

This study aimed to evaluate the acceptability of the ECA (Laura) used to deliver diabetes self-management education and support in the My Diabetes Coach (MDC) app.

Methods

A sequential mixed methods design was applied. Adults with T2D allocated to the intervention arm of the MDC trial used the MDC app over a period of 12 months. At 6 months, they completed questions assessing their interaction with, and attitudes toward, the ECA. In-depth qualitative interviews were conducted with a subsample of the participants from the intervention arm to explore their experiences of using the ECA. The interview questions included the participants' perceptions of Laura, including their initial impression of her (and how this changed over time), her personality, and human character. The quantitative and qualitative data were interpreted using integrated synthesis.

Results

Of the 93 intervention participants, 44 (47%) were women; the mean (SD) age of the participants was 55 (SD 10) years and the baseline glycated hemoglobin A1c level was 7.3% (SD 1.5%). Overall, 66 of the 93 participants (71%) provided survey responses. Of these, most described Laura as being helpful (57/66, 86%), friendly (57/66, 86%), competent (56/66, 85%), trustworthy (48/66, 73%), and likable (40/66, 61%). Some described Laura as not real (18/66, 27%), boring (26/66, 39%), and annoying (20/66, 30%). Participants reported that interacting with Laura made them feel more motivated (29/66, 44%), comfortable (24/66, 36%), confident (14/66, 21%), happy (11/66, 17%), and hopeful (8/66, 12%). Furthermore, 20% (13/66) of the participants were frustrated by their interaction with Laura, and 17% (11/66) of the participants reported that interacting with Laura made them feel guilty. A total of 4 themes emerged from the qualitative data (N=19): (1) perceived role: a friendly coach rather than a health professional; (2) perceived support: emotional and motivational support; (3) embodiment preference acceptability of a human-like character; and (4) room for improvement: need for greater congruence between Laura's words and actions.

Conclusions

These findings suggest that an ECA is an acceptable means to deliver T2D self-management education and support. A human-like character providing ongoing, friendly, nonjudgmental, emotional, and motivational support is well received. Nevertheless, the ECA can be improved by increasing congruence between its verbal and nonverbal communication and accommodating user preferences.

Trial registration

Australian New Zealand Clinical Trials Registry CTRN12614001229662; https://tinyurl.com/yxshn6pd.

SUBMITTER: Baptista S

PROVIDER: S-EPMC7407258 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Acceptability of an Embodied Conversational Agent for Type 2 Diabetes Self-Management Education and Support via a Smartphone App: Mixed Methods Study.

Baptista Shaira S Wadley Greg G Bird Dominique D Oldenburg Brian B Speight Jane J

JMIR mHealth and uHealth 20200722 7

<h4>Background</h4>Embodied conversational agents (ECAs) are increasingly used in health care apps; however, their acceptability in type 2 diabetes (T2D) self-management apps has not yet been investigated.<h4>Objective</h4>This study aimed to evaluate the acceptability of the ECA (Laura) used to deliver diabetes self-management education and support in the My Diabetes Coach (MDC) app.<h4>Methods</h4>A sequential mixed methods design was applied. Adults with T2D allocated to the intervention arm ...[more]

PMID: 32706734

Similar Datasets

Project description:BackgroundSelf-management is the key recommendation for managing nonspecific low back pain (LBP). However, there are well-documented barriers to self-management; therefore, methods of facilitating adherence are required. Smartphone apps are increasingly being used to support self-management of long-term conditions such as LBP.ObjectiveThe aim of this study was to assess the usability and acceptability of the SELFBACK smartphone app, designed to support and facilitate self-management of non-specific LBP. The app provides weekly self-management plans, comprising physical activity, strength and flexibility exercises, and patient education. The plans are tailored to the patient's characteristics and symptom progress by using case-based reasoning methodology.MethodsThe study was carried out in 2 stages using a mixed-methods approach. All participants undertook surveys, and semistructured telephone interviews were conducted with a subgroup of participants. Stage 1 assessed an app version with only the physical activity component and a web questionnaire that collects information necessary for tailoring the self-management plans. The physical activity component included monitoring of steps recorded by a wristband, goal setting, and a scheme for sending personalized, timely, and motivational notifications to the user's smartphone. Findings from Stage 1 were used to refine the app and inform further development. Stage 2 investigated an app version that incorporated 3 self-management components (physical activity, exercises, and education). A total of 16 participants (age range 23-71 years) with ongoing or chronic nonspecific LBP were included in Stage 1, and 11 participants (age range 32-56 years) were included in Stage 2.ResultsIn Stage 1, 15 of 16 participants reported that the baseline questionnaire was easy to answer, and 84% (13/16) found the completion time to be acceptable. Overall, participants were positive about the usability of the physical activity component but only 31% (5/16) found the app functions to be well integrated. Of the participants, 90% (14/16) were satisfied with the notifications, and they were perceived as being personalized (12/16, 80%). In Stage 2, all participants reported that the web questionnaire was easy to answer and the completion time acceptable. The physical activity and exercise components were rated useful by 80% (8/10), while 60% (6/10) rated the educational component useful. Overall, participants were satisfied with the usability of the app; however, only 50% (5/10) found the functions to be well integrated, and 20% (2/10) found them to be inconsistent. Overall, 80% (8/10) of participants reported it to be useful for self-management. The interviews largely reinforced the survey findings in both stages.ConclusionsThis study has demonstrated that participants considered the SELFBACK app to be acceptable and usable and that they thought it would be useful for supporting self-management of LBP. However, we identified some limitations and suggestions useful to guide further development of the SELFBACK app and other mobile health interventions.

Project description:BackgroundVarenicline is a pharmacological intervention for tobacco dependence that is safe and effective in facilitating smoking cessation. Enhanced adherence to varenicline augments the probability of prolonged smoking abstinence. However, research has shown that one-third of people who use varenicline are nonadherent by the second week. There is evidence showing that behavioral support helps with medication adherence. We have designed an artificial intelligence (AI) conversational agent or health bot, called "ChatV," based on evidence of what works as well as what varenicline is, that can provide these supports. ChatV is an evidence-based, patient- and health care provider-informed health bot to improve adherence to varenicline. ChatV has been programmed to provide medication reminders, answer questions about varenicline and smoking cessation, and track medication intake and the number of cigarettes.ObjectiveThis study aims to explore the feasibility of the ChatV health bot, to examine if it is used as intended, and to determine the appropriateness of proceeding with a randomized controlled trial.MethodsWe will conduct a mixed methods feasibility study where we will pilot-test ChatV with 40 participants. Participants will be provided with a standard 12-week varenicline regimen and access to ChatV. Passive data collection will include adoption measures (how often participants use the chatbot, what features they used, when did they use it, etc). In addition, participants will complete questionnaires (at 1, 4, 8, and 12 weeks) assessing self-reported smoking status and varenicline adherence, as well as questions regarding the acceptability, appropriateness, and usability of the chatbot, and participate in an interview assessing acceptability, appropriateness, fidelity, and adoption. We will use "stop, amend, and go" progression criteria for pilot studies to decide if a randomized controlled trial is a reasonable next step and what modifications are required. A health equity lens will be adopted during participant recruitment and data analysis to understand and address the differences in uptake and use of this digital health solution among diverse sociodemographic groups. The taxonomy of implementation outcomes will be used to assess feasibility, that is, acceptability, appropriateness, fidelity, adoption, and usability. In addition, medication adherence and smoking cessation will be measured to assess the preliminary treatment effect. Interview data will be analyzed using the framework analysis method.ResultsParticipant enrollment for the study will begin in January 2024.ConclusionsBy using predetermined progression criteria, the results of this preliminary study will inform the determination of whether to advance toward a larger randomized controlled trial to test the effectiveness of the health bot. Additionally, this study will explore the acceptability, appropriateness, fidelity, adoption, and usability of the health bot. These insights will be instrumental in refining the intervention and the health bot.Trial registrationClinicalTrials.gov NCT05997901; https://classic.clinicaltrials.gov/ct2/show/NCT05997901.International registered report identifier (irrid)PRR1-10.2196/53556.

Project description:BACKGROUND:Falls have implications for older adults' health and well-being. Strength and balance interventions significantly reduce the risk of falls. However, patients do not always perform the unsupervised home exercise needed for fall reduction. OBJECTIVE:This study aims to develop motivational smartphone apps co-designed with health professionals and older adults to support patients to perform exercise proven to aid fall reduction and to explore the apps' usability and acceptability with both health professionals and patients. METHODS:There were 3 phases of app development that included analysis, design, and implementation. For analysis, we examined the literature to establish key app components and had a consultation with 12 older adults attending a strength and balance class, exercise instructors, and 3 fall services. For design, we created prototype apps and conducted 2 patient and public involvement workshops, one with 5 health professionals and the second with 8 older adults from an exercise group. The apps were revised based on the feedback. For implementation, we tested them with one fall service and their patients for 3 weeks. Participatory evaluation was used through testing, semistructured interviews, and focus groups to explore acceptability and usability. Focus groups were conducted with the service that tested the apps and two other services. Qualitative data were analyzed using the framework approach. RESULTS:On the basis of findings from the literature and consultations in the analysis phase, we selected Behavior Change Techniques, such as goal setting, action planning, and feedback on behavior, to be key parts of the app. We developed goals using familiar icons for patients to select and add while self-reporting exercise and decided to develop 2 apps, one for patients (My Activity Programme) and one for health professionals (Motivate Me). This enabled health professionals to guide patients through the goal-setting process, making it more accessible to nontechnology users. Storyboards were created during the design phase, leading to prototypes of "Motivate Me" and "My Activity Programme." Key changes from the workshops included being able to add more details about the patients' exercise program and a wider selection of goals within "Motivate Me." The overall app design was acceptable to health professionals and older adults. In total, 7 patients and 3 health professionals participated in testing in the implementation phase, with interviews conducted with 6 patients and focus groups, with 3 teams (11 health professionals). Barriers, facilitators, and further functionality were identified for both apps, with 2 cross-cutting themes around phone usability and confidence. CONCLUSIONS:The motivational apps were found to be acceptable for older adults taking part in the design stage and patients and health professionals testing the apps in a clinical setting. User-led design is important to ensure that the apps are usable and acceptable.

Project description:BackgroundThe poor engagement of men with HIV care is attributed to a number of factors: fear of stigma, masculine representations, concerns related to confidentiality, and the time commitment needed to visit public health clinics. Digital technologies are emerging as an approach to support the engagement of men with care.ObjectiveThis study aims to deliver a usable and engaging tablet-based app, called EPIC-HIV 2 (Empowering People through Informed Choices for HIV 2), to support men in making informed decisions about engaging with HIV care in rural KwaZulu Natal, South Africa.MethodsWe employed a mixed methods, iterative, and three-phased design that was guided by self-determination theory (SDT), a person-based approach, and human-computer interaction techniques. We reviewed related literature and conducted secondary analyses of existing data to identify barriers and facilitators to linkage to care and inform content development and design principles and used focus group discussions with members of the community advisory board and general community to evaluate a PowerPoint prototype of the app; used observations and guided questions with a convenience sample of potential users from the intervention community to iteratively test and refine a functioning interactive app; and conducted qualitative interviews and satisfaction surveys with actual users to evaluate acceptability.ResultsPhase 1 identified supply- and demand-side barriers to linkage to care. Specifically, clinics were feminized spaces unattractive to men with high social costs of attendance. Men did not feel vulnerable to HIV, preferred traditional medicine, and were afraid of the consequences of being HIV positive. Thus, the app needed to allow men to identify the long-term health benefits to themselves and their families of starting antiretroviral therapy early and remaining on it, and these benefits typically outweigh the social costs of attending and being seen at a clinic. SDT led to content design that emphasized long-term benefits but at the same time supported the need for autonomy, competence, and relatedness and informed decision making. Phase 2 indicated that we needed to use simpler text and more images to help users understand and navigate the app. Phase 3 indicated that the app was acceptable and likely to encourage men to link to care.ConclusionsWe found that iteratively developing the app with potential users using local narratives ensured that EPIC-HIV 2 is usable, engaging, and acceptable. Although the app encouraged men to link to HIV care, it was insufficient as a stand-alone intervention for men in our sample to exercise their full autonomy to link to HIV care without other factors such as it being convenient to initiate treatment, individual experiences of HIV, and support. Combining tailored digital interventions with other interventions to address a range of barriers to HIV care, especially supply-side barriers, should be considered in the future to close the present linkage gap in the HIV treatment cascade.

Project description:BackgroundAdolescents face unprecedented mental health challenges, and technology has the opportunity to facilitate access and support digitally connected generations. The combination of digital tools and live human connection may hold particular promise for resonating with and flexibly supporting young people's mental health.ObjectiveThis study aimed to describe the BeMe app-based platform to support adolescents' mental health and well-being and to examine app engagement, usability, and satisfaction.MethodsAdolescents in the United States, aged 13 to 20 years, were recruited via the web and enrolled between September 1 and October 31, 2022. App engagement, feature use, clinical functioning, and satisfaction with BeMe were examined for 30 days. BeMe provides content based on cognitive behavioral therapy, dialectical behavior therapy, motivational interviewing, and positive psychology; interactive activities; live text-based coaching; links to clinical services; and crisis support tools (digital and live).ResultsThe average age of the sample (N=13,421) was 15.04 (SD 1.7) years, and 56.72% (7612/13,421) identified with she/her pronouns. For the subsample that completed the in-app assessments, the mean scores indicated concern for depression (8-item Patient Health Questionnaire mean 15.68/20, SD 5.9; n=239), anxiety (7-item Generalized Anxiety Disorder Questionnaire mean 13.37/17, SD 5.0; n=791), and poor well-being (World Health Organization-Five Well-being Index mean 30.15/100, SD 16.1; n=1923). Overall, the adolescents engaged with BeMe for an average of 2.38 (SD 2.7) days in 7.94 (SD 24.1) sessions and completed 11.26 (SD 19.8) activities. Most adolescents engaged with BeMe's content (12,270/13,421, 91.42%), mood ratings (13,094/13,421, 97.56%), and interactive skills (10,098/13,421, 75.24%), and almost one-fifth of the adolescents engaged with coaching (2539/13,421, 18.92%), clinical resources (2411/13,421, 17.96%), and crisis support resources (2499/13,421, 18.62%). Overall app engagement (total activities) was highest among female and gender-neutral adolescents compared with male adolescents (all P<.001) and was highest among younger adolescents (aged 13-14 years) compared with all other ages (all P<.001). Satisfaction ratings were generally high for content (eg, 158/176, 89.8% rated as helpful and 1044/1139, 91.66% improved coping self-efficacy), activities (5362/8468, 63.32% helpful and 4408/6072, 72.6% useful in coping with big feelings), and coaching (747/894, 83.6% helpful and 747/894, 83.6% improved coping self-efficacy). Engagement (total activities completed) predicted the likelihood of app satisfaction (P<.001).ConclusionsMany adolescents downloaded the BeMe app and completed multiple sessions and activities. Engagement with BeMe was higher among female and younger adolescents. Ratings of BeMe's content, activities, and coaching were very positive for cognitive precursors aimed at reducing depression and anxiety and improving well-being. The findings will inform future app development to promote more sustained engagement, and future evaluations will assess the effects of BeMe on changes in mental health outcomes.

Project description:BackgroundHIV testing rates in sub-Saharan Africa remain below the targeted threshold, and primary care facilities struggle to provide adequate services. Innovative approaches that leverage digital technologies could improve HIV testing and access to treatment.ObjectiveThis study aimed to examine the feasibility and acceptability of Nolwazi_bot. It is an isiZulu-speaking conversational agent designed to support HIV self-testing (HIVST) in KwaZulu-Natal, South Africa.MethodsNolwazi_bot was designed with 4 different personalities that users could choose when selecting a counselor for their HIVST session. We recruited a convenience sample of 120 consenting adults and invited them to undertake an HIV self-test facilitated by the Nolwazi_bot. After testing, participants completed an interviewer-led posttest structured survey to assess their experience with the chatbot-supported HIVST.ResultsParticipants (N=120) ranged in age from 18 to 47 years, with half of them being men (61/120, 50.8%). Of the 120 participants, 111 (92.5%) had tested with a human counselor more than once. Of the 120 participants, 45 (37.5%) chose to be counseled by the female Nolwazi_bot personality aged between 18 and 25 years. Approximately one-fifth (21/120, 17.5%) of the participants who underwent an HIV self-test guided by the chatbot tested positive. Most participants (95/120, 79.2%) indicated that their HIV testing experience with a chatbot was much better than that with a human counselor. Many participants (93/120, 77.5%) reported that they felt as if they were talking to a real person, stating that the response tone and word choice of Nolwazi_bot reminded them of how they speak in daily conversations.ConclusionsThe study provides insights into the potential of digital technology interventions to support HIVST in low-income and middle-income countries. Although we wait to see the full benefits of mobile health, technological interventions including conversational agents or chatbots provide us with an excellent opportunity to improve HIVST by addressing the barriers associated with clinic-based HIV testing.

Project description:BackgroundDelivering self-management support to people with type 2 diabetes mellitus is essential to reduce the health system burden and to empower people with the skills, knowledge, and confidence needed to take an active role in managing their own health.ObjectiveThis study aims to evaluate the adoption, use, and effectiveness of the My Diabetes Coach (MDC) program, an app-based interactive embodied conversational agent, Laura, designed to support diabetes self-management in the home setting over 12 months.MethodsThis randomized controlled trial evaluated both the implementation and effectiveness of the MDC program. Adults with type 2 diabetes in Australia were recruited and randomized to the intervention arm (MDC) or the control arm (usual care). Program use was tracked over 12 months. Coprimary outcomes included changes in glycated hemoglobin (HbA1c) and health-related quality of life (HRQoL). Data were assessed at baseline and at 6 and 12 months, and analyzed using linear mixed-effects regression models.ResultsA total of 187 adults with type 2 diabetes (mean 57 years, SD 10 years; 41.7% women) were recruited and randomly allocated to the intervention (n=93) and control (n=94) arms. MDC program users (92/93 participants) completed 1942 chats with Laura, averaging 243 min (SD 212) per person over 12 months. Compared with baseline, the mean estimated HbA1c decreased in both arms at 12 months (intervention: 0.33% and control: 0.20%), but the net differences between the two arms in change of HbA1c (-0.04%, 95% CI -0.45 to 0.36; P=.83) was not statistically significant. At 12 months, HRQoL utility scores improved in the intervention arm, compared with the control arm (between-arm difference: 0.04, 95% CI 0.00 to 0.07; P=.04).ConclusionsThe MDC program was successfully adopted and used by individuals with type 2 diabetes and significantly improved the users' HRQoL. These findings suggest the potential for wider implementation of technology-enabled conversation-based programs for supporting diabetes self-management. Future studies should focus on strategies to maintain program usage and HbA1c improvement.Trial registrationAustralia New Zealand Clinical Trials Registry (ACTRN) 12614001229662; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?ACTRN=12614001229662.

Project description:BACKGROUND:Advancements in mobile phone technology offer huge potential for enhancing the timely delivery of health behavior change interventions. The development of smartphone-based health interventions (apps) is a rapidly growing field of research, yet there have been few longitudinal examinations of how people experience and use these apps within their day-to-day routines, particularly within the context of a hybrid Web- and app-based intervention. OBJECTIVE:This study used an in-depth mixed-methods design to examine individual variation in (1) impact on self-reported goal engagement (ie, motivation, self-efficacy, awareness, effort, achievement) of access to a weight management app (POWeR Tracker) when provided alongside a Web-based weight management intervention (POWeR) and (2) usage and views of POWeR Tracker. METHODS:Thirteen adults were provided access to POWeR and were monitored over a 4-week period. Access to POWeR Tracker was provided in 2 alternate weeks (ie, weeks 1 and 3 or weeks 2 and 4). Participants' goal engagement was measured daily via self-report. Mixed effects models were used to examine change in goal engagement between the weeks when POWeR Tracker was and was not available and whether the extent of change in goal engagement varied between individual participants. Usage of POWeR and POWeR Tracker was automatically recorded for each participant. Telephone interviews were conducted and analyzed using inductive thematic analysis to further explore participants' experiences using POWeR and POWeR Tracker. RESULTS:Access to POWeR Tracker was associated with a significant increase in participants' awareness of their eating (?1=0.31, P=.04) and physical activity goals (?1=0.28, P=.03). The level of increase varied between individual participants. Usage data showed that participants used the POWeR website for similar amounts of time during the weeks when POWeR Tracker was (mean 29 minutes, SD 31 minutes) and was not available (mean 27 minutes, SD 33 minutes). POWeR Tracker was mostly accessed in short bursts (mean 3 minutes, SD 2 minutes) during convenient moments or moments when participants deemed the intervention content most relevant. The qualitative data indicated that nearly all participants agreed that it was more convenient to access information on-the-go via their mobiles compared to a computer. However, participants varied in their views and usage of the Web- versus app-based components and the informational versus tracking tools provided by POWeR Tracker. CONCLUSIONS:This study provides evidence that smartphones have the potential to improve individuals' engagement with their health-related goals when used as a supplement to an existing online intervention. The perceived convenience of mobile access to information does not appear to deter use of Web-based interventions or strengthen the impact of app access on goal engagement. A mixed-methods design enabled exploration of individual variation in daily usage of the app-based tools.

Project description:BackgroundHealth care systems are increasingly looking to mobile device technologies (mobile health) to improve patient experience and health outcomes. SecondEars is a smartphone app designed to allow patients to audio-record medical consultations to improve recall, understanding, and health care self-management. Novel health interventions such as SecondEars often fail to be implemented post pilot-testing owing to inadequate user experience (UX) assessment, a key component of a comprehensive implementation strategy.ObjectiveThis study aimed to pilot the SecondEars app within an active clinical setting to identify factors necessary for optimal implementation. Objectives were to (1) investigate patient UX and acceptability, utility, and satisfaction with the SecondEars app, and (2) understand health professional perspectives on issues, solutions, and strategies for effective implementation of SecondEars.MethodsA mixed methods implementation study was employed. Patients were invited to test the app to record consultations with participating oncology health professionals. Follow-up interviews were conducted with all participating patients (or carers) and health professionals, regarding uptake and extent of app use. Responses to the Mobile App Rating Scale (MARS) were also collected. Interviews were analyzed using interpretive descriptive methodology; all quantitative data were analyzed descriptively.ResultsA total of 24 patients used SecondEars to record consultations with 10 multidisciplinary health professionals. In all, 22 of these patients used SecondEars to listen to all or part of the recording, either alone or with family. All 100% of patient participants reported in the MARS that they would use SecondEars again and recommend it to others. A total of 3 themes were identified from the patient interviews relating to the UX of SecondEars: empowerment, facilitating support in cancer care, and usability. Further, 5 themes were identified from the health professional interviews relating to implementation of SecondEars: changing hospital culture, mitigating medico-legal concerns, improving patient care, communication, and practical implementation solutions.ConclusionsData collected during pilot testing regarding recording use, UX, and health professional and patient perspectives will be important for designing an effective implementation strategy for SecondEars. Those testing the app found it useful and felt that it could facilitate the benefits of consultation recordings, along with providing patient empowerment and support. Potential issues regarding implementation were discussed, and solutions were generated.Trial registrationAustralia and New Zealand Clinical Trials Registry ACTRN12618000730202; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=373915&isClinicalTrial=False.

Dataset Information

Acceptability of an Embodied Conversational Agent for Type 2 Diabetes Self-Management Education and Support via a Smartphone App: Mixed Methods Study.

Background

Objective

Methods

Results

Conclusions

Trial registration

Publications

Acceptability of an Embodied Conversational Agent for Type 2 Diabetes Self-Management Education and Support via a Smartphone App: Mixed Methods Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets