Dataset Information

An 11-Item Measure of User- and Human-Centered Design for Personal Health Tools (UCD-11): Development and Validation.

ABSTRACT:

Background

Researchers developing personal health tools employ a range of approaches to involve prospective users in design and development.

Objective

The aim of this paper was to develop a validated measure of the human- or user-centeredness of design and development processes for personal health tools.

Methods

We conducted a psychometric analysis of data from a previous systematic review of the design and development processes of 348 personal health tools. Using a conceptual framework of user-centered design, our team of patients, caregivers, health professionals, tool developers, and researchers analyzed how specific practices in tool design and development might be combined and used as a measure. We prioritized variables according to their importance within the conceptual framework and validated the resultant measure using principal component analysis with Varimax rotation, classical item analysis, and confirmatory factor analysis.

Results

We retained 11 items in a 3-factor structure explaining 68% of the variance in the data. The Cronbach alpha was .72. Confirmatory factor analysis supported our hypothesis of a latent construct of user-centeredness. Items were whether or not: (1) patient, family, caregiver, or surrogate users were involved in the steps that help tool developers understand users or (2) develop a prototype, (3) asked their opinions, (4) observed using the tool or (5) involved in steps intended to evaluate the tool, (6) the process had 3 or more iterative cycles, (7) changes between cycles were explicitly reported, (8) health professionals were asked their opinion and (9) consulted before the first prototype was developed or (10) between initial and final prototypes, and (11) a panel of other experts was involved.

Conclusions

The User-Centered Design 11-item measure (UCD-11) may be used to quantitatively document the user/human-centeredness of design and development processes of patient-centered tools. By building an evidence base about such processes, we can help ensure that tools are adapted to people who will use them, rather than requiring people to adapt to tools.

SUBMITTER: Witteman HO

PROVIDER: S-EPMC8074832 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundTo improve chronic disease outcomes, self-management is an effective strategy. An electronic personal health record (ePHR) is a promising tool with the potential to support chronic patient's education, counseling, and self-management. Fitting ePHRs within the daily practices of chronic care providers and chronic patients requires user-centered design approaches. We aimed to understand users' needs and requirements in chronic kidney disease (CKD) care to consider in the design of an ePHR to facilitate its implementation, adoption, and use.MethodsA qualitative study was conducted in a major Iranian nephrology center including inpatient and outpatient settings in 2019. We conducted 28 semi-structured interviews with CKD patients, nurses, and adult nephrologists. To confirm or modify the requirements extracted from the interviews, a focus group was also held. Data were analyzed to extract especially those requirements that can facilitate implementation, adoption, and sustained use based on the PHR adoption model and the unified theory of acceptance and use of technology.ResultsParticipants requested an ePHR that provides access to up to date patient information, facilitates patient-provider communication, and increases awareness about patient individualized conditions. Participants expected a system that is able to cater to low patient e-health literacy and high provider workload. They requested the ePHR to include purposeful documentation of medical history, diagnostic and therapeutic procedures, tailored educational content, and scheduled care reminders. Messaging function, tailored educational content to individual patients' conditions, and controlled access to information were highly valued in order to facilitate its implementation, adoption, and use.ConclusionsWe focused on the ePHR's content and functionalities in the face of facilitators and/or barriers envisioned for its adoption in nephrology care. Designers and implementers should value CKD patients' needs and requirements for self-management such as providing personalized education and counseling (on the basis of their condition and risk factors), health literacy, and disease progression levels. The socio-technical aspects of care also need further attention to facilitate ePHR's adoption.

Project description:Long-term admissions in psychiatric facilities often result in a gradual erosion of the identity of people diagnosed with severe mental illnesses (SMIs) into merely "patient." Moreover, experiences of loss often reduced people's sense of purpose. Although regaining a multidimensional identity and a sense of purpose are essential for personal recovery, few interventions specifically address this, while at the same time take people's often considerable cognitive and communicative disabilities into consideration. This study describes the development process of a new intervention through user-centered design (UCD). UCD is an iterative process in which a product (in this case, an intervention) is developed in close cooperation with future users, such that the final product matches their needs. The design process included three phases: an analysis, design, and evaluation phase. In the analysis phase, the "problem" was defined, users' needs were identified, and design criteria were established. In the design phase, the collected information served as input to create a testable prototype using a process of design and redesign, in close collaboration with service users and other stakeholders. This resulted in an intervention entitled "This is Me" (TiM) in which service users, together with a self-chosen teammate, actively engage in new experiences on which they are prompted to reflect. Finally, in the evaluation phase, TiM was implemented and evaluated in a real-life setting. In a small feasibility pilot, we found indications that some people indeed demonstrated increased reflection on their identity during the intervention. Furthermore, TiM seemed to benefit the relationship between the service users and the mental health professionals with whom they underwent the experiences. The pilot also revealed some aspects of the (implementation of) TiM that can be improved. Overall, we conclude that UCD is a useful method for the development of a new psychosocial intervention. The method additionally increased our knowledge about necessary factors in targeting personal recovery for people with complex mental health needs. Moreover, we conclude that TiM is a promising tool for supporting people with SMI in redeveloping a multidimensional identity and a renewed sense of purpose.

Project description:BackgroundConversational chatbots are an emerging digital intervention for smoking cessation. No studies have reported on the entire development process of a cessation chatbot.ObjectiveWe aim to report results of the user-centered design development process and randomized controlled trial for a novel and comprehensive quit smoking conversational chatbot called QuitBot.MethodsThe 4 years of formative research for developing QuitBot followed an 11-step process: (1) specifying a conceptual model; (2) conducting content analysis of existing interventions (63 hours of intervention transcripts); (3) assessing user needs; (4) developing the chat's persona ("personality"); (5) prototyping content and persona; (6) developing full functionality; (7) programming the QuitBot; (8) conducting a diary study; (9) conducting a pilot randomized controlled trial (RCT); (10) reviewing results of the RCT; and (11) adding a free-form question and answer (QnA) function, based on user feedback from pilot RCT results. The process of adding a QnA function itself involved a three-step process: (1) generating QnA pairs, (2) fine-tuning large language models (LLMs) on QnA pairs, and (3) evaluating the LLM outputs.ResultsWe developed a quit smoking program spanning 42 days of 2- to 3-minute conversations covering topics ranging from motivations to quit, setting a quit date, choosing Food and Drug Administration-approved cessation medications, coping with triggers, and recovering from lapses and relapses. In a pilot RCT with 96% three-month outcome data retention, QuitBot demonstrated high user engagement and promising cessation rates compared to the National Cancer Institute's SmokefreeTXT text messaging program, particularly among those who viewed all 42 days of program content: 30-day, complete-case, point prevalence abstinence rates at 3-month follow-up were 63% (39/62) for QuitBot versus 38.5% (45/117) for SmokefreeTXT (odds ratio 2.58, 95% CI 1.34-4.99; P=.005). However, Facebook Messenger intermittently blocked participants' access to QuitBot, so we transitioned from Facebook Messenger to a stand-alone smartphone app as the communication channel. Participants' frustration with QuitBot's inability to answer their open-ended questions led to us develop a core conversational feature, enabling users to ask open-ended questions about quitting cigarette smoking and for the QuitBot to respond with accurate and professional answers. To support this functionality, we developed a library of 11,000 QnA pairs on topics associated with quitting cigarette smoking. Model testing results showed that Microsoft's Azure-based QnA maker effectively handled questions that matched our library of 11,000 QnA pairs. A fine-tuned, contextualized GPT-3.5 (OpenAI) responds to questions that are not within our library of QnA pairs.ConclusionsThe development process yielded the first LLM-based quit smoking program delivered as a conversational chatbot. Iterative testing led to significant enhancements, including improvements to the delivery channel. A pivotal addition was the inclusion of a core LLM-supported conversational feature allowing users to ask open-ended questions.Trial registrationClinicalTrials.gov NCT03585231; https://clinicaltrials.gov/study/NCT03585231.