Toward an optimal quantitative design method integrating user-centered qualitative attributes.
Ontology highlight
ABSTRACT:
SUBMITTER: Bertheaux C
PROVIDER: S-EPMC6657721 | biostudies-literature | 2019 Jul
REPOSITORIES: biostudies-literature
Publications
Toward an optimal quantitative design method integrating user-centered qualitative attributes.
Bertheaux Cyril C Toscano Rosario R Fortunier Roland R Borg Céline C
Food science & nutrition 20190529 7
The determination of product features, which can be seen as design specifications, is a crucial problem that must be carried out upstream to quickly validate the product configuration according to some attributes in relation to the user perception. To this end, the design methods must evolve toward an analysis compatible with various kind of data that can be qualitative or quantitative. In this paper, a new approach is introduced able to take into account various kind of information in order to ...[more]
Similar Datasets
Project description:Backgrounde-Consultations between primary care physicians and specialists are a valuable means of improving access to specialty care. Adolescents and young adults (AYAs) face unique challenges in accessing limited adolescent medicine specialty care resources, which contributes to delayed or forgone care. e-Consultations between general pediatricians and adolescent medicine specialists may alleviate these barriers to care. However, the optimal application of this model in adolescent medicine requires careful attention to the nuances of AYA care.ObjectiveThis study aims to qualitatively analyze feedback obtained during the iterative development of an e-consultation system for communication between general pediatricians and adolescent medicine specialists tailored to the specific health care needs of AYAs.MethodsWe conducted an iterative user-centered design and evaluation process in two phases. In the first phase, we created a static e-consultation prototype and storyboards and evaluated them with target users (general pediatricians and adolescent medicine specialists). In the second phase, we incorporated feedback to develop a functional prototype within the electronic health record and again evaluated this with general pediatricians and adolescent medicine specialists. In each phase, general pediatricians and adolescent medicine specialists provided think-aloud feedback during the use of the prototypes and semistructured exit interviews, which was qualitatively analyzed to identify perspectives related to the usefulness and usability of the e-consultation system.ResultsBoth general pediatricians (n=12) and adolescent medicine specialists (n=12) perceived the usefulness of e-consultations for AYA patients, with more varied perceptions of potential usefulness for generalist and adolescent medicine clinicians. General pediatricians and adolescent medicine specialists discussed ways to maximize the usability of e-consultations for AYAs, primarily by improving efficiency (eg, reducing documentation, emphasizing critical information, using autopopulated data fields, and balancing specificity and efficiency through text prompts) and reducing the potential for errors (eg, prompting a review of autopopulated data fields, requiring physician contact information, and prompting explicit discussion of patient communication and confidentiality expectations). Through iterative design, patient history documentation was streamlined, whereas documentation of communication and confidentiality expectations were enhanced.ConclusionsThrough an iterative user-centered design process, we identified user perspectives to guide the refinement of an e-consultation system based on general pediatrician and adolescent medicine specialist feedback on usefulness and usability related to the care of AYAs. Qualitative analysis of this feedback revealed both opportunities and risks related to confidentiality, communication, and the use of tailored documentation prompts that should be considered in the development and use of e-consultations with AYAs.
| S-EPMC8380586 | biostudies-literature
Project description:BackgroundContingency management (CM) is one of the only behavioral interventions shown to be effective for the treatment of opioid use disorders when delivered alone and in combination with pharmacotherapy. Despite extensive empirical support, uptake of CM in community settings remains abysmally low. The current study applied user-centered design principles to gather qualitative data on familiarity with CM, current clinical practice, and preferences regarding the implementation of CM in community-based opioid treatment programs.MethodsParticipants were 21 leaders and 22 front-line counselors from 11 community-based opioid treatment programs. Semi-structured interviews were about 45 min long. Transcripts from each interview were coded by independent raters and analyzed using a reflexive team approach. Frequencies of responses were tallied, and queries were run in NVivo to identify exemplar quotes for each code.ResultsResults indicated low familiarity with CM, with less than half of the respondents defining CM correctly and over 40% of respondents declining to answer/ did not know. Abstinence was the most commonly recommended CM target, yet over 70% of respondents indicated that urine screens only occurred monthly. Attendance was also a popular recommendation, with respondents suggesting a range of possible indices including counseling, dosing, and/or case management sessions. Regarding the ideal role to administer CM prizes, program directors and supervisors were most commonly recommended, closely followed by front-line counselors. The most commonly suggested strategies to afford CM incentives included soliciting community donations and offering non-financial incentives.ConclusionsUser design principles to understand workflow constraints, target user needs, and simplify the intervention guided this qualitative investigation of CM implementation in opioid treatment programs. Findings highlighted the potential value of flexible, organization-specific definitions of CM attendance and non-financial incentives, as well as active involvement of clinical leaders and supervisors to promote buy in among staff/patients. Respondents were generally optimistic about their ability to fundraise or solicit donations to overcome cost-related barriers of CM. Implications for CM implementation strategies, including the use of targeted leadership coaching focused on sustainability, are explored.
| S-EPMC6617614 | biostudies-literature
Project description:BackgroundAccounting for how end users engage with technologies is imperative for designing an efficacious mobile behavioral intervention.ObjectiveThis mixed methods analysis examined the translational potential of user-centered design and basic behavioral science to inform the design of a new mobile intervention for obesity and binge eating.MethodsA total of 22 adults (7/22, 32% non-Hispanic White; 8/22, 36% male) with self-reported obesity and recurrent binge eating (≥12 episodes in 3 months) who were interested in losing weight and reducing binge eating completed a prototyping design activity over 1 week. Leveraging evidence from behavioral economics on choice architecture, participants chose treatment strategies from 20 options (aligned with treatment targets composing a theoretical model of the relation between binge eating and weight) to demonstrate which strategies and treatment targets are relevant to end users. The process by which participants selected and implemented strategies and their change in outcomes were analyzed.ResultsAlthough prompted to select one strategy, participants selected between 1 and 3 strategies, citing perceived achievability, helpfulness, or relevance as selection reasons. Over the week, all practiced a strategy at least once; 82% (18/22) struggled with implementation, and 23% (5/22) added a new strategy. Several themes emerged on successes and challenges with implementation, yielding design implications for supporting users in behavior change. In postexperiment reflections, 82% (18/22) indicated the strategy was helpful, and 86% (19/22) planned to continue use. One-week average within-subject changes in weight (-2.2 [SD -5.0] pounds) and binge eating (-1.6 [SD -1.8] episodes) indicated small clinical improvement.ConclusionsApplying user-centered design and basic behavioral science yielded design insights to incorporate personalization through user choice with guidance, which may enhance engagement with and potential efficacy of digital health interventions.
| S-EPMC8145081 | biostudies-literature
Project description:BackgroundChildhood overweight and obesity are major health challenges in the United States. One of the recommendations to combat obesity is to maintain a healthy diet, which is often best supported by eating home-cooked meals to control cooking methods, ingredients, and portions. Diet control through home cooking is challenged because of the decline in culinary skills in the population and a paucity of effective culinary nutrition education (CNE) programs. Providing technology-enabled CNE (CNE-tech) to overweight and obese adolescents can equip them with life skills that can assist them in the future. Such skills can facilitate saving money, eating healthier, and creating social environments. In addition, CNE builds cooking confidence and food literacy that in turn can build adolescent self-efficacy, particularly toward managing their health behaviors.ObjectiveThis study aimed to inform functionalities, design requirements, and the context of use for CNE-tech that could enhance overweight and obese adolescents' healthy food literacy, cooking confidence, and general self-efficacy with regard to self-management to ultimately promote healthy lifestyle management.MethodsThe design science study was completed in 2 distinct phases engaging overweight and obese adolescents, parents of overweight and obese adolescents, and the health care providers that treat adolescents with these conditions. Phase 2, our primary source of data, involved user-centered design methods including the following: (1) early stage prototype usability analysis, (2) semistructured interviews with 70 overweight or obese adolescents engaged in a healthy behavior program, and (3) semistructured interviews with 10 health care providers. Data were analyzed using constant comparison analysis to identify functionalities, design requirements, and inform the context of use of CNE-tech.ResultsData revealed specific desired functionalities for the CNE-tech related to building cooking skills, populating a healthy recipe database, suggesting healthy alternatives, supporting the construction of a healthy plate, and the ability to share healthy recipes and cooking accomplishments. Moreover, the adolescents provided design requirements pertaining to the presentation (eg, vivid colors, semirealistic images, and cooking sounds), use of multimedia, and gaming. Data further revealed contextual factors, such as shared experiences with family members and enhanced continued use.ConclusionsWe demonstrate the potentiality of creating CNE-tech that could effectively lead to better self-care and induce sustainable behavioral change as it facilitates skill building, self-efficacy, and a pathway that enables overweight and obese adolescents to influence cooking habits in their family home and future dwellings. Our CNE-tech-proposed solution aligns with the goals of overweight and obese adolescents and also reflects existing theories about behavioral change.
| S-EPMC6690165 | biostudies-literature
Project description:BackgroundThe goal of user-centered design (UCD) is to understand the users' perspective and to use that knowledge to shape more effective solutions. The UCD approach provides insight into users' needs and requirements and thereby improves the design of the developed services. However, involving users in the development process does not guarantee that feedback from different subgroups of users will shape the development in ways that will make the solutions more useful for the entire target user population.ObjectiveThe aim of this study was to describe a protocol for systematic analysis and prioritization of feedback from user subgroups in the usability testing of a digital motivation support for fall-preventive physical activity (PA) interventions in seniors (aged 65 years and older). This protocol can help researchers and developers to systematically exploit feedback from relevant user subgroups in UCD.MethodsGender, PA level, and level of technology experience have been identified in the literature to influence users' experience and use of digital support systems for fall-preventive PA interventions in seniors. These 3 key user characteristics were dichotomized and used to define 8 (ie, 23) possible user subgroups. The presented method enables systematic tracking of the user subgroups' contributions in iterative development. The method comprises (1) compilation of difficulties and deficiencies in the digital applications identified in usability testing, (2) clustering of the identified difficulties and deficiencies, and (3) prioritization of deficiencies to be rectified. Tracking user subgroup representation in the user feedback ensures that the development process is prioritized according to the needs of different subgroups. Mainly qualitative data collection methods are used.ResultsA protocol was developed to ensure that feedback from users representing all possible variants of 3 selected key user characteristics (gender, PA level, and level of technology experience) is considered in the iterative usability testing of a digital support for seniors' PA. The method was applied in iterative usability testing of two digital applications during spring/summer 2018. Results from the study on the users' experiences and the iterative modification of the digital applications are expected to be published during 2021.ConclusionsMethods for systematic collection, analysis, and prioritization of feedback from user subgroups might be particularly important in heterogenous user groups (eg, seniors). This study can contribute to identifying and improving the understanding of potential differences between user subgroups of seniors in their use and experiences of digital support for fall-preventive PA interventions. This knowledge may be relevant for developing digital support systems that are appropriate, useful, and attractive to users and for enabling the design of digital support systems that target specific user subgroups (ie, tailoring of the support). The protocol needs to be further used and investigated in order to validate its potential value.International registered report identifier (irrid)RR1-10.2196/20061.
| S-EPMC7781794 | biostudies-literature
Project description:BackgroundTo improve chronic disease outcomes, self-management is an effective strategy. An electronic personal health record (ePHR) is a promising tool with the potential to support chronic patient's education, counseling, and self-management. Fitting ePHRs within the daily practices of chronic care providers and chronic patients requires user-centered design approaches. We aimed to understand users' needs and requirements in chronic kidney disease (CKD) care to consider in the design of an ePHR to facilitate its implementation, adoption, and use.MethodsA qualitative study was conducted in a major Iranian nephrology center including inpatient and outpatient settings in 2019. We conducted 28 semi-structured interviews with CKD patients, nurses, and adult nephrologists. To confirm or modify the requirements extracted from the interviews, a focus group was also held. Data were analyzed to extract especially those requirements that can facilitate implementation, adoption, and sustained use based on the PHR adoption model and the unified theory of acceptance and use of technology.ResultsParticipants requested an ePHR that provides access to up to date patient information, facilitates patient-provider communication, and increases awareness about patient individualized conditions. Participants expected a system that is able to cater to low patient e-health literacy and high provider workload. They requested the ePHR to include purposeful documentation of medical history, diagnostic and therapeutic procedures, tailored educational content, and scheduled care reminders. Messaging function, tailored educational content to individual patients' conditions, and controlled access to information were highly valued in order to facilitate its implementation, adoption, and use.ConclusionsWe focused on the ePHR's content and functionalities in the face of facilitators and/or barriers envisioned for its adoption in nephrology care. Designers and implementers should value CKD patients' needs and requirements for self-management such as providing personalized education and counseling (on the basis of their condition and risk factors), health literacy, and disease progression levels. The socio-technical aspects of care also need further attention to facilitate ePHR's adoption.
| S-EPMC8611831 | biostudies-literature
Project description:The success of smart homes is fundamentally dependent on their adoption and use by people in the context of daily life. This study investigated ways to control and adapt the technology to fulfill user daily needs, which are the active drivers of smart housing technology adoption. A framework of smart home services was developed by focusing on the practicability of each variable from the perspective of supporting user experience. By developing scenarios based on previous studies, we identified residents' behaviors and intentions regarding smart home technology and its use. Their issues were identified through the health problems and daily activities identified in the scenarios, and customized smart home services were developed for each resident based on technical solutions, space requirements, and design solutions. The main strength of this study is the adoption of user-centered methods to build a rich picture of the issues that affect households and the community related to the design, installation, and use of technology.
| S-EPMC7100148 | biostudies-literature
Project description:Despite pervasive findings pointing to its inextricable role in intervention implementation, context remains poorly understood in implementation science. Existing approaches for describing context (e.g., surveys, interviews) may be narrow in scope or superficial in their elicitation of contextual data. Thus, in-depth and multilevel approaches are needed to meaningfully describe the contexts into which interventions will be implemented. Moreover, many studies assess context without subsequently using contextual information to enhance implementation. To be useful for improving implementation, though, methods are needed to apply contextual information during implementation. In the case example presented in this paper, we embedded an ethnographic assessment of context within a user-centered design approach to describe implementation context and apply that information to promote implementation. We developed a patient-reported outcome measure-based clinical intervention to assess and address the pervasive unmet needs of young adults with cancer: the Needs Assessment & Service Bridge (NA-SB). In this paper, we describe the user-centered design process that we used to anticipate context modifications needed to deliver NA-SB and implementation strategies needed to facilitate its implementation. Our ethnographic contextual inquiry yielded a rich understanding of local implementation context and contextual variation across potential scale-up contexts. Other methods from user-centered design (i.e., translation tables and a design team prototyping workshop) allowed us to translate that information into specifications for NA-SB delivery and a plan for implementation. Embedding ethnographic methods within a user-centered design approach can help us to tailor interventions and implementation strategies to their contexts of use to promote implementation.
| S-EPMC8826991 | biostudies-literature
Project description:BACKGROUND:There is an increasing interest in clinical prediction tools that can achieve high prediction accuracy and provide explanations of the factors leading to increased risk of adverse outcomes. However, approaches to explaining complex machine learning (ML) models are rarely informed by end-user needs and user evaluations of model interpretability are lacking in the healthcare domain. We used extended revisions of previously-published theoretical frameworks to propose a framework for the design of user-centered displays of explanations. This new framework served as the basis for qualitative inquiries and design review sessions with critical care nurses and physicians that informed the design of a user-centered explanation display for an ML-based prediction tool. METHODS:We used our framework to propose explanation displays for predictions from a pediatric intensive care unit (PICU) in-hospital mortality risk model. Proposed displays were based on a model-agnostic, instance-level explanation approach based on feature influence, as determined by Shapley values. Focus group sessions solicited critical care provider feedback on the proposed displays, which were then revised accordingly. RESULTS:The proposed displays were perceived as useful tools in assessing model predictions. However, specific explanation goals and information needs varied by clinical role and level of predictive modeling knowledge. Providers preferred explanation displays that required less information processing effort and could support the information needs of a variety of users. Providing supporting information to assist in interpretation was seen as critical for fostering provider understanding and acceptance of the predictions and explanations. The user-centered explanation display for the PICU in-hospital mortality risk model incorporated elements from the initial displays along with enhancements suggested by providers. CONCLUSIONS:We proposed a framework for the design of user-centered displays of explanations for ML models. We used the proposed framework to motivate the design of a user-centered display of an explanation for predictions from a PICU in-hospital mortality risk model. Positive feedback from focus group participants provides preliminary support for the use of model-agnostic, instance-level explanations of feature influence as an approach to understand ML model predictions in healthcare and advances the discussion on how to effectively communicate ML model information to healthcare providers.
| S-EPMC7545557 | biostudies-literature
Project description:BackgroundAlthough effective mental health treatments exist, the ability to match individuals to optimal treatments is poor, and timely assessment of response is difficult. One reason for these challenges is the lack of objective measurement of psychiatric symptoms. Sensors and active tasks recorded by smartphones provide a low-burden, low-cost, and scalable way to capture real-world data from patients that could augment clinical decision-making and move the field of mental health closer to measurement-based care.ObjectiveThis study tests the feasibility of a fully remote study on individuals with self-reported depression using an Android-based smartphone app to collect subjective and objective measures associated with depression severity. The goals of this pilot study are to develop an engaging user interface for high task adherence through user-centered design; test the quality of collected data from passive sensors; start building clinically relevant behavioral measures (features) from passive sensors and active inputs; and preliminarily explore connections between these features and depression severity.MethodsA total of 600 participants were asked to download the study app to join this fully remote, observational 12-week study. The app passively collected 20 sensor data streams (eg, ambient audio level, location, and inertial measurement units), and participants were asked to complete daily survey tasks, weekly voice diaries, and the clinically validated Patient Health Questionnaire (PHQ-9) self-survey. Pairwise correlations between derived behavioral features (eg, weekly minutes spent at home) and PHQ-9 were computed. Using these behavioral features, we also constructed an elastic net penalized multivariate logistic regression model predicting depressed versus nondepressed PHQ-9 scores (ie, dichotomized PHQ-9).ResultsA total of 415 individuals logged into the app. Over the course of the 12-week study, these participants completed 83.35% (4151/4980) of the PHQ-9s. Applying data sufficiency rules for minimally necessary daily and weekly data resulted in 3779 participant-weeks of data across 384 participants. Using a subset of 34 behavioral features, we found that 11 features showed a significant (P<.001 Benjamini-Hochberg adjusted) Spearman correlation with weekly PHQ-9, including voice diary-derived word sentiment and ambient audio levels. Restricting the data to those cases in which all 34 behavioral features were present, we had available 1013 participant-weeks from 186 participants. The logistic regression model predicting depression status resulted in a 10-fold cross-validated mean area under the curve of 0.656 (SD 0.079).ConclusionsThis study finds a strong proof of concept for the use of a smartphone-based assessment of depression outcomes. Behavioral features derived from passive sensors and active tasks show promising correlations with a validated clinical measure of depression (PHQ-9). Future work is needed to increase scale that may permit the construction of more complex (eg, nonlinear) predictive models and better handle data missingness.
| S-EPMC8386379 | biostudies-literature