Dataset Information

User-centered design and usability testing of RxMAGIC: a prescription management and general inventory control system for free clinic dispensaries.

ABSTRACT:

Background

To address challenges related to medication management in underserved settings, we developed a system for Prescription Management And General Inventory Control, or RxMAGIC, in collaboration with the Birmingham Free Clinic in Pittsburgh, Pennsylvania. RxMAGIC is an interoperable, web-based medication management system designed to standardize and streamline the dispensing practice and improve inventory control in a free clinic setting. This manuscript describes the processes used to design, develop, and deploy RxMAGIC.

Methods

We transformed data from previously performed mixed-methods needs assessment studies into functional user requirements using agile development methods. Requirements took the form of user stories that were prioritized to drive implementation of RxMAGIC as a web-application. A functional prototype was developed and tested to understand its perceived usefulness before developing a production system. Prior to deployment, we evaluated the usability of RxMAGIC with six users to diagnose potential interaction challenges that may be avoided through redesign. The results from this study were similarly prioritized and informed the final features of the production system.

Results

We developed 45 user stories that acted as functional requirements to incrementally build RxMAGIC. Integrating with the electronic health record at the clinic was a requirement for deployment. We utilized health data standards to communicate with the existing order entry system; an outgoing electronic prescribing framework was leveraged to send prescription data to RxMAGIC. The results of the usability study were positive, with all tested features receiving a mean score of four or five (i.e. somewhat easy or easy, respectively) on a five-point Likert scale assessing ease of completion, thus demonstrating the system's simplicity and high learnability. RxMAGIC was deployed at the clinic in October 2016 over a two-week period.

Conclusions

We built RxMAGIC, an open-source, pharmacist-facing dispensary management information system that augments the pharmacist's ability to efficiently deliver medication services in a free clinic setting. RxMAGIC provides electronic dispensing and automated inventory management and alerting capabilities. We deployed RxMAGIC at the Birmingham Free Clinic and measured its usability with potential users. In future work, we plan to continue to measure the impact of RxMAGIC on pharmacist efficiency and satisfaction.

SUBMITTER: Fisher AM

PROVIDER: S-EPMC6131751 | biostudies-literature | 2018 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

User-centered design and usability testing of RxMAGIC: a prescription management and general inventory control system for free clinic dispensaries.

Fisher Arielle M AM Mtonga Timothy M TM Espino Jeremy U JU Jonkman Lauren J LJ Connor Sharon E SE Cappella Nickie K NK Douglas Gerald P GP

BMC health services research 20180910 1

<h4>Background</h4>To address challenges related to medication management in underserved settings, we developed a system for Prescription Management And General Inventory Control, or RxMAGIC, in collaboration with the Birmingham Free Clinic in Pittsburgh, Pennsylvania. RxMAGIC is an interoperable, web-based medication management system designed to standardize and streamline the dispensing practice and improve inventory control in a free clinic setting. This manuscript describes the processes use ...[more]

PMID: 30200939

Similar Datasets

Project description:BackgroundThe treatment for cancer can have a negative impact not only on physical well-being but also on mental health and the quality of life (QoL). Health apps enable the monitoring of different parameters, but to date, there are only few that support patients with cancer and none that focuses on the assessment of QoL. Furthermore, patients as stakeholders are often only integrated at the late stage of the development process, if at all.ObjectiveThe aim of this research was to develop and evaluate a smartphone app (Lion-App) to enable patients with cancer to autonomously measure the QoL with an iterative, user-centered approach.MethodsPatients with cancer were involved in a 3-stage process from conceptualization to the point when the app was available on the tester's private device. First, focus groups with members (N=21) of cancer support groups were conducted to understand their expectations and needs. Thereafter, individual tests were performed. After developing a prototype that incorporated findings from the focus groups, a second test cycle was conducted, followed by a beta test lasting 2 months. In our app, the QoL can be assessed via a patient diary and an integrated questionnaire. Through all stages, usability was evaluated using the modular extended version of the User Experience Questionnaire (UEQ+), including the calculation of a key performance indicator (KPI). If possible, the impact of sex on the results was evaluated. As part of the beta test, usage rates as well as age-dependent differences were also assessed.ResultsA total of 21 participants took part in the initial 3 focus groups. In the subsequent usability testing (N=18), 17 (94%) participants rated their impression through the UEQ+, with a mean KPI of 2.12 (SD 0.64, range: -3 to 3). In the second usability test (N=14), the mean KPI increased to 2.28 (SD=0.49). In the beta test, the usage rate of 19 participants was evaluated, of whom 14 (74%) also answered the UEQ+ (mean KPI 1.78, SD 0.84). An influence of age on the number of questionnaire responses in Lion-App was observed, with a decrease in responses with increasing age (P=.02). Sex-dependent analyses were only possible for the first usability test and the beta test. The main adjustments based on user feedback were a restructuring of the diary as well as integration of a shorter questionnaire to assess the QoL.ConclusionsThe iterative, user-centered approach for development and usability testing resulted in positive evaluations of Lion-App. Our app was rated as suitable for everyday use to monitor the QoL of patients with cancer. Initial results indicated that the sex and age of participants seem to play only a minor role.

Project description:BackgroundInnovative approaches are needed to address the self-management needs of youths with osteogenesis imperfecta (OI) transitioning into adult-oriented health care systems. Using a sequentially phased research approach, the goal is to design, develop, and test the usability of an innovative eHealth program called "Teens Taking Charge: Managing OI Online," hereafter named "Teens OI." This program seeks to optimize self-management, facilitate a successful transition to adult care, and address a critical gap in the quality of care for youths with OI.ObjectiveThe study objectives are to (1) design and develop an English and French version of the Teens OI and (2) test the usability of the Teens OI in terms of efficiency, effectiveness, and satisfaction from the perspectives of youths with OI and their parents.MethodsA user-centered design is presently in progress to design and develop Teens OI. A "Website Design and Development Council" (ie, Council) has been convened, with 20 youths and parent dyads recruited and global experts surveyed at an international meeting. With unanimous support from the Council, usability testing of the Teens OI will ensue in 4 iterative cycles with 32 youth-parent dyads. All sociodemographic and usability metrics will be descriptively analyzed. All recorded interview and focus group data are analyzed using content analysis techniques involving an iterative process of data reduction, data display, conclusion drawing, and verification.ResultsAs of December 2022, an 8-person, interdisciplinary Teens OI council, comprising 4 health care professionals, 3 youths and young adults with OI, and 1 parent, has been convened to oversee the design and development of Teens OI. Two cycles of interviews have been conducted with 10 youths with OI with or without their parents (n=6) from December 2021 to September 2022. Data analysis has been in progress since April 2022. Aim 2 is ethically approved and will commence following the completion of content development, expected by late July 2023. Preliminary analysis indicates that the following topics need to be prioritized for the youths: mental health, pain, accessibility, medical care, education, community, and parental care.ConclusionsThe proposed study will design and develop a self-management and transitional care program for youths with OI in partnership with patients, caregivers, and health care professionals. This study leverages youths' openness to adopt eHealth technologies to meet their needs and has the potential to actively engage them to autonomously manage their lifelong conditions, and facilitate a successful transition to adult health care. Finally, the proposed study will also address a critical gap in the quality of care and the growing concern that the OI population transitioning from pediatric to adult care is at risk of various adverse events associated with the transition.International registered report identifier (irrid)DERR1-10.2196/47524.

Project description:BackgroundMobile health (mHealth) apps for children are increasing in availability and scope. Therapy (physiotherapy, speech pathology, and occupational therapy) prescription apps to improve home or school program adherence work best when developed to be highly engaging for children and when they incorporate behavior change techniques (BCTs) within their design.ObjectiveThe aim of this study was to describe the development of a user-centered therapy prescription app for children (aged 6-12 years) with neurodevelopmental disabilities (eg, cerebral palsy, autism spectrum disorder, and intellectual disability) incorporating intervention mapping (IM) and gamified design.MethodsWe used an iterative, user-centered app development model incorporating the first 3 steps of IM. We conducted a needs analysis with user feedback from our previous mHealth app study, a literature review, and a market audit. Change objectives were then specified in alignment with the psychological needs of autonomy, competence, and relatedness identified in self-determination theory. From these objectives, we then selected BCTs, stipulating parameters for effectiveness and how each BCT would be operationalized. A gamification design was planned and implemented focusing on maximizing engagement in children. In total, 2 rounds of consultations with parents, teachers, and therapists and 1 round of prototype app testing with children were conducted to inform app development, with a final iteration developed for further testing.ResultsThe IM process resulted in the specification of app elements, self-determination theory-informed BCTs, that were embedded into the app design. The gamification design yielded the selection of a digital pet avatar with a fantasy anime visual theme and multiple layers of incentives earned by completing prescribed therapy activities. Consultation groups with professionals working with children with disabilities (4 therapists and 3 teachers) and parents of children with disabilities (n=3) provided insights into the motivation of children and the pragmatics of implementing app-delivered therapy programs that informed the app development. User testing with children with disabilities (n=4) highlighted their enthusiasm for the app and the need for support in the initial phase of learning the app. App quality testing (Mobile Application Rating Scale-user version) with the children yielded means (out of 5) of 4.5 (SD 0.8) for engagement, 3.3 (SD 1.6) for function, 3.3 (SD 1.7) for aesthetics, and 4.3 (SD 1.1) for subjective quality.ConclusionsmHealth apps designed for children can be greatly enhanced with a systematic yet flexible development process considering the specific contextual needs of the children with user-centered design, addressing the need for behavior change using the IM process, and maximizing engagement with gamification and strong visual design.

Project description:BackgroundOlder adults (OAs) residing in long-term care (LTC) homes are often unable to engage in adequate amounts of physical activity because of multiple comorbidities, including frailty and severe cognitive impairments. This level of physical inactivity is associated with declines in cognitive and functional abilities and can be further compounded by social isolation. Exergaming, defined as a combination of exercise and gaming, has the potential to engage OAs in exercise and encourage social interaction. However, previously used systems such as the Nintendo Wii are no longer commercially available, and the physical design of other exergames is not suitable for OAs (ie, fall risks, accessibility issues, and games geared toward a younger population) with diverse physical and cognitive impairments.ObjectiveThis study aims to design and develop a novel, user-centered, evidence-based exergaming system for use among OAs in LTC homes. In addition, we aim to identify facilitators and barriers to the implementation of our exergaming intervention, the MouvMat, into LTC homes according to staff input.MethodsThis study used a user-centered design (UCD) process that consisted of 4 rounds of usability testing. The exergame was developed and finalized based on existing evidence, end user and stakeholder input, and user testing. Semistructured interviews and standardized and validated scales were used iteratively to evaluate the acceptability, usability, and physical activity enjoyment of the MouvMat.ResultsA total of 28 participants, 13 LTC residents, and 15 staff and family members participated in the UCD process for over 18 months to design and develop the novel exergaming intervention, the MouvMat. The iterative use of validated scales (System Usability Scale, 8-item Physical Activity Enjoyment Scale, and modified Treatment Evaluation Inventory) indicated an upward trend in the acceptability, usability, and enjoyment scores of MouvMat over 4 rounds of usability testing, suggesting that identified areas for refinement and improvement were appropriately addressed by the team. A qualitative analysis of semistructured interview data found that residents enjoyed engaging with the prototype and appreciated the opportunity to increase their PA. In addition, staff and stakeholders were drawn to MouvMat's ability to increase residents' autonomous PA. The intended and perceived benefits of MouvMat use, that is, improved physical and cognitive health, were the most common facilitators of its use identified by study participants.ConclusionsThis study was successful in applying UCD to collaborate with LTC residents, despite the high number of physical and sensory impairments that this population experiences. By following a UCD process, an exergaming intervention that meets diverse requirements (ie, hardware design features and motivation) and considers environmental barriers and residents' physical and cognitive needs was developed. The effectiveness of MouvMat in improving physical and cognitive abilities should be explored in future multisite randomized controlled trials.

Project description:BackgroundThe goal of user-centered design (UCD) is to understand the users' perspective and to use that knowledge to shape more effective solutions. The UCD approach provides insight into users' needs and requirements and thereby improves the design of the developed services. However, involving users in the development process does not guarantee that feedback from different subgroups of users will shape the development in ways that will make the solutions more useful for the entire target user population.ObjectiveThe aim of this study was to describe a protocol for systematic analysis and prioritization of feedback from user subgroups in the usability testing of a digital motivation support for fall-preventive physical activity (PA) interventions in seniors (aged 65 years and older). This protocol can help researchers and developers to systematically exploit feedback from relevant user subgroups in UCD.MethodsGender, PA level, and level of technology experience have been identified in the literature to influence users' experience and use of digital support systems for fall-preventive PA interventions in seniors. These 3 key user characteristics were dichotomized and used to define 8 (ie, 23) possible user subgroups. The presented method enables systematic tracking of the user subgroups' contributions in iterative development. The method comprises (1) compilation of difficulties and deficiencies in the digital applications identified in usability testing, (2) clustering of the identified difficulties and deficiencies, and (3) prioritization of deficiencies to be rectified. Tracking user subgroup representation in the user feedback ensures that the development process is prioritized according to the needs of different subgroups. Mainly qualitative data collection methods are used.ResultsA protocol was developed to ensure that feedback from users representing all possible variants of 3 selected key user characteristics (gender, PA level, and level of technology experience) is considered in the iterative usability testing of a digital support for seniors' PA. The method was applied in iterative usability testing of two digital applications during spring/summer 2018. Results from the study on the users' experiences and the iterative modification of the digital applications are expected to be published during 2021.ConclusionsMethods for systematic collection, analysis, and prioritization of feedback from user subgroups might be particularly important in heterogenous user groups (eg, seniors). This study can contribute to identifying and improving the understanding of potential differences between user subgroups of seniors in their use and experiences of digital support for fall-preventive PA interventions. This knowledge may be relevant for developing digital support systems that are appropriate, useful, and attractive to users and for enabling the design of digital support systems that target specific user subgroups (ie, tailoring of the support). The protocol needs to be further used and investigated in order to validate its potential value.International registered report identifier (irrid)RR1-10.2196/20061.

Project description:BackgroundSmoking prevalence during and after pregnancy remains high among socioeconomically disadvantaged women. Mobile health (mHealth) apps with game and social support elements seem promising to support smoking cessation.ObjectiveThis study aims to describe the user-centered design and usability evaluation of Kindle, an mHealth app with game and social support elements, to support disadvantaged young women during and after pregnancy through the first stages of smoking cessation.MethodsDisadvantaged women (n=9), members of their social networks (n=4), and nurses supporting these women (n=51) were informants throughout the iterative prototype development of Kindle according to the International Organization for Standardization 9241-11:2018. Specific phases included understanding the context of use through secondary analysis of qualitative interview data (phase 1), establishing the user and organizational requirements (phase 2), production of design solutions (phase 3), and usability inspection of the prototype through a heuristic evaluation (3 experts) along with user testing by a think aloud method (5 disadvantaged women and 5 nurses; phase 4). Usability problems were categorized according to the principles of the Healthcare Information and Management Systems Society.ResultsPhase 1 resulted in an understanding of the VoorZorg program and the needs of VoorZorg nurses and clients (eg, focus on early stages of change and building new supportive networks to aid clients in smoking cessation). In phase 2, we established requirements (n=22; eg, mHealth app, secure communication between nurses and clients, easy-to-use interfaces, inclusion of game elements, and tailoring at early stages of change in smoking cessation). Phase 3 resulted in a prototype of Kindle, combining the interface for nurses and clients, including the following functionalities: personal goal setting with earning points; secured chat function between nurses and other clients; and tips, diary, and profile creation. The heuristic evaluation and thinking aloud method in phase 4 revealed 78 usability problems in the interfaces. Most usability problems concerned simplicity (eg, unclear clickable button) and naturalness (eg, unclear icon).ConclusionsThe user-centered design and usability testing of the mHealth app Kindle yielded useful insights. The involvement of end users, specifically socioeconomically disadvantaged women during and after their pregnancy, resulted in a prototype that met their needs and requirements (eg, mHealth app, secure communication between nurses and clients, easy-to-use interfaces, inclusion of game elements, and tailoring to the early stages of change in smoking cessation) to achieve readiness for smoking cessation. Moreover, the usability evaluation by end users and experts revealed unique usability problems for this population. These insights allow for further optimization of Kindle and encourage future studies to engage disadvantaged populations in all phases of mHealth intervention design and usability testing.

Dataset Information

User-centered design and usability testing of RxMAGIC: a prescription management and general inventory control system for free clinic dispensaries.

Background

Methods

Results

Conclusions

Publications

User-centered design and usability testing of RxMAGIC: a prescription management and general inventory control system for free clinic dispensaries.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets