Dataset Information

User-centered design and usability testing of RxMAGIC: a prescription management and general inventory control system for free clinic dispensaries.

ABSTRACT:

Background

To address challenges related to medication management in underserved settings, we developed a system for Prescription Management And General Inventory Control, or RxMAGIC, in collaboration with the Birmingham Free Clinic in Pittsburgh, Pennsylvania. RxMAGIC is an interoperable, web-based medication management system designed to standardize and streamline the dispensing practice and improve inventory control in a free clinic setting. This manuscript describes the processes used to design, develop, and deploy RxMAGIC.

Methods

We transformed data from previously performed mixed-methods needs assessment studies into functional user requirements using agile development methods. Requirements took the form of user stories that were prioritized to drive implementation of RxMAGIC as a web-application. A functional prototype was developed and tested to understand its perceived usefulness before developing a production system. Prior to deployment, we evaluated the usability of RxMAGIC with six users to diagnose potential interaction challenges that may be avoided through redesign. The results from this study were similarly prioritized and informed the final features of the production system.

Results

We developed 45 user stories that acted as functional requirements to incrementally build RxMAGIC. Integrating with the electronic health record at the clinic was a requirement for deployment. We utilized health data standards to communicate with the existing order entry system; an outgoing electronic prescribing framework was leveraged to send prescription data to RxMAGIC. The results of the usability study were positive, with all tested features receiving a mean score of four or five (i.e. somewhat easy or easy, respectively) on a five-point Likert scale assessing ease of completion, thus demonstrating the system's simplicity and high learnability. RxMAGIC was deployed at the clinic in October 2016 over a two-week period.

Conclusions

We built RxMAGIC, an open-source, pharmacist-facing dispensary management information system that augments the pharmacist's ability to efficiently deliver medication services in a free clinic setting. RxMAGIC provides electronic dispensing and automated inventory management and alerting capabilities. We deployed RxMAGIC at the Birmingham Free Clinic and measured its usability with potential users. In future work, we plan to continue to measure the impact of RxMAGIC on pharmacist efficiency and satisfaction.

SUBMITTER: Fisher AM

PROVIDER: S-EPMC6131751 | biostudies-literature | 2018 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

User-centered design and usability testing of RxMAGIC: a prescription management and general inventory control system for free clinic dispensaries.

Fisher Arielle M AM Mtonga Timothy M TM Espino Jeremy U JU Jonkman Lauren J LJ Connor Sharon E SE Cappella Nickie K NK Douglas Gerald P GP

BMC health services research 20180910 1

<h4>Background</h4>To address challenges related to medication management in underserved settings, we developed a system for Prescription Management And General Inventory Control, or RxMAGIC, in collaboration with the Birmingham Free Clinic in Pittsburgh, Pennsylvania. RxMAGIC is an interoperable, web-based medication management system designed to standardize and streamline the dispensing practice and improve inventory control in a free clinic setting. This manuscript describes the processes use ...[more]

PMID: 30200939

Similar Datasets

Project description:BackgroundThe treatment for cancer can have a negative impact not only on physical well-being but also on mental health and the quality of life (QoL). Health apps enable the monitoring of different parameters, but to date, there are only few that support patients with cancer and none that focuses on the assessment of QoL. Furthermore, patients as stakeholders are often only integrated at the late stage of the development process, if at all.ObjectiveThe aim of this research was to develop and evaluate a smartphone app (Lion-App) to enable patients with cancer to autonomously measure the QoL with an iterative, user-centered approach.MethodsPatients with cancer were involved in a 3-stage process from conceptualization to the point when the app was available on the tester's private device. First, focus groups with members (N=21) of cancer support groups were conducted to understand their expectations and needs. Thereafter, individual tests were performed. After developing a prototype that incorporated findings from the focus groups, a second test cycle was conducted, followed by a beta test lasting 2 months. In our app, the QoL can be assessed via a patient diary and an integrated questionnaire. Through all stages, usability was evaluated using the modular extended version of the User Experience Questionnaire (UEQ+), including the calculation of a key performance indicator (KPI). If possible, the impact of sex on the results was evaluated. As part of the beta test, usage rates as well as age-dependent differences were also assessed.ResultsA total of 21 participants took part in the initial 3 focus groups. In the subsequent usability testing (N=18), 17 (94%) participants rated their impression through the UEQ+, with a mean KPI of 2.12 (SD 0.64, range: -3 to 3). In the second usability test (N=14), the mean KPI increased to 2.28 (SD=0.49). In the beta test, the usage rate of 19 participants was evaluated, of whom 14 (74%) also answered the UEQ+ (mean KPI 1.78, SD 0.84). An influence of age on the number of questionnaire responses in Lion-App was observed, with a decrease in responses with increasing age (P=.02). Sex-dependent analyses were only possible for the first usability test and the beta test. The main adjustments based on user feedback were a restructuring of the diary as well as integration of a shorter questionnaire to assess the QoL.ConclusionsThe iterative, user-centered approach for development and usability testing resulted in positive evaluations of Lion-App. Our app was rated as suitable for everyday use to monitor the QoL of patients with cancer. Initial results indicated that the sex and age of participants seem to play only a minor role.

Project description:BackgroundOlder adults (OAs) residing in long-term care (LTC) homes are often unable to engage in adequate amounts of physical activity because of multiple comorbidities, including frailty and severe cognitive impairments. This level of physical inactivity is associated with declines in cognitive and functional abilities and can be further compounded by social isolation. Exergaming, defined as a combination of exercise and gaming, has the potential to engage OAs in exercise and encourage social interaction. However, previously used systems such as the Nintendo Wii are no longer commercially available, and the physical design of other exergames is not suitable for OAs (ie, fall risks, accessibility issues, and games geared toward a younger population) with diverse physical and cognitive impairments.ObjectiveThis study aims to design and develop a novel, user-centered, evidence-based exergaming system for use among OAs in LTC homes. In addition, we aim to identify facilitators and barriers to the implementation of our exergaming intervention, the MouvMat, into LTC homes according to staff input.MethodsThis study used a user-centered design (UCD) process that consisted of 4 rounds of usability testing. The exergame was developed and finalized based on existing evidence, end user and stakeholder input, and user testing. Semistructured interviews and standardized and validated scales were used iteratively to evaluate the acceptability, usability, and physical activity enjoyment of the MouvMat.ResultsA total of 28 participants, 13 LTC residents, and 15 staff and family members participated in the UCD process for over 18 months to design and develop the novel exergaming intervention, the MouvMat. The iterative use of validated scales (System Usability Scale, 8-item Physical Activity Enjoyment Scale, and modified Treatment Evaluation Inventory) indicated an upward trend in the acceptability, usability, and enjoyment scores of MouvMat over 4 rounds of usability testing, suggesting that identified areas for refinement and improvement were appropriately addressed by the team. A qualitative analysis of semistructured interview data found that residents enjoyed engaging with the prototype and appreciated the opportunity to increase their PA. In addition, staff and stakeholders were drawn to MouvMat's ability to increase residents' autonomous PA. The intended and perceived benefits of MouvMat use, that is, improved physical and cognitive health, were the most common facilitators of its use identified by study participants.ConclusionsThis study was successful in applying UCD to collaborate with LTC residents, despite the high number of physical and sensory impairments that this population experiences. By following a UCD process, an exergaming intervention that meets diverse requirements (ie, hardware design features and motivation) and considers environmental barriers and residents' physical and cognitive needs was developed. The effectiveness of MouvMat in improving physical and cognitive abilities should be explored in future multisite randomized controlled trials.

Project description:BackgroundThe goal of user-centered design (UCD) is to understand the users' perspective and to use that knowledge to shape more effective solutions. The UCD approach provides insight into users' needs and requirements and thereby improves the design of the developed services. However, involving users in the development process does not guarantee that feedback from different subgroups of users will shape the development in ways that will make the solutions more useful for the entire target user population.ObjectiveThe aim of this study was to describe a protocol for systematic analysis and prioritization of feedback from user subgroups in the usability testing of a digital motivation support for fall-preventive physical activity (PA) interventions in seniors (aged 65 years and older). This protocol can help researchers and developers to systematically exploit feedback from relevant user subgroups in UCD.MethodsGender, PA level, and level of technology experience have been identified in the literature to influence users' experience and use of digital support systems for fall-preventive PA interventions in seniors. These 3 key user characteristics were dichotomized and used to define 8 (ie, 23) possible user subgroups. The presented method enables systematic tracking of the user subgroups' contributions in iterative development. The method comprises (1) compilation of difficulties and deficiencies in the digital applications identified in usability testing, (2) clustering of the identified difficulties and deficiencies, and (3) prioritization of deficiencies to be rectified. Tracking user subgroup representation in the user feedback ensures that the development process is prioritized according to the needs of different subgroups. Mainly qualitative data collection methods are used.ResultsA protocol was developed to ensure that feedback from users representing all possible variants of 3 selected key user characteristics (gender, PA level, and level of technology experience) is considered in the iterative usability testing of a digital support for seniors' PA. The method was applied in iterative usability testing of two digital applications during spring/summer 2018. Results from the study on the users' experiences and the iterative modification of the digital applications are expected to be published during 2021.ConclusionsMethods for systematic collection, analysis, and prioritization of feedback from user subgroups might be particularly important in heterogenous user groups (eg, seniors). This study can contribute to identifying and improving the understanding of potential differences between user subgroups of seniors in their use and experiences of digital support for fall-preventive PA interventions. This knowledge may be relevant for developing digital support systems that are appropriate, useful, and attractive to users and for enabling the design of digital support systems that target specific user subgroups (ie, tailoring of the support). The protocol needs to be further used and investigated in order to validate its potential value.International registered report identifier (irrid)RR1-10.2196/20061.

Project description:BackgroundSmoking prevalence during and after pregnancy remains high among socioeconomically disadvantaged women. Mobile health (mHealth) apps with game and social support elements seem promising to support smoking cessation.ObjectiveThis study aims to describe the user-centered design and usability evaluation of Kindle, an mHealth app with game and social support elements, to support disadvantaged young women during and after pregnancy through the first stages of smoking cessation.MethodsDisadvantaged women (n=9), members of their social networks (n=4), and nurses supporting these women (n=51) were informants throughout the iterative prototype development of Kindle according to the International Organization for Standardization 9241-11:2018. Specific phases included understanding the context of use through secondary analysis of qualitative interview data (phase 1), establishing the user and organizational requirements (phase 2), production of design solutions (phase 3), and usability inspection of the prototype through a heuristic evaluation (3 experts) along with user testing by a think aloud method (5 disadvantaged women and 5 nurses; phase 4). Usability problems were categorized according to the principles of the Healthcare Information and Management Systems Society.ResultsPhase 1 resulted in an understanding of the VoorZorg program and the needs of VoorZorg nurses and clients (eg, focus on early stages of change and building new supportive networks to aid clients in smoking cessation). In phase 2, we established requirements (n=22; eg, mHealth app, secure communication between nurses and clients, easy-to-use interfaces, inclusion of game elements, and tailoring at early stages of change in smoking cessation). Phase 3 resulted in a prototype of Kindle, combining the interface for nurses and clients, including the following functionalities: personal goal setting with earning points; secured chat function between nurses and other clients; and tips, diary, and profile creation. The heuristic evaluation and thinking aloud method in phase 4 revealed 78 usability problems in the interfaces. Most usability problems concerned simplicity (eg, unclear clickable button) and naturalness (eg, unclear icon).ConclusionsThe user-centered design and usability testing of the mHealth app Kindle yielded useful insights. The involvement of end users, specifically socioeconomically disadvantaged women during and after their pregnancy, resulted in a prototype that met their needs and requirements (eg, mHealth app, secure communication between nurses and clients, easy-to-use interfaces, inclusion of game elements, and tailoring to the early stages of change in smoking cessation) to achieve readiness for smoking cessation. Moreover, the usability evaluation by end users and experts revealed unique usability problems for this population. These insights allow for further optimization of Kindle and encourage future studies to engage disadvantaged populations in all phases of mHealth intervention design and usability testing.

Project description:BackgroundFalls account for approximately 50% of infant injury hospitalizations, and caretaker behavior is central to preventing infant falls. Behavior theory-informed interventions for injury prevention have been suggested, but to date, few have been reported. The potential of using smartphones for injury prevention intervention delivery is also underexploited.ObjectiveThis study aims to develop a behavior theory- and evidence-based as well as user-centered digital intervention as a mobile app for parents to prevent infant falls following agile development practices.MethodsInfant falls while feeding was selected as the fall mechanism to demonstrate the approach being taken to develop this intervention. In phase 1, the Behaviour Change Wheel was used as a theoretical framework supported by a literature review to define intervention components that were then implemented as a mobile app. In phase 2, after the person-based approach, user testing through think-aloud interviews and comprehension assessments were used to refine the content and implementation of the intervention.ResultsThe target behaviors identified in phase 1 were adequate rest for the newborn's mother and safe feeding practices defined as prepare, position, and place. From behavioral determinants and the Behaviour Change Wheel, the behavior change functions selected to achieve these target behaviors were psychological capability, social opportunity, and reflective motivation. The selected behavior change techniques aligned with these functions were providing information on health consequences, using a credible source, instruction on performing each behavior, and social support. The defined intervention was implemented in a draft Android app. In phase 2, 4 rounds of user testing were required to achieve the predefined target comprehension level. The results from the think-aloud interviews were used to refine the intervention content and app features. Overall, the results from phase 2 revealed that users found the information provided to be helpful. Features such as self-tracking and inclusion of the social and environmental aspects of falls prevention were liked by the participants. Important feedback for the successful implementation of the digital intervention was also obtained from the user testing.ConclusionsTo our knowledge, this is the first study to apply the Behaviour Change Wheel to develop a digital intervention for child injury prevention. This study provides a detailed example of evidence-based development of a behavior theory-informed mobile intervention for injury prevention refined using the person-based approach.

Project description:BACKGROUND:Active video game (AVG) playing, also known as "exergaming," is increasingly employed to promote physical activity across all age groups. The Wii Fit Balance Board is a popular gaming controller for AVGs and is used in a variety of settings. However, the commercial off-the-shelf (OTS) design poses several limitations. It is inaccessible to wheelchair users, does not support the use of stabilization assistive devices, and requires the ability to shift the center of balance (COB) in all directions to fully engage in game play. OBJECTIVE:The aim of this study was to design an adapted version of the Wii Fit Balance Board to overcome the identified limitations and to evaluate the usability of the newly designed adapted Wii Fit Balance Board in persons with mobility impairments. METHODS:In a previous study, 16 participants tried the OTS version of the Wii Fit Balance Board. On the basis of observed limitations, a team of engineers developed and adapted the design of the Wii Fit Balance Board, which was then subjected to multiple iterations of user feedback and design tweaks. On design completion, we recruited a new pool of participants with mobility impairments for a larger study. During their first visit, we assessed lower-extremity function using selected mobility tasks from the International Classification of Functioning, Disability and Health. During a subsequent session, participants played 2 sets of games on both the OTS and adapted versions of the Wii Fit Balance Board. Order of controller version played first was randomized. After participants played each version, we administered the System Usability Scale (SUS) to examine the participants' perceived usability. RESULTS:The adapted version of the Wii Fit Balance Board resulting from the user-centered design approach met the needs of a variety of users. The adapted controller (1) allowed manual wheelchair users to engage in game play, which was previously not possible; (2) included Americans with Disabilities Act-compliant handrails as part of the controller, enabling stable and safe game play; and (3) included a sensitivity control feature, allowing users to fine-tune the controller to match the users' range of COB motion. More than half the sample could not use the OTS version of the Wii Fit Balance Board, while all participants were able to use the adapted version. All participants rated the adapted Wii Fit Balance Board at a minimum as "good," while those who could not use the OTS Wii Fit Balance Board rated the adapted Wii Fit Balance Board as "excellent." We found a significant negative correlation between lower-extremity function and differences between OTS and adapted SUS scores, indicating that as lower-extremity function decreased, participants perceived the adapted Wii Fit Balance Board as more usable. CONCLUSIONS:This study demonstrated a successful adaptation of a widely used AVG controller. The adapted controller's potential to increase physical activity levels among people with mobility impairments will be evaluated in a subsequent trial. TRIAL REGISTRATION:ClinicalTrials.gov NCT02994199; https://clinicaltrials.gov/ct2/show/NCT02994199 (Archived by WebCite at http://www.webcitation.org/6xWTyiJWf).

Dataset Information

User-centered design and usability testing of RxMAGIC: a prescription management and general inventory control system for free clinic dispensaries.

Background

Methods

Results

Conclusions

Publications

User-centered design and usability testing of RxMAGIC: a prescription management and general inventory control system for free clinic dispensaries.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets