Dataset Information

Development and Usability of a Novel Interactive Tablet App (PediAppRREST) to Support the Management of Pediatric Cardiac Arrest: Pilot High-Fidelity Simulation-Based Study.

ABSTRACT: BACKGROUND:Pediatric cardiac arrest (PCA), although rare, is associated with high mortality. Deviations from international management guidelines are frequent and associated with poorer outcomes. Different strategies/devices have been developed to improve the management of cardiac arrest, including cognitive aids. However, there is very limited experience on the usefulness of interactive cognitive aids in the format of an app in PCA. No app has so far been tested for its usability and effectiveness in guiding the management of PCA. OBJECTIVE:To develop a new audiovisual interactive app for tablets, named PediAppRREST, to support the management of PCA and to test its usability in a high-fidelity simulation-based setting. METHODS:A research team at the University of Padova (Italy) and human-machine interface designers, as well as app developers, from an Italian company (RE:Lab S.r.l.) developed the app between March and October 2019, by applying an iterative design approach (ie, design-prototyping-evaluation iterative loops). In October-November 2019, a single-center nonrandomized controlled simulation-based pilot study was conducted including 48 pediatric residents divided into teams of 3. The same nonshockable PCA scenario was managed by 11 teams with and 5 without the app. The app user's experience and interaction patterns were documented through video recording of scenarios, debriefing sessions, and questionnaires. App usability was evaluated with the User Experience Questionnaire (UEQ) (scores range from -3 to +3 for each scale) and open-ended questions, whereas participants' workload was measured using the NASA Raw-Task Load Index (NASA RTLX). RESULTS:Users' difficulties in interacting with the app during the simulations were identified using a structured framework. The app usability, in terms of mean UEQ scores, was as follows: attractiveness 1.71 (SD 1.43), perspicuity 1.75 (SD 0.88), efficiency 1.93 (SD 0.93), dependability 1.57 (SD 1.10), stimulation 1.60 (SD 1.33), and novelty 2.21 (SD 0.74). Team leaders' perceived workload was comparable (P=.57) between the 2 groups; median NASA RTLX score was 67.5 (interquartile range [IQR] 65.0-81.7) for the control group and 66.7 (IQR 54.2-76.7) for the intervention group. A preliminary evaluation of the effectiveness of the app in reducing deviations from guidelines showed that median time to epinephrine administration was significantly longer in the group that used the app compared with the control group (254 seconds versus 165 seconds; P=.015). CONCLUSIONS:The PediAppRREST app received a good usability evaluation and did not appear to increase team leaders' workload. Based on the feedback collected from the participants and the preliminary results of the evaluation of its effects on the management of the simulated scenario, the app has been further refined. The effectiveness of the new version of the app in reducing deviations from guidelines recommendations in the management of PCA and its impact on time to critical actions will be evaluated in an upcoming multicenter simulation-based randomized controlled trial.

SUBMITTER: Corazza F

PROVIDER: S-EPMC7563631 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and Usability of a Novel Interactive Tablet App (PediAppRREST) to Support the Management of Pediatric Cardiac Arrest: Pilot High-Fidelity Simulation-Based Study.

Corazza Francesco F Snijders Deborah D Arpone Marta M Stritoni Valentina V Martinolli Francesco F Daverio Marco M Losi Maria Giulia MG Soldi Luca L Tesauri Francesco F Da Dalt Liviana L Bressan Silvia S

JMIR mHealth and uHealth 20201001 10

<h4>Background</h4>Pediatric cardiac arrest (PCA), although rare, is associated with high mortality. Deviations from international management guidelines are frequent and associated with poorer outcomes. Different strategies/devices have been developed to improve the management of cardiac arrest, including cognitive aids. However, there is very limited experience on the usefulness of interactive cognitive aids in the format of an app in PCA. No app has so far been tested for its usability and eff ...[more]

PMID: 32788142

Similar Datasets

Project description:IntroductionPaediatric cardiac arrest (PCA), despite its low incidence, has a high mortality. Its management is complex and deviations from guideline recommendations occur frequently. We developed a new interactive tablet app, named PediAppRREST, to support the management of PCA. The app received a good usability evaluation in a previous pilot trial. The aim of the study is to evaluate the effectiveness of the PediAppRREST app in reducing deviations from guideline recommendations in PCA management.Methods and analysisThis is a multicentre, simulation-based, randomised controlled, three-parallel-arm study. Participants are residents in Paediatric, Emergency Medicine, and Anaesthesiology programmes in Italy. All 105 teams (315 participants) manage the same scenario of in-hospital PCA. Teams are randomised by the study statistician into one of three study arms for the management of the PCA scenario: (1) an intervention group using the PediAppRREST app or (2) a control group Paediatric Advanced Life Support (CtrlPALS+) using the PALS pocket reference card; or (3) a control group (CtrlPALS-) not allowed to use any PALS-related cognitive aid. The primary outcome of the study is the number of deviations (delays and errors) in PCA management from PALS guideline recommendations, according to a novel checklist, named c-DEV15plus. The c-DEV15plus scores will be compared between groups with a one-way analysis of variance model, followed by the Tukey-Kramer multiple comparisons adjustment procedure in case of statistical significance.Ethics and disseminationThe Ethics Committee of the University Hospital of Padova, coordinating centre of the trial, deemed the project to be a negligible risk study and approved it through an expedited review process. The results of the study will be disseminated in peer-reviewed journals, and at national and international scientific conferences. Based on the study results, the PediAppRREST app will be further refined and will be available for download by institutions/healthcare professionals.Trial registration numberNCT04619498; Pre-results.

Project description:Symptom drawings are widely used as a qualitative and quantitative method of assessing pain symptoms for both clinical and research purposes. As electronic drawings offer many advantages over classical pen-and-paper drawings, the last years have seen a shift toward tablet-based acquisition of symptom drawings. However, software that is used in clinical care requires special attention to usability aspects and design to provide easy access for physically impaired or elderly patients.The aims of this project were to develop a new tablet-based software app specifically designed to collect patients' and doctors' drawings of pain and related bodily symptoms and test it for usability in 2 samples of chronic pain patients (Aim 1) and their treating doctors (Aim 2) as well as for test-retest reliability (Aim 3).In 2 separate studies, symptom drawings from 103 chronic pain patients and their treating doctors were collected using 2 different versions of the app. Both patients and doctors evaluated usability aspects of the app through questionnaires. Results from study 1 were used to improve certain features of the app, which were then evaluated in study 2. Furthermore, a subgroup of 25 patients in study 2 created 2 consecutive symptom drawings for test-retest reproducibility analysis. Usability of both app versions was compared, and reproducibility was calculated for symptom extent, number of symptom clusters, and the whole symptom pattern.The changes we made to the app and the body outline led to significant improvements in patients' usability evaluation regarding the identification with the body outline (P=.007) and the evaluation of symptom depth (P=.02), and the overall difficultness of the drawing process (P=.003) improved significantly. Doctors' usability evaluation of the final app showed good usability with 75.63 (SD 19.51) points on the System Usability Scale, Attrakdiff 2 scores from 0.93 to 1.41, and ISONORM 9241/10 scores from -0.05 to 1.80. Test-retest analysis showed excellent reproducibility for pain extent (intraclass correlation coefficient, ICC=0.92) and good results for the number of symptom clusters (ICC=0.70) and a mean overlap of 0.47 (Jaccard index).We developed a tablet-based symptom drawing app and improved it based on usability assessment in a sample of chronic pain patients and their treating doctors. Increases in usability of the improved app comprised identification with the body outline, symptom depth evaluation, and difficultness of the drawing process. Test-retest reliability of symptom drawings by chronic pain patients showed fair to excellent reproducibility. Patients' usability evaluation is an important factor that should not be neglected when designing apps for mobile or eHealth apps.

Project description:BackgroundThe rapid advancement in media technology has radically changed the way we learn and interact with one another. Games, with their engaging and interactive approach, hold promise in the delivery of knowledge and building of skills. This has potential in child and adolescent mental health work, where the lack of insight and motivation for therapy are major barriers to treatment. However, research on the use of serious games in mental health interventions for children and adolescents is still in its infancy.ObjectiveThis study adds to the research on serious games in mental health interventions through the development and evaluation of RegnaTales, a series of 6 mobile apps designed to help children and adolescents manage anger. We examined the usability and playability of RegnaTales, as well as children's aggression levels before and after the game play.MethodsA total of 72 children aged between 6 and 12 years were recruited for the study. Thirty-five participants had a clinical diagnosis of disruptive behavior disorders (DBD), whereas 37 were typically developing (TD) children. Each child played 1 of the 6 RegnaTales apps for approximately 50 min before completing the Playability and Usability Questionnaire. The Reactive-Proactive Aggression Questionnaire was completed before and after the game play.ResultsThe overall results showed high levels of enjoyment and playability. TD children and children with DBD had similar experienced fun and perceived playability scores on all 6 mobile apps. All 6 mobile apps garnered comparable experienced fun and perceived playability scores. Furthermore, 42% (5/12) to 67% (8/12) of the children indicated that they would like to play the games again. Importantly, children felt that they acquired skills in anger management, were motivated to use them in their daily lives, and felt confident that the skills would help them better manage their anger. Children reported significantly lower reactive aggression after playing the mobile apps Rage Raver (P=.001), Abaddon (P=.008), and RegnaTools (P=.03). These apps focused on the psychoeducation of the link between thoughts and emotions, as well as equipping the participants with various emotion regulation strategies such as relaxation and cognitive restructuring.ConclusionsThis study presents evidence to support RegnaTales as a feasible serious game. The preliminary findings associated with reduction in reactive aggression, coupled with future research to further establish its efficacy, could warrant RegnaTales as a potential intervention for anger issues among clinical and community populations.

Project description:BACKGROUND:Falls have implications for older adults' health and well-being. Strength and balance interventions significantly reduce the risk of falls. However, patients do not always perform the unsupervised home exercise needed for fall reduction. OBJECTIVE:This study aims to develop motivational smartphone apps co-designed with health professionals and older adults to support patients to perform exercise proven to aid fall reduction and to explore the apps' usability and acceptability with both health professionals and patients. METHODS:There were 3 phases of app development that included analysis, design, and implementation. For analysis, we examined the literature to establish key app components and had a consultation with 12 older adults attending a strength and balance class, exercise instructors, and 3 fall services. For design, we created prototype apps and conducted 2 patient and public involvement workshops, one with 5 health professionals and the second with 8 older adults from an exercise group. The apps were revised based on the feedback. For implementation, we tested them with one fall service and their patients for 3 weeks. Participatory evaluation was used through testing, semistructured interviews, and focus groups to explore acceptability and usability. Focus groups were conducted with the service that tested the apps and two other services. Qualitative data were analyzed using the framework approach. RESULTS:On the basis of findings from the literature and consultations in the analysis phase, we selected Behavior Change Techniques, such as goal setting, action planning, and feedback on behavior, to be key parts of the app. We developed goals using familiar icons for patients to select and add while self-reporting exercise and decided to develop 2 apps, one for patients (My Activity Programme) and one for health professionals (Motivate Me). This enabled health professionals to guide patients through the goal-setting process, making it more accessible to nontechnology users. Storyboards were created during the design phase, leading to prototypes of "Motivate Me" and "My Activity Programme." Key changes from the workshops included being able to add more details about the patients' exercise program and a wider selection of goals within "Motivate Me." The overall app design was acceptable to health professionals and older adults. In total, 7 patients and 3 health professionals participated in testing in the implementation phase, with interviews conducted with 6 patients and focus groups, with 3 teams (11 health professionals). Barriers, facilitators, and further functionality were identified for both apps, with 2 cross-cutting themes around phone usability and confidence. CONCLUSIONS:The motivational apps were found to be acceptable for older adults taking part in the design stage and patients and health professionals testing the apps in a clinical setting. User-led design is important to ensure that the apps are usable and acceptable.

Project description:BackgroundHealth care aides are unlicensed support personnel who provide direct care, personal assistance, and support to people with health conditions. The shortage of health care aides has been attributed to recruitment challenges, high turnover, an aging population, the COVID-19 pandemic, and low retention rates. Mobile apps are among the many information communication technologies that are paving the way for eHealth solutions to help address this workforce shortage by enhancing the workflow of health care aides. In collaboration with Clinisys EMR Inc, we developed a mobile app (Mobile Smart Care System [mSCS]) to support the workflow of health care aides who provide services to older adult residents of a long-term care facility.ObjectiveThe purpose of this study was to investigate the technology acceptance and usability of a mobile app in a real-world environment, while it is used by health care aides who provide services to older adults.MethodsThis pilot study used a mixed methods design: sequential mixed methods (QUANTITATIVE, qualitative). Our study included a pre- and post-paper-based questionnaire with no control group (QUAN). Toward the end of the study, 2 focus groups were conducted with a subsample of health care aides (qual, qualitative description design). Technology acceptance and usability questionnaires used a 5-point Likert scale ranging from disagree (1) to agree (5). The items included in the questionnaires were validated in earlier research as having high levels of internal consistency for the Unified Theory of Acceptance and Use of Technology constructs. A total of 60 health care aides who provided services to older adults as part of their routine caseloads used the mobile app for 1 month. Comparisons of the Unified Theory of Acceptance and Use of Technology constructs' summative scores at pretest and posttest were calculated using a paired t test (2-tailed). We used the partial least squares structural regression model to determine the factors influencing mobile app acceptance and usability for health care aides. The α level of significance for all tests was set at P≤.05 (2-tailed).ResultsWe found that acceptance of the mSCS was high among health care aides, performance expectancy construct was the strongest predictor of intention to use the mSCS, intention to use the mSCS predicted usage behavior. The qualitative data support the quantitative findings and showed health care aides' strong belief that the mSCS was useful, portable, and reliable, although there were still opportunities for improvement, especially with regard to the mSCS user interface.ConclusionsOverall, these results support the assertion that mSCS technology acceptance and usability are high among health care aides. In other words, health care aides perceived that the mSCS assisted them in addressing their workflow issues.

Project description:BackgroundCertolizumab pegol (CZP) is an anti-tumor necrosis factor drug approved for the treatment of multiple moderate to severe chronic inflammatory diseases. In the European Union, CZP is approved for administration by subcutaneous self-injection using a prefilled syringe, prefilled pen, or reusable electromechanical auto-injector (electronic device). CimplyMe is a companion app for use alongside CZP self-injection devices, designed to support CZP-treated patients self-managing their treatment and disease.ObjectiveThis study aimed to validate the usability of the companion app by demonstrating that tasks required for use can be performed successfully by intended end users.MethodsWe recruited 15 patients with moderate to severe rheumatoid arthritis, currently prescribed biologic treatment, and using apps on a smart phone. Patients were assessed on their ability to use the companion app in a setting designed to simulate a location where patients regularly administer biologic treatment. To assess the usability of the key features of the app, 8 critical and 3 noncritical tasks were designed. Patients' success on each task was recorded through observations or knowledge-based questions. Successes with difficulty and use errors were also recorded. If a patient made a use error at the first attempt, a second attempt was allowed. Second-attempt use errors were recorded as a task failure.ResultsA total of 207 first attempts at the 14 components of the 8 critical tasks were evaluated (3 patients failed to complete one component); 178 (86.0%) critical tasks were successfully completed at the first attempt. The remaining first attempts comprised 16 (7.7%) successes with difficulty and 13 (6.3%) use errors, which had to be repeated. One critical task was not re-attempted by one patient due to time constraints; however, there were no use errors in the 12 completed second attempts. A total of 107 first attempts at the 3 noncritical tasks were made, all of which (107/107, 100.0%) were completed without use errors.ConclusionsIn simulated testing, patients were able to successfully use the companion app without formal training. This study suggests the companion app is easy to use and could help patients prescribed CZP better manage their treatment and disease.

Project description:BackgroundEfficient digitization in medicine still is in its infancy but undeniably has great potential for current and future challenges in health care. Thus far, the rollout of medical apps has not resulted in widespread use of smartphones in the German health care sector-the reasons for this have not been clarified so far. Nevertheless, the lack of user involvement in the development process and content creation might contribute to low acceptance of these products.ObjectiveThis study aims to outline an approach to involve medical expertise without any coding knowledge for developing medical app content and functions.MethodsAn end user-operable backend was built. Its usability was evaluated using a usability evaluation test protocol. The results of the usability tests were evaluated by the app development team, and the usability test was repeated for optimizing backend usability. In total, 40 criteria to measure the ease of app usage were defined a priori. The usability test comprised 20 tasks that had to be fulfilled. Usability tasks were analyzed for completion, dropout, and test duration. Due to the COVID-19 pandemic, digital videoconferencing platforms (Zoom and QuickTime Player) were used to complete usability questionnaires. Finally, several backend-based apps for several specialties (infectiology, plastic and reconstructive surgery, and orthopedics) were developed by health care professionals as prototypes.ResultsInitial usability testing was conducted with 5 participants (4 men and 1 woman; mean age 39.2, SD 5.97 years). All of them could complete the assigned backend tasks with only a few workflow interruptions and some minor errors. After usability optimization, the workflow completion time decreased from 5.03 minutes to 3.50 minutes, indicating a time saving. The basic backend structure was clear to all test users and the handling was intuitive to learn. Some minor errors in the backend occurred during the test rounds. The apps developed using the aforementioned approach are in clinical use as a proof of concept.ConclusionsBackends offering operability for medical professionals might have great potential for app development in the mobile health sector. Sophisticated and time-saving usability are pivotal for the acceptance of medical software, as illustrated by the backend-based apps presented herein, which are in clinical use as a proof of concept. Basic interventions are essential and sufficient for adequate usability optimization. Practicable, well-structured software usability evaluation is possible based on the usability evaluation test protocol.

Dataset Information

Development and Usability of a Novel Interactive Tablet App (PediAppRREST) to Support the Management of Pediatric Cardiac Arrest: Pilot High-Fidelity Simulation-Based Study.

Publications

Development and Usability of a Novel Interactive Tablet App (PediAppRREST) to Support the Management of Pediatric Cardiac Arrest: Pilot High-Fidelity Simulation-Based Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets