Evaluating and improving the usability of a mHealth platform to assess postoperative dental pain.
Ontology highlight
ABSTRACT: Objectives
The use of interactive mobile health (mHealth) applications to monitor patient-reported postoperative pain outcomes is an emerging area in dentistry that requires further exploration. This study aimed to evaluate and improve the usability of an existing mHealth application.Materials and methods
The usability of the application was assessed iteratively using a 3-phase approach, including a rapid cognitive walkthrough (Phase I), lab-based usability testing (Phase II), and in situ pilot testing (Phase III). The study team conducted Phase I, while providers and patients participated in Phase II and III.Results
The rapid cognitive walkthrough identified 23 potential issues that could negatively impact user experience, with the majority classified as system issues. The lab-based usability testing yielded 141 usability issues.; 43% encountered by patients and 57% by dentists. Usability problems encountered during pilot testing included undelivered messages due to mobile phone carrier and service-related issues, errors in patients' phone number data entry, and problems in provider training.Discussion
Through collaborative and iterative work with the vendor, usability issues were addressed before launching a trial to assess its efficacy.Conclusion
The usability of the mHealth application for postoperative dental pain was remarkably improved by the iterative analysis and interdisciplinary collaboration.
SUBMITTER: Ibarra-Noriega AM
PROVIDER: S-EPMC10928307 | biostudies-literature | 2024 Apr
REPOSITORIES: biostudies-literature
Publications
Evaluating and improving the usability of a mHealth platform to assess postoperative dental pain.
Ibarra-Noriega Ana M AM Yansane Alfa A Mullins Joanna J Simmons Kristen K Skourtes Nicholas N Holmes David D White Joel J Kalenderian Elsbeth E Walji Muhammad F MF
JAMIA open 20240311 1
<h4>Objectives</h4>The use of interactive mobile health (mHealth) applications to monitor patient-reported postoperative pain outcomes is an emerging area in dentistry that requires further exploration. This study aimed to evaluate and improve the usability of an existing mHealth application.<h4>Materials and methods</h4>The usability of the application was assessed iteratively using a 3-phase approach, including a rapid cognitive walkthrough (Phase I), lab-based usability testing (Phase II), an ...[more]
Similar Datasets
Project description:BackgroundPostoperative dental pain is pervasive and can affect a patient's quality of life. Adopting a patient-centric approach to pain management involves having contemporaneous information about the patient's experience of pain and using it to personalize care.ObjectiveIn this study, we evaluated the use of a mobile health (mHealth) platform to collect pain-related patient-reported outcomes over 7 days after the patients underwent pain-inducing dental procedures; we then relayed the information to the dentist and determined its impact on the patient's pain experience.MethodsThe study used a cluster-randomized experimental study design with an intervention arm where patients were prompted to complete a series of questions relating to their pain experience after receiving automated text notifications on their smartphone on days 1, 3, 5, and 7, with the resulting information fed back to dentists, and a control arm where patients received usual care. Providers were randomized, and patients subsequently assumed the enrollment status of their providers. Providers or their staff identified eligible patients and invited them to participate in the study. Provider interviews and surveys were conducted to evaluate acceptance of the mHealth platform.ResultsA total of 42 providers and 1525 patients participated. For the primary outcome (pain intensity on a 1 to 10 scale, with 10 being the most painful), intervention group patients reported an average pain intensity of 4.8 (SD 2.6), while those in the control group reported an average pain intensity of 4.7 (SD 2.8). These differences were not significant. There were also no significant differences in secondary outcomes, including pain interference with activity or sleep, patient satisfaction with pain management, or opioid prescribing. Patient surveys revealed reluctance to use the app was mostly due to technological challenges, data privacy concerns, and a preference for phone calls over texting. Providers had high satisfaction with the app and suggested integrating additional features, such as an in-system camera for patients to upload pictures and videos of the procedural site, and integration with the electronic health record system.ConclusionsWhile the mHealth platform did not have a significant impact on acute postoperative pain experience, patients and providers indicated improvement in patient-provider communication, patient-provider relationship, postoperative complication management, and ability to manage pain medication prescribing. Expanded collaboration between mHealth developers and frontline health care providers can facilitate the applicability of these platforms, further help improve its integration with the normal clinic workflow, and assist in moving toward a more patient-centric approach to pain management.
| S-EPMC10644946 | biostudies-literature
Project description:Usability questionnaires have a wide use in mobile health (mHealth) app usability studies. However, no systematic review has been conducted for assessing the effectiveness of these questionnaires.This paper describes a protocol for conducting a systematic review of published questionnaire-based mHealth app usability studies.In this systematic review, we will select recently published (2008-2017) articles from peer-reviewed journals and conferences that describe mHealth app usability studies and implement at least one usability questionnaire. The search strategy will include terms such as "mobile app" and "usability." Multiple databases such as PubMed, CINAHL, IEEE Xplore, ACM Digital Library, and INSPEC will be searched. There will be 2 independent reviewers in charge of screening titles and abstracts as well as determining those articles that should be included for a full-text review. The third reviewer will act as a mediator between the other 2 reviewers. Moreover, a data extraction form will be created and used during the full article data analysis. Notably, the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guidelines will be followed in reporting this protocol.A preliminary search produced 1271 articles, 40 of which are duplicate records. The inclusion-exclusion criteria are being strictly followed in performing the ongoing study selection.Usability questionnaires are an important tool in mHealth app usability studies. This review will summarize the usability questionnaires used in published research articles while assessing the efficacy of these questionnaires in determining the usability of mHealth apps.
| S-EPMC5558042 | biostudies-other
Project description:Effective management of chronic low back pain (LBP) often relies on maintaining a healthy lifestyle. Mobile health (mHealth) applications provide a unique opportunity to support LBP sufferers by integrating evidence-based health education into daily routines. However, many existing mHealth apps lack scientific rigour in their development, limiting their impact. This study reports on developing and usability testing My Back Exercise, an mHealth app designed to support individuals managing chronic LBP through a user-centred, theory-based approach. The development followed the Double Diamond framework and Software Development Life Cycle (SDLC) model, focusing on behaviour change theory to promote healthy lifestyle habits. Usability testing involved ten users and employed the System Usability Scale (SUS) and Mobile App Rating Scale (MARS) to assess engagement, functionality, aesthetics, and information quality. Additionally, a think-aloud approach captured real-time feedback and guided iterative improvements. Results showed that the app was well-received, achieving a SUS mean score of 79 (total score of 100) and a MARS mean score of 3.7 (out of 5.0). Key intervention components included exercises, sleep management, diet, and pain education, contributing to a holistic self-management tool. This study provides a transparent roadmap for the development of evidence-based digital health tools. The My Back Exercise app offers an innovative, holistic approach to help people self-manage chronic LBP using evidence-based methods.Supplementary informationThe online version contains supplementary material available at 10.1007/s41666-024-00179-0.
| S-EPMC11782706 | biostudies-literature
Project description:BACKGROUND:After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users' feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE:The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS:An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS:In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS:The newly created mHealth app usability questionnaire-MAUQ-has the reliability and validity required to assess mHealth app usability.
| S-EPMC6482399 | biostudies-other
Project description:BackgroundChronic pain (CP) is 1 of the leading causes of disability worldwide and represents a significant burden on individual, social, and economic aspects. Potential tools, such as mobile health (mHealth) systems, are emerging for the self-management of patients with CP.ObjectiveA systematic review was conducted to analyze the effects of mHealth interventions on CP management, based on pain intensity, quality of life (QoL), and functional disability assessment, compared to conventional treatment or nonintervention.MethodsPRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) guidelines were followed to conduct a systematic review of randomized controlled trials (RCTs) published in PubMed, Web of Science, Scopus, and Physiotherapy Evidence Database (PEDro) databases from February to March 2022. No filters were used. The eligibility criteria were RCTs of adults (≥18 years old) with CP, intervened with mHealth systems based on mobile apps for monitoring pain and health-related outcomes, for pain and behavioral self-management, and for performing therapeutic approaches, compared to conventional treatments (physical, occupational, and psychological therapies; usual medical care; and education) or nonintervention, reporting pain intensity, QoL, and functional disability. The methodological quality and risk of bias (RoB) were assessed using the Checklist for Measuring Quality, the Oxford Centre for Evidence-Based Medicine Levels of Evidence, and the Cochrane RoB 2.0 tool.ResultsIn total, 22 RCTs, involving 2641 patients with different CP conditions listed in the International Classification of Diseases 11th Revision (ICD-11), including chronic low back pain (CLBP), chronic musculoskeletal pain (CMSP), chronic neck pain (CNP), unspecified CP, chronic pelvic pain (CPP), fibromyalgia (FM), interstitial cystitis/bladder pain syndrome (IC/BPS), irritable bowel syndrome (IBS), and osteoarthritis (OA). A total of 23 mHealth systems were used to conduct a variety of CP self-management strategies, among which monitoring pain and symptoms and home-based exercise programs were the most used. Beneficial effects of the use of mHealth systems in reducing pain intensity (CNP, FM, IC/BPS, and OA), QoL (CLBP, CNP, IBS, and OA), and functional disability (CLBP, CMSP, CNP, and OA) were found. Most of the included studies (18/22, 82%) reported medium methodological quality and were considered as highly recommendable; in addition, 7/22 (32%) studies had a low RoB, 10/22 (45%) had some concerns, and 5/22 (23%) had a high RoB.ConclusionsThe use of mHealth systems indicated positive effects for pain intensity in CNP, FM, IC/BPS, and OA; for QoL in CLBP, CNP, IBS, and OA; and for functional disability in CLBP, CMSP, CNP, and OA. Thus, mHealth seems to be an alternative to improving pain-related outcomes and QoL and could be part of multimodal strategies for CP self-management. High-quality studies are needed to merge the evidence and recommendations of the use of mHealth systems for CP management.Trial registrationPROSPERO International Prospective Register of Systematic Reviews CRD42022315808; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=315808.
| S-EPMC9936365 | biostudies-literature
Project description:BackgroundCOVID-19 continues to disrupt global health and well-being. In April-May 2020, we generated a digital, remote interactive tool to provide health and well-being resources and foster connectivity among community members through a text messaging platform.ObjectiveThis study aimed to prospectively investigate the ability of a health system-based digital, remote, interactive tool to provide health and well-being resources to local community participants and to foster connectivity among them during the early phases of COVID-19.MethodsWe performed descriptive and nonparametric longitudinal statistical analyses to describe and compare the participants' mood ratings over time and thematic analysis of their responses to text messages to further assess mood.ResultsFrom among 393 individuals seeking care in an urban emergency department in an academic setting, engaged in a two-way text messaging platform, we recorded 287 mood ratings and 368 qualitative responses. We observed no difference in the initial mood rating by week of enrollment [Kruskal-Wallis chi-square H(5)=1.34; P=.93], and the average mood rating did not change for participants taken together [Friedman chi-square Q(3)=0.32; P=.96]. However, of participants providing mood ratings at baseline, mood improved significantly among participants who reported a low mood rating at baseline [n=25, 14.97%; Q(3)=20.68; P<.001] but remained stable among those who reported a high mood rating at baseline [n=142, 85.03%; Q(3)=2.84; P=.42]. Positive mood elaborations most frequently included words related to sentiments of thankfulness and gratitude, mostly for a sense of connection and communication; in contrast, negative mood elaborations most frequently included words related to anxiety.ConclusionsOur findings suggest the feasibility of engaging individuals in a digital community with an emergency department facilitation. Specifically, for those who opt to engage in a text messaging platform during COVID-19, it is feasible to assess and respond to mood-related queries with vetted health and well-being resources.
| S-EPMC7919843 | biostudies-literature
Project description:Introduction:Chronic pain has become a matter of public health concern due to its high prevalence and because public costs associated with treatment and disability increase each year. Research suggests that limitations in the traditional assessment of chronic pain patients limit the effectiveness of current medical treatments. The use of technology might serve change patient traditional monitoring into ecological momentary assessments, which might be visualised by physicians live. This study describes a randomised control trial designed to test the utility of a technology-based solution for pain telemonitoring consisting of a smartphone app for patients and a web application for physicians. The goal of this study will be to explore whether this combination of eHealth and mHealth improves the effectiveness of existing pain treatments.Methods and analysis:Participants will be 250 patients randomly assigned to one of these two conditions: treatment-as-usual (TAU) and TAU +app+ web. All participants will receive the usual treatment for their pain. Only the TAU +app+ web group use Pain Monitor app, which generates alarms that are sent to the physicians in the face of previously established undesired events. Physicians will be able to monitor app reports using a web application, which might result in an adjustment of treatment. We anticipate that the use of Pain Monitor plus the therapist web will result in a reduction of pain intensity and side effects of the medication. Improvements on secondary outcomes, namely fatigue, mood, pain interference, rescue medication use and quality of life, are also expected. Mixed repeated-measure multivariate analyses of variances will be conducted to investigate whether there are differences between preassessment and postassessment scores as a function of the experimental condition.Ethics and dissemination:Ethical approval from the Hospital General Universitari de Castellon was obtained. The findings will be published in peer-reviewed journals.Trial registration number:NCT03606265.
| S-EPMC6937108 | biostudies-literature
Project description:A moldable and biodegradable dental material was designed for customized placement and sustained delivery of bupivacaine (BP) within an extraction cavity. Microparticles comprising poly(lactic-co-glycolic acid) (PLGA) containing BP were generated via solvent-evaporation and combined with absorbable hemostat Gelfoam®. Kinetics of drug release were evaluated by in vitro dialysis assays, showing higher release within the first 24 hours, with subsequent tapering of release kinetics. Formulations of Gelfoam® and BP-PLGA microparticles (GelBP), with three targeted dosing profiles (0.25, 0.5, and 1 mg/kg/day), were evaluated alongside acute subcutaneous BP injections (2 mg/kg) to determine analgesic efficacy in a rat model of tooth extraction pain. Molar extraction resulted in mechanical and thermal cold hyperalgesia in male and female rats. GelBP outperformed acute BP in blocking post-surgical dental pain, with the 0.25 mg/kg GelBP dose preventing hypersensitivity to mechanical (p < 0.01) and thermal cold stimuli (p = 0.05). Molar extraction also resulted in decreased food consumption and weight. Males receiving acute BP and 0.25 mg/kg GelBP maintained normal food consumption (p < 0.002) and weight (p < 0.0001) throughout 7 days. Females, receiving 0.25 mg/kg GelBP maintained weight on days 5-7 (p < 0.04). Customized, sustained release formulation of anesthetic within a tooth extraction cavity holds potential to eliminate post-operative dental pain over several days.
| S-EPMC6093872 | biostudies-literature
Project description:Considering the widespread use of rabbits in research that potentially causes pain and discomfort and the limited number of pain assessment validated tools in this species, we aimed to develop and validate a scale of acute postoperative pain in rabbits (RPBS). Footage of 58 rabbits from previous studies were used, recorded at 'baseline' (before orthopaedic and soft tissue surgeries), 'pain' (after surgery), 'analgesia' (after analgesic), and '24h post' (24 hours after surgery). The videos were randomised and assessed twice by four evaluators, within one-month interval between evaluations. After content validation, RBPS was further refined using the criteria from the validation. According to the principal component analysis, RPBS was considered unidimensional. The intra- and inter-observer reliability was excellent (ICC>0.80) for all evaluators. There was a high Spearman's correlation of the RPBS with unidimensional scales (>0.80) and a moderate correlation with the Rabbit Grimace Scale (0.68), confirming criterion validity. According to the mixed linear model, the scale was responsive, shown by the increase in pain scores after surgery. Construct validity was confirmed by known-group approach and internal relationships among items. Adequate item-total correlation (>0.3) was observed for all items, except for the attention to the affected area (0.04). The internal consistency was very good (Cronbach's α coefficient = 0.78; Mcdonald's ω coefficient = 0.83). The cut-off score for rescue analgesia was ≥3, with an area under the curve >0.95, demonstrating a high discriminatory capacity of the instrument. Scores 3 and 4 were within the uncertainty diagnostic zone. Specificity was 87% and sensitivity was 90%. It was concluded that the RPBS presented content, criterion, and construct validities, responsiveness, and reliability to assess acute pain in rabbits submitted to orthopaedic and soft tissue surgeries. The cut-off for rescue analgesia serves as a basis for the administration of analgesics to rabbits submitted to painful procedures.
| S-EPMC9135295 | biostudies-literature
Project description:BackgroundEmphasis on outpatient pediatric surgical procedures places the burden of responsibility for postoperative pain management on parents or guardians. Panda is a mobile phone app that provides scheduled medication alerts and allows parents to track their child's pain and medication administration. We have previously tested and optimized the usability and feasibility of Panda within the hospital setting.ObjectiveThe purpose of this study was to evaluate and optimize the usability and feasibility of Panda for use at home based on alert response adherence (response to any medication notification within 1 hour) and parents' satisfaction.MethodsParents or guardians of children aged 3 to 18 years undergoing day surgery were recruited to use Panda at home for 1 to 7 days to manage their scheduled medications and to assess their child's pain. After the surgical procedure, a research assistant guided parents through app setup before independent use at home. We aimed to recruit 10 child-caregiver pairs in each of three rounds of evaluation. Each user's adherence with the recommended medication alerts was analyzed through audit-trail data generated during the use of the app. We used the Computer System Usability Questionnaire and a poststudy phone interview to evaluate the app's ease of use and identify major barriers to adoption. Suggestions provided during the interviews were used to improve the app between each round.ResultsTwenty-nine child-caregiver pairs participated in three rounds, using the app for 1 to 5 days. Alert response adherence (response to any medication notification within 1 hour) improved as the study progressed: participants responded to a median 30% (interquartile range [IQR] 22%-33%) of alerts within 1 hour in round 1, and subsequently to median 60% (IQR 44%-64%) in round 2 and median 64% (IQR 56%-72%) in round 3 (P=.005). Similarly, response times decreased from median 131 (IQR 77-158) minutes in round 1 to median 31 (IQR 18-61) minutes in round 2 and median 10 (IQR 2-14) minutes in round 3 (P=.002). Analysis of interview feedback from the first two rounds revealed usability issues, such as complaints of too many pages and trouble hearing app alerts, which were addressed to streamline app function, as well as improve visual appearance and audible alerts.ConclusionsIt is feasible for parents or guardians to use Panda at home to manage their child's medication schedule and track their pain. Simple modifications to the app's alert sounds and user interface improved response times.
| S-EPMC7709843 | biostudies-literature