Development and Usability Evaluation of a Desktop Software Application for Pain Assessment in Infants.
Ontology highlight
ABSTRACT: Background
Pain assessment is a key component of pain management and research in infants. We developed software to assist in coding of pain in infants called PAiN (Pain Assessment in Neonates).Aims
The aims of this study were to evaluate the usability of PAiN in terms of effectiveness, efficiency, and satisfaction among novice and expert users and to compare the efficiency and satisfaction of PAiN to existing software for coding of infant pain among expert users.Methods
A quantitative usability testing approach was conducted with two participant groups, representing novice and expert end-users. Testing included an observed session with each participant completing a pain assessment coding task, followed by administration of the Post Study System Usability Questionnaire and Desirability Toolkit. For comparison, the usability of existing coding software was also evaluated by the expert group.Results
Twelve novice and six expert users participated. Novice users committed 14 noncritical navigational errors, and experts committed six. For experts, the median time for completing the coding task was 28.6 min in PAiN, compared to 46.5 min using the existing software. The mean Post Study System Usability Questionnaire score among novice (1.89) and expert users (1.40) was not significantly different (P = 0.0917). Among experts, the score for the existing software (4.83) was significantly (P = 0.0277) higher compared to PAiN (1.40). Lower scores indicate more positive responses.Conclusions
Users were highly satisfied with PAiN. Experts were more efficient with PAiN compared to the existing software. The study was critical to ensuring that PAiN is error free and easy to use prior to implementation.
SUBMITTER: Hundert AS
PROVIDER: S-EPMC8730649 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundReduced or absence of melanin poses physical, social, and psychological challenges to individuals with albinism. Mobile health (mHealth) applications have the potential to improve the accessibility of information and services while reducing time and costs. This study aimed to develop and evaluate a mHealth application for self-management of albinism.MethodsThis applied study was conducted in two stages (development and evaluation) in 2022. Initially, the functional requirements were determined, and the conceptual model of the application was then developed using Microsoft Visio 2021. In the second phase, the application was evaluated using the Mobile Application Usability Questionnaire (MAUQ) involving patients with albinism to reflect their views on the usability of the application.ResultsThe key capabilities of the application included: reminders, alerts, educational content, useful links, storage and exchange of images of skin lesions, specialist finder, and notifications for albinism-relevant events. Twenty-one users with albinism participated in the usability testing of the application. The users were predominantly satisfied with the application (5.53 ± 1.10; Max: 7.00).ConclusionsThe findings of this study suggest that the developed mobile application could assist individuals with albinism to effectively manage their condition by considering the users' requirements and services that the application should deliver.
| S-EPMC10262590 | biostudies-literature
Project description:ObjectivePoor electronic health record (EHR) usability contributes to clinician burnout and poses patent safety risks. Site-specific customization and configuration of EHRs require individual EHR system usability and safety testing which is resource intensive. We developed and pilot-tested a self-administered EHR usability and safety assessment tool, focused on computerized provider order entry (CPOE), which can be used by any facility to identify specific issues. In addition, the tool provides recommendations for improvement.Materials and methodsAn assessment tool consisting of 104 questions was developed and pilot-tested at 2 hospitals, one using a Cerner EHR and the other using Epic. Five physicians at each site participated in and completed the assessment. Participant response accuracy compared to actual EHR interactions, consistency across participants, and usability issues identified through the tool were measured at each site.ResultsAcross sites, participants answered an average of 46 questions in 23 min with 89.9% of responses either correct or partially correct. The tool identified 8 usability and safety issues at one site and 7 at the other site across medication, laboratory, and radiology CPOE functions.DiscussionThe tool shows promise as a method to rapidly evaluate EHR usability and safety and provide guidance on specific areas for improvement. Important improvements to the evaluation tool were identified including the need to clarify certain questions and provide definitions for usability terminology.ConclusionA self-administered usability and safety assessment tool can serve to identify specific usability and safety issues in the EHR and provide guidance for improvements.
| S-EPMC9338455 | biostudies-literature
Project description:Pain in infancy is poorly understood, and medical staff often have difficulty assessing whether an infant is in pain. Current pain assessment tools rely on behavioural and physiological measures, such as change in facial expression, which may not accurately reflect pain experience. Our ability to measure cortical pain responses in young infants gives us the first opportunity to evaluate pain assessment tools with respect to the sensory input and establish whether the resultant pain scores reflect cortical pain processing.Cortical haemodynamic activity was measured in infants, aged 25-43 wk postmenstrual, using near-infrared spectroscopy following a clinically required heel lance and compared to the magnitude of the premature infant pain profile (PIPP) score in the same infant to the same stimulus (n = 12, 33 test occasions). Overall, there was good correlation between the PIPP score and the level of cortical activity (regression coefficient = 0.72, 95% confidence interval [CI] limits 0.32-1.11, p = 0.001; correlation coefficient = 0.57). Of the different PIPP components, facial expression correlated best with cortical activity (regression coefficient = 1.26, 95% CI limits 0.84-1.67, p < 0.0001; correlation coefficient = 0.74) (n = 12, 33 test occasions). Cortical pain responses were still recorded in some infants who did not display a change in facial expression.While painful stimulation generally evokes parallel cortical and behavioural responses in infants, pain may be processed at the cortical level without producing detectable behavioural changes. As a result, an infant with a low pain score based on behavioural assessment tools alone may not be pain free.
| S-EPMC2504041 | biostudies-literature
Project description:ObjectivesWe seek to develop a prototype software analytical tool to augment FDA regulatory reviewers' capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool.MethodsA prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use.ResultsAll usability test participants cited the tool's ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool's automated literature search relative to a manual 'all fields' PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools.ConclusionsUsability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction.
| S-EPMC5373771 | biostudies-literature
Project description:Symptom drawings are widely used as a qualitative and quantitative method of assessing pain symptoms for both clinical and research purposes. As electronic drawings offer many advantages over classical pen-and-paper drawings, the last years have seen a shift toward tablet-based acquisition of symptom drawings. However, software that is used in clinical care requires special attention to usability aspects and design to provide easy access for physically impaired or elderly patients.The aims of this project were to develop a new tablet-based software app specifically designed to collect patients' and doctors' drawings of pain and related bodily symptoms and test it for usability in 2 samples of chronic pain patients (Aim 1) and their treating doctors (Aim 2) as well as for test-retest reliability (Aim 3).In 2 separate studies, symptom drawings from 103 chronic pain patients and their treating doctors were collected using 2 different versions of the app. Both patients and doctors evaluated usability aspects of the app through questionnaires. Results from study 1 were used to improve certain features of the app, which were then evaluated in study 2. Furthermore, a subgroup of 25 patients in study 2 created 2 consecutive symptom drawings for test-retest reproducibility analysis. Usability of both app versions was compared, and reproducibility was calculated for symptom extent, number of symptom clusters, and the whole symptom pattern.The changes we made to the app and the body outline led to significant improvements in patients' usability evaluation regarding the identification with the body outline (P=.007) and the evaluation of symptom depth (P=.02), and the overall difficultness of the drawing process (P=.003) improved significantly. Doctors' usability evaluation of the final app showed good usability with 75.63 (SD 19.51) points on the System Usability Scale, Attrakdiff 2 scores from 0.93 to 1.41, and ISONORM 9241/10 scores from -0.05 to 1.80. Test-retest analysis showed excellent reproducibility for pain extent (intraclass correlation coefficient, ICC=0.92) and good results for the number of symptom clusters (ICC=0.70) and a mean overlap of 0.47 (Jaccard index).We developed a tablet-based symptom drawing app and improved it based on usability assessment in a sample of chronic pain patients and their treating doctors. Increases in usability of the improved app comprised identification with the body outline, symptom depth evaluation, and difficultness of the drawing process. Test-retest reliability of symptom drawings by chronic pain patients showed fair to excellent reproducibility. Patients' usability evaluation is an important factor that should not be neglected when designing apps for mobile or eHealth apps.
| S-EPMC6000481 | biostudies-literature
Project description:AIM: To validate and evaluate the psychometric properties of the ALPS-Neo, a new pain assessment scale created for the continuous evaluation of pain and stress in preterm and sick term infants. METHODS: A unidimensional scale for continuous pain, Astrid Lindgren Children's Hospital Pain Scale (ALPS 1), was developed further to assess continuous pain and stress in infants treated in the neonatal intensive care unit (NICU). The pain scale includes observations of five behaviours. A manual was created, clarifying the scoring criteria. An internal and an external panel assessed face validity. Psychometric properties were evaluated in three different steps. Inter-rater reliability was estimated from video-based assessments (n = 625) using weighted kappa statistics (test I). Inter-rater reliability was further evaluated in test II (n = 125) and test III (n = 96) by real-time assessments using the intraclass correlation coefficient (ICC) and Cronbach's alpha. RESULTS: The final inter-rater reliability (test III) was assessed as good with ICC 0.91 for the total score and 0.62-0.81 for the five items. Cronbach's alpha showed 0.95 for the total score. CONCLUSION: ALPS-Neo is a new assessment tool for optimising the management of pain and stress in newborn infants in the NICU. It has proved easy to implement and user-friendly, permitting fast, reliable observations with high inter-rater reliability.
| S-EPMC4368370 | biostudies-literature
Project description:IntroductionInfants and children are frequently exposed to painful medical procedures such as immunisation, blood sampling and intravenous access. Over 40 scales for pain assessment are available, many designed for neonatal or postoperative pain. What is not well understood is how well these scales perform when used to assess procedural pain in infants and children.AimThe aim of this study was to test the psychometric and practical properties of the Face, Legs, Activity, Cry and Consolability (FLACC) scale, the Modified Behavioural Pain Scale (MBPS) and the Visual Analogue Scale (VAS) observer pain scale to quantify procedural pain intensity in infants and children aged from 6-42 months to determine their suitability for clinical and research purposes.Methods and analysisA prospective observational non-interventional study conducted at a single centre. The psychometric and practical performance of the FLACC scale, MBPS and the VAS observer pain scale and VAS observer distress scale used to assess children experiencing procedural pain will be assessed. Infants and young children aged 6-42 months undergoing one of four painful and/or distressing procedures were recruited and the procedure digitally video recorded. Clinicians and psychologists will be recruited to independently apply the scales to these video recordings to establish intrarater and inter-rater reliability, convergent validity responsiveness and specificity. Pain score distributions will be presented descriptively; reliability will be assessed using the intraclass correlation coefficient and Bland-Altman plots. Spearman correlations will be used to assess convergence and linear mixed modelling to explore the responsiveness of the scales to pain and their capacity to distinguish between pain and distress.Ethics and disseminationEthical approval was provided by the Royal Children's Hospital Human Research Ethics Committee, approval number 35220B. The findings of this study will be disseminated via peer-reviewed journals and presented at international conferences.
| S-EPMC5589003 | biostudies-literature
Project description:In several nations, caries in pre-school children remain a significant oral health issue. In an outbreak period such as the Coronavirus disease 2019 (COVID-19), remote contact and education aimed at the prevention of oral diseases and the preservation of children's oral health are more relevant than ever. Currently, the amount of published applications is far higher than the published scientific studies while the problems of usability remains vulnerable. The goal of this paper was to comprehensively document the phase of development and usability testing of a mobile application for diet and oral health, namely Gigiku Sihat, which was primarily intended to be used by parents and guardians of pre-school children. The mobile application was developed using the System Development Life Cycle principle. Apart from searching for the available oral health application on Android platform, the initial requirement gathering process consisted of situational analysis, concept generation, content development, and features and functional requirement determination. The mobile application design and implementation evolved at each phase before being finalised. Gigiku Sihat was successfully developed in the Bahasa Malaysia. Finalised Gigiku Sihat was installed on mobile devices to determine the usability using translated and validated System Usability Scale questionnaire namely Skala Kebolehgunaan Aplikasi Mudah Alih (SKAMA). The mean score usability with score of 68 and above was deemed to have good usability. This study found that Gigiku Sihat mean (SD) usability score was 77.0 (14.18). The results were promising as they showed that Gigiku Sihat had a good usability. Thus, the development of this mobile application focusing on diet and oral health served as a new source of oral health education and provided a necessary foundation in developing future improved mobile application development for parents in the prevention of early childhood caries.
| S-EPMC8425540 | biostudies-literature
Project description:A desktop NMR spectrometer was used to qualitatively analyze samples in drug-related cases in order to enhance the accuracy of the results and identify new drugs. Twelve known drugs and their derivatives were used to establish the parameters, conditions, and procedures for the methods and validate the feasibility and reliability of the methods. First, 1-D and 2-D NMR data for these 12 drugs and their derivatives were obtained in detail using a 600-MHz NMR spectrometer to create a data library. Next, some of these 12 drugs were analyzed using a Picospin 80 MHz desktop NMR spectrometer to set up the analytical procedure and method. With the procedure and method established, real case samples were analyzed and the data were compared to those obtained by a standard method. The results indicate that the desktop NMR spectrometer is a reliable and promising approach that can be used in criminology to quickly identify whether or not samples contain illegal drugs.
| S-EPMC6169242 | biostudies-literature
Project description:BackgroundThe use of patient health and treatment information captured in structured and unstructured formats in computerized electronic health record (EHR) repositories could potentially augment the detection of safety signals for drug products regulated by the US Food and Drug Administration (FDA). Natural language processing and other artificial intelligence (AI) techniques provide novel methodologies that could be leveraged to extract clinically useful information from EHR resources.ObjectiveOur aim is to develop a novel AI-enabled software prototype to identify adverse drug event (ADE) safety signals from free-text discharge summaries in EHRs to enhance opioid drug safety and research activities at the FDA.MethodsWe developed a prototype for web-based software that leverages keyword and trigger-phrase searching with rule-based algorithms and deep learning to extract candidate ADEs for specific opioid drugs from discharge summaries in the Medical Information Mart for Intensive Care III (MIMIC III) database. The prototype uses MedSpacy components to identify relevant sections of discharge summaries and a pretrained natural language processing (NLP) model, Spark NLP for Healthcare, for named entity recognition. Fifteen FDA staff members provided feedback on the prototype's features and functionalities.ResultsUsing the prototype, we were able to identify known, labeled, opioid-related adverse drug reactions from text in EHRs. The AI-enabled model achieved accuracy, recall, precision, and F1-scores of 0.66, 0.69, 0.64, and 0.67, respectively. FDA participants assessed the prototype as highly desirable in user satisfaction, visualizations, and in the potential to support drug safety signal detection for opioid drugs from EHR data while saving time and manual effort. Actionable design recommendations included (1) enlarging the tabs and visualizations; (2) enabling more flexibility and customizations to fit end users' individual needs; (3) providing additional instructional resources; (4) adding multiple graph export functionality; and (5) adding project summaries.ConclusionsThe novel prototype uses innovative AI-based techniques to automate searching for, extracting, and analyzing clinically useful information captured in unstructured text in EHRs. It increases efficiency in harnessing real-world data for opioid drug safety and increases the usability of the data to support regulatory review while decreasing the manual research burden.
| S-EPMC10538589 | biostudies-literature