Dataset Information

The SleepFit Tablet Application for Home-Based Clinical Data Collection in Parkinson Disease: User-Centric Development and Usability Study.

ABSTRACT:

Background

Parkinson disease (PD) is a common, multifaceted neurodegenerative disorder profoundly impacting patients' autonomy and quality of life. Assessment in real-life conditions of subjective symptoms and objective metrics of mobility and nonmotor symptoms such as sleep disturbance is strongly advocated. This information would critically guide the adaptation of antiparkinsonian medications and nonpharmacological interventions. Moreover, since the spread of the COVID-19 pandemic, health care practices are being reshaped toward a more home-based care. New technologies could play a pivotal role in this new approach to clinical care. Nevertheless, devices and information technology tools might be unhandy for PD patients, thus dramatically limiting their widespread employment.

Objective

The goals of the research were development and usability evaluation of an application, SleepFit, for ecological momentary assessment of objective and subjective clinical metrics at PD patients' homes, and as a remote tool for researchers to monitor patients and integrate and manage data.

Methods

An iterative and user-centric strategy was employed for the development of SleepFit. The core structure of SleepFit consists of (1) an electronic finger-tapping test; (2) motor, sleepiness, and emotional subjective scales; and (3) a sleep diary. Applicable design, ergonomic, and navigation principles have been applied while tailoring the application to the specific patient population. Three progressively enhanced versions of the application (alpha, v1.0, v2.0) were tested by a total of 56 patients with PD who were asked to perform multiple home assessments 4 times per day for 2 weeks. Patient compliance was calculated as the proportion of completed tasks out of the total number of expected tasks. Satisfaction on the latest version (v2.0) was evaluated as potential willingness to use SleepFit again after the end of the study.

Results

From alpha to v1.0, SleepFit was improved in graphics, ergonomics, and navigation, with automated flows guiding the patients in performing tasks throughout the 24 hours, and real-time data collection and consultation were made possible thanks to a remote web portal. In v2.0, the kiosk-mode feature restricts the use of the tablet to the SleepFit application only, thus preventing users from accidentally exiting the application. A total of 52 (4 dropouts) patients were included in the analyses. Overall compliance (all versions) was 88.89% (5707/6420). SleepFit was progressively enhanced and compliance increased from 87.86% (2070/2356) to 89.92% (2899/3224; P=.04). Among the patients who used v2.0, 96% (25/26) declared they would use SleepFit again.

Conclusions

SleepFit can be considered a state-of-the-art home-based system that increases compliance in PD patients, ensures high-quality data collection, and works as a handy tool for remote monitoring and data management in clinical research. Thanks to its user-friendliness and modular structure, it could be employed in other clinical studies with minimum adaptation efforts.

Trial registration

ClinicalTrials.gov NCT02723396; https://clinicaltrials.gov/ct2/show/NCT02723396.

SUBMITTER: Mascheroni A

PROVIDER: S-EPMC8262669 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe Discovery Critical Care Research Network Program for Resilience and Emergency Preparedness (Discovery PREP) partnered with a third-party technology vendor to design and implement an electronic data capture tool that addressed multisite data collection challenges during public health emergencies (PHE) in the United States. The basis of the work was to design an electronic data capture tool and to prospectively gather data on usability from bedside clinicians during national health system stress queries and influenza observational studies.ObjectiveThe aim of this paper is to describe the lessons learned in the design and implementation of a novel electronic data capture tool with the goal of significantly increasing the nation's capability to manage real-time data collection and analysis during PHE.MethodsA multiyear and multiphase design approach was taken to create an electronic data capture tool, which was used to pilot rapid data capture during a simulated PHE. Following the pilot, the study team retrospectively assessed the feasibility of automating the data captured by the electronic data capture tool directly from the electronic health record. In addition to user feedback during semistructured interviews, the System Usability Scale (SUS) questionnaire was used as a basis to evaluate the usability and performance of the electronic data capture tool.ResultsParticipants included Discovery PREP physicians, their local administrators, and data collectors from tertiary-level academic medical centers at 5 different institutions. User feedback indicated that the designed system had an intuitive user interface and could be used to automate study communication tasks making for more efficient management of multisite studies. SUS questionnaire results classified the system as highly usable (SUS score 82.5/100). Automation of 17 (61%) of the 28 variables in the influenza observational study was deemed feasible during the exploration of automated versus manual data abstraction. The creation and use of the Project Meridian electronic data capture tool identified 6 key design requirements for multisite data collection, including the need for the following: (1) scalability irrespective of the type of participant; (2) a common data set across sites; (3) automated back end administrative capability (eg, reminders and a self-service status board); (4) multimedia communication pathways (eg, email and SMS text messaging); (5) interoperability and integration with local site information technology infrastructure; and (6) natural language processing to extract nondiscrete data elements.ConclusionsThe use of the electronic data capture tool in multiple multisite Discovery PREP clinical studies proved the feasibility of using the novel, cloud-based platform in practice. The lessons learned from this effort can be used to inform the improvement of ongoing global multisite data collection efforts during the COVID-19 pandemic and transform current manual data abstraction approaches into reliable, real time, and automated information exchange. Future research is needed to expand the ability to perform automated multisite data extraction during a PHE and beyond.

Project description:BackgroundDelivery of major trauma care is complex and often fast paced. Clear and comprehensive documentation is paramount to support effective communication during complex clinical care episodes, and to allow collection of data for audit, research and continuous improvement. Clinical events are typically recorded on paper-based records that are developed for individual centres or systems. As one of the priorities laid out by the Scottish Trauma Network project was to develop an electronic data collection system, the TraumaApp was created as a data collection tool for major trauma that could be adopted worldwide.MethodsThe study was performed as a service evaluation based at the Queen Elizabeth University Hospital Emergency Department. Fifty staff members were recruited in pairs and listened to five paired major trauma standby and handover recordings. Participants were randomised to input data to the TraumaApp and one into the existing paper proforma. The time taken to input data add into was measured, along with time for clarifications and any errors made. Those using the app completed a System Usability Score.ResultsNo statistically significant difference was demonstrated between times taken for data entry for the digital and paper documentation, apart from the Case 5 Handover (p < 0.05). Case 1 showed a significantly higher time for clarifications and number of errors with digital data collection (p = 0.01 and p = 1.79E-05 respectively). There were no other differences between data for the app and the proforma. The mean System Usability score for this cohort was 75 out of 100, with a standard deviation of 17 (rounded to nearest integer).ConclusionDigital real-time recording of clinical events using a tool such as the TraumaApp is comparable to completion of paper proforma. The System Usability Score for the TraumaApp was above the internationally validated standard of acceptable usability. There was no evidence of improvement in use over time or familiarity, most likely due to the brevity of the assessments and the refined user interface. This would benefit from further research, exploring data completeness and a potential mixed methods approach to explore training requirements for use of the TraumaApp.

Project description:BackgroundContinuous in-home monitoring of older adults can provide rich and sensitive data capturing subtle behavioral and cognitive changes. Our previous work has identified multiple metrics that describe meaningful trends in daily activities over time. The continuous, multidomain nature of this technology may also serve to inform caregivers of the need for higher levels of care to maintain the health and safety of at-risk older adults. Accordingly, care decisions can be based on objective, systematically assessed real-time data.ObjectiveThis study deployed a suite of in-home monitoring technologies to detect changing levels of care needs in residents of independent living units in 7 retirement communities and to assess the efficacy of computer-based tools in informing decisions regarding care transitions.MethodsContinuous activity data were presented via an interactive, web-based tool to the staff identified in each facility who were involved in decisions regarding transitions in care among residents. Comparisons were planned between outcomes for residents whose data were shared and those whose data were not made available to the staff. Staff use of the data dashboard was monitored throughout the study, and exit interviews with the staff were conducted to explicate staff interaction with the data platform. Residents were sent weekly self-report questionnaires to document any health- or care-related changes.ResultsDuring the study period, 30 of the 95 residents (32%) reported at least one incidence of new or increased provision of care; 6 residents made a permanent move to a higher level of care within their communities. Despite initial enthusiasm and an iterative process of refinement of measures and modes of data presentation based on staff input, actual inspection and therefore the use of resident data were well below expectation. In total, 11 of the 25 staff participants (44%) logged in to the activity dashboard throughout the study. Survey data and in-depth interviews provided insight into the mismatch between intended and actual use.ConclusionsMost continuous in-home monitoring technology acceptance models focus on perceived usefulness and ease of use and equate the intent to use technology with actual use. Our experience suggests otherwise. We found that multiple intervening variables exist between perceived usefulness, intent to use, and actual use. Ethical, institutional, and social factors are considered in their roles as determinants of use.

Project description:BackgroundThe Smart Angel home medical device allows ambulatory surgery patients to monitor their own health by taking their blood pressure and oxygen levels and answering a health questionnaire from home. Currently, this device is a prototype in the design phase, and no usability evaluation has been performed. This preventive device must be usable by patients with different profiles; however, it is important to select patients carefully to ensure their safety when using the device. As such, it would be interesting to know how to select or exclude patients. However, the links between user characteristics and the usability of this home medical device remain unclear.ObjectiveThis study aims to better understand the links between certain characteristics of potential patients (ie, age, education, technophilia, and health literacy) and the usability (ie, effectiveness, efficiency, and satisfaction) of Smart Angel, as defined by the ISO 9241-11.MethodsWe conducted an experimental study involving 36 participants investigating the effects of 4 patient characteristics (ie, age, education, technophilia, and health literacy) on usability, measured in terms of effectiveness, efficiency, and satisfaction. A mixed methods approach (subjective vs objective) using a variety of standard instruments was adopted (direct observation, video analysis, and questionnaires). First, to help participants project themselves into the real use of the Smart Angel device, they watched a scenario in a video. Second, the participants completed a set of questionnaires to show the extent of their health literacy level (Newest Vital Sign [NVS] and the Health Literacy Survey [HLS]) and then operated Smart Angel devices. Efficiency (ie, handling time) and effectiveness (ie, number of handling errors) measures were collected by video analysis. Satisfaction measures were collected by a questionnaire (System Usability Scale [SUS]). The qualitative observational data were coded using inductive analysis by 2 independent researchers specialized in cognitive psychology and cognitive ergonomics.ResultsThe results show a moderate and positive correlation between age and effectiveness (r=0.359; P=.03) and efficiency (r=0.357; P=.03). There is strong correlation between health literacy scored by the NVS and effectiveness (r=0.417; P=.01), efficiency (r=-0.38; P=.02), and satisfaction (r=0.45; P=.006). However, there is a weak correlation between technophilia and usability and no relationship between education level and usability.ConclusionsOur results show that literacy level and age are 2 important factors to consider when selecting future users of the Smart Angel device to ensure patient safety. This study also serves as an example promoting mixed methodologies in assessments of medical device usability that cannot be performed under real-world conditions.

Project description:Many research domains still heavily rely on paper-based data collection procedures, despite numerous associated drawbacks. The QuestionSys framework is intended to empower researchers as well as clinicians without programming skills to develop their own smart mobile apps in order to collect data for their specific scenarios.In order to validate the feasibility of this model-driven, end-user programming approach, we conducted a study with 80 participants.Across 2 sessions (7 days between Session 1 and Session 2), participants had to model 10 data collection instruments (5 at each session) with the developed configurator component of the framework. In this context, performance measures like the time and operations needed as well as the resulting errors were evaluated. Participants were separated into two groups (ie, novices vs experts) based on prior knowledge in process modeling, which is one fundamental pillar of the QuestionSys framework.Statistical analysis (t tests) revealed that novices showed significant learning effects for errors (P=.04), operations (P<.001), and time (P<.001) from the first to the last use of the configurator. Experts showed significant learning effects for operations (P=.001) and time (P<.001), but not for errors as the experts' errors were already very low at the first modeling of the data collection instrument. Moreover, regarding the time and operations needed, novices got significantly better at the third modeling task than experts were at the first one (t tests; P<.001 for time and P=.002 for operations). Regarding errors, novices did not get significantly better at working with any of the 10 data collection instruments than experts were at the first modeling task, but novices' error rates for all 5 data collection instruments at Session 2 were not significantly different anymore from those of experts at the first modeling task. After 7 days of not using the configurator (from Session 1 to Session 2), the experts' learning effect at the end of Session 1 remained stable at the beginning of Session 2, but the novices' learning effect at the end of Session 1 showed a significant decay at the beginning of Session 2 regarding time and operations (t tests; P<.001 for time and P=.03 for operations).In conclusion, novices were able to use the configurator properly and showed fast (but unstable) learning effects, resulting in their performances becoming as good as those of experts (which were already good) after having little experience with the configurator. Following this, researchers and clinicians can use the QuestionSys configurator to develop data collection apps for smart mobile devices on their own.

Project description:BackgroundReadily available testing for SARS-CoV-2 is necessary to mitigate COVID-19 disease outbreaks. At-home collection kits, in which samples are self-collected without requiring a laboratory or clinic visit and sent to an external laboratory for testing, can provide convenient testing to those with barriers to access. They can prevent unnecessary exposure between patient and clinical staff, increase access for patients with disabilities or remote workers, and decrease burdens on health care resources, such as provider time and personal protective equipment. Exact Sciences developed an at-home collection kit for samples to be tested to detect SARS-CoV-2 that includes an Instructions for Use (IFU) document, which guides people without prior experience on collecting a nasal swab sample. Demonstrating successful sample collection and usability is critical to ensure that these samples meet the same high-quality sample collection standards as samples collected in clinics.ObjectiveThe aim of this study was to determine the usability of a SARS-CoV-2 at-home nasal swab sample collection kit.MethodsA human factors usability study was conducted with 30 subjects without prior medical, laboratory, or health care training and without COVID-19 sample self-collection experience. Subjects were observed while they followed the IFU for the at-home sample collection portion of the SARS-CoV-2 test in a setting that simulated a home environment. IFU usability was further evaluated by requiring the subjects to complete a survey, answer comprehension questions, provide written feedback, and respond to questions from the observer about problems during use.ResultsAll 30 subjects successfully completed the sample collection process, and all 30 samples were determined by reverse transcription-polymerase chain reaction (RT-PCR) testing to meet quality standards for SARS-CoV-2 testing. The subjects' written feedback and comments revealed several recommendations to improve the IFU.ConclusionsThe study demonstrated the overall usability of an at-home SARS-CoV-2 collection kit. Various feedback mechanisms provided opportunities to improve the wording and graphics for some critical tasks, including placing the label correctly on the tube. A modified IFU was prepared based on study outcomes.