Methods for Authenticating Participants in Fully Web-Based Mobile App Trials from the iReach Project: Cross-sectional Study.
Ontology highlight
ABSTRACT: Background
Mobile health apps are important interventions that increase the scale and reach of prevention services, including HIV testing and prevention counseling, pre-exposure prophylaxis, condom distribution, and education, of which all are required to decrease HIV incidence rates. The use of these web-based apps as well as fully web-based intervention trials can be challenged by the need to remove fraudulent or duplicate entries and authenticate unique trial participants before randomization to protect the integrity of the sample and trial results. It is critical to ensure that the data collected through this modality are valid and reliable.Objective
The aim of this study is to discuss the electronic and manual authentication strategies for the iReach randomized controlled trial that were used to monitor and prevent fraudulent enrollment.Methods
iReach is a randomized controlled trial that focused on same-sex attracted, cisgender males (people assigned male at birth who identify as men) aged 13-18 years in the United States and on enrolling people of color and those in rural communities. The data were evaluated by identifying possible duplications in enrollment, identifying potentially fraudulent or ineligible participants through inconsistencies in the data collected at screening and survey data, and reviewing baseline completion times to avoid enrolling bots and those who did not complete the baseline questionnaire. Electronic systems flagged questionable enrollment. Additional manual reviews included the verification of age, IP addresses, email addresses, social media accounts, and completion times for surveys.Results
The electronic and manual strategies, including the integration of social media profiles, resulted in the identification and prevention of 624 cases of potential fraudulent, duplicative, or ineligible enrollment. A total of 79% (493/624) of the potentially fraudulent or ineligible cases were identified through electronic strategies, thereby reducing the burden of manual authentication for most cases. A case study with a scenario, resolution, and authentication strategy response was included.Conclusions
As web-based trials are becoming more common, methods for handling suspicious enrollments that compromise data quality have become increasingly important for inclusion in protocols.International registered report identifier (irrid)
RR2-10.2196/10174.
SUBMITTER: Guest JL
PROVIDER: S-EPMC8441600 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Nonspecific low back pain (NLBP) is the diagnosis for individuals with back pain that has no underlying medical cause (eg, tumor, infection, fracture, herniated disc, spinal stenosis). The American College of Physicians (ACP) and American Pain Society (APS) recommend multidisciplinary treatments for NLBP that lasts more than 4 weeks. This approach, however, is impractical for many physicians to implement, and relatively few providers offer NLBP treatment that meets the joint ACP-APS guidelines.This study evaluated the efficacy of a mobile-Web intervention called "FitBack" to help users implement self-tailored strategies to manage and prevent NLBP occurrences.A total of 597 adults were recruited, screened, consented, and assessed online at baseline, at 2 months (T2), and at 4 months (T3). After baseline assessments, participants were randomized into three groups: FitBack intervention, alternative care group that received 8 emails urging participants to link to six Internet resources for NLBP, and control group. The FitBack group also received weekly email reminder prompts for 8 weeks plus emails to do assessments. The control group was only contacted to do assessments.Users of the FitBack program showed greater improvement compared to the control group in every comparison of the critical physical, behavioral, and worksite outcome measures at 4-month follow-up. In addition, users of the FitBack program performed better than the alternative care group on current back pain, behavioral, and worksite outcomes at 4-month follow-up. For example, subjects in the control group were 1.7 times more likely to report current back pain than subjects in the FitBack group; subjects in the alternative care group were 1.6 times more likely to report current back pain at 4-month follow-up. Further, the users of the FitBack program showed greater improvement compared to both the control and alternative care groups at 4-month follow-up on patient activation, constructs of the Theory of Planned Behavior, and attitudes toward pain.This research demonstrated that a theoretically based stand-alone mobile-Web intervention that tailors content to users' preferences and interests can be an effective tool in self-management of low back pain. When viewed from the RE-AIM perspective (ie, reach, efficacy/effectiveness, adoption, implementation fidelity, and maintenance), this study supports the notion that there is considerable value in this type of intervention as a potentially cost-effective tool that can reach large numbers of people. The results are promising considering that the FitBack intervention was neither supported by professional caregivers nor integrated within a health promotion campaign, which might have provided additional support for participants. Still, more research is needed on how self-guided mobile-Web interventions will be used over time and to understand factors associated with continuing user engagement.Clinicaltrials.gov NCT01950091; http://clinicaltrials.gov/ct2/show/NCT01950091 (Archived by WebCite at http://www.webcitation.org/6TwZucX77).
| S-EPMC4296097 | biostudies-literature
Project description:Numerous therapeutic peptides do not enter the clinical trials just because of their high hemolytic activity. Recently, we developed a database, Hemolytik, for maintaining experimentally validated hemolytic and non-hemolytic peptides. The present study describes a web server and mobile app developed for predicting, and screening of peptides having hemolytic potency. Firstly, we generated a dataset HemoPI-1 that contains 552 hemolytic peptides extracted from Hemolytik database and 552 random non-hemolytic peptides (from Swiss-Prot). The sequence analysis of these peptides revealed that certain residues (e.g., L, K, F, W) and motifs (e.g., "FKK", "LKL", "KKLL", "KWK", "VLK", "CYCR", "CRR", "RFC", "RRR", "LKKL") are more abundant in hemolytic peptides. Therefore, we developed models for discriminating hemolytic and non-hemolytic peptides using various machine learning techniques and achieved more than 95% accuracy. We also developed models for discriminating peptides having high and low hemolytic potential on different datasets called HemoPI-2 and HemoPI-3. In order to serve the scientific community, we developed a web server, mobile app and JAVA-based standalone software (http://crdd.osdd.net/raghava/hemopi/).
| S-EPMC4782144 | biostudies-literature
Project description:Objective:To compare the accuracy of cephalometric analyses made with fully automated tracings, computerized tracing, and app-aided tracings with equivalent hand-traced measurements, and to evaluate the tracing time for each cephalometric analysis method. Methods:Pre-treatment lateral cephalometric radiographs of 40 patients were randomly selected. Eight angular and 4 linear parameters were measured by 1 operator using 3 methods: computerized tracing with software Dolphin Imaging 13.01(Dolphin Imaging and Management Solutions, Chatsworth, Calif, USA), app-aided tracing using the CephNinja 3.51 app (Cyncronus LLC, WA, USA), and web-based fully automated tracing with CephX (ORCA Dental AI, Las Vegas, NV). Correction of CephX landmarks was also made. Manual tracings were performed by 3 operators. Remeasurement of 15 radiographs was carried out to determine the intra-examiner and inter-examiner (manual tracings) correlation coefficient (ICC). Inter-group comparisons were made with one-way analysis of variance. The Tukey test was used for post hoc testing. Results:Overall, greater variability was found with CephX compared with the other methods. Differences in GoGn-SN (°), I-NA (°), I-NB (°), I-NA (mm), and I-NB (mm) were statistically (p<0.05) and clinically significant using CephX, whereas CephNinja and Dolphin were comparable to manual tracings. Correction of CephX landmarks gave similar results to CephNinja and Dolphin. All the ICCs exceeded 0.85, except for I-NA (°), I-NB (°), and I-NB (mm), which were traced with CephX. The shortest analyzing time was obtained with CephX. Conclusion:Fully automatic analysis with CephX needs to be more reliable. However, CephX analysis with manual correction is promising for use in clinical practice because it is comparable to CephNinja and Dolphin, and the analyzing time is significantly shorter.
| S-EPMC7491969 | biostudies-literature
Project description:Adolescence can be a fertile time for relationship issues, with interpersonal conflict being a risk factor for poor mental health. Mobile app interventions may have a significant appeal to young people in assisting with relationship distress. However, currently available apps have not been formally evaluated. Youths' perspectives on engaging with mobile technology to assist with relationships are also unknown.This study aimed to examine adolescents' attitudes toward the concept of a mobile phone app for relationship help and support, and whether they would be likely to use such an intervention.A cross-sectional Web survey consisting of 42 questions, including 13 free responses, was delivered. The proposed app, including character vignettes, was presented, and participants were asked to indicate whether they had experienced the same relationship issues, whether their peers would relate to the issues, and how helpful they found the proposed advice. Participants were also asked to provide their own suggestions for help, which were analyzed using thematic analyses.A total of 150 adolescents (aged 15 to 18) participated. Overall, 60.7% (91/150) were likely to use an app for relationship problems, and this was not associated with demographics or social support (all P values >.05). Likelihood of app usage was found to be influenced by perceived need for help, personal beliefs about app effectiveness, and whether the app is engaging and easy to use. Overall, adolescents were receptive of the proposed content with an average of 99.3% (149/150), rating the strategies provided as somewhat to very helpful.Adolescents were likely to use a mobile phone app for relationship support, and use was not influenced by gender, age, social support, or any other background characteristic. Instead, likely use was influenced by need, personal beliefs, usability, and the appropriateness of app content. App developers must address these factors if the app is to have a wide-scale uptake.
| S-EPMC5865001 | biostudies-literature
Project description:ObjectiveThis study provides a preliminary evaluation of the usability and acceptability of a mobile application (sexual assault care algorithm, SACA).MethodsAn explanatory sequential mixed methods research was used. A quantitative survey was followed up by a qualitative study. A convenience sample of participants (n = 4) was recruited. The research was conducted on a one-on-one basis. In the quantitative phase, a random assignment technique was used to divide four participants into two groups of two participants each. Post-Study System Usability Questionnaire(PSSUQ) and Acceptability e-Scale were used to collect quantitative data. In the qualitative phase, interview, observation, and documentation were used to collect qualitative data. Data were analyzed both quantitative and qualitatively. The qualitative data were linked with the initial quantitative data to determine how the follow-up qualitative data helped explain the initial quantitative results.ResultsThe quantitative results suggested that SACA has high usability (5.05 ± 1.83) and acceptability (3.81 ± 1.22). The qualitative results further indicate that the participants thought SACA was easy to use and useful, and most of them would recommend it to others. Areas of improvement include adding features that would calculate and validate the elapsed time since the sexual assault, adding explanations to some buttons, and providing training.ConclusionsOur findings highlight the value of using a mixed methods research design to conduct a usability and acceptability test. Nurses are more likely to adopt a new technology for their evidence-based practice when the technology is easy to use and useful and requires less time to find the right piece of guideline evidence. Individualized training needs to be designed based on users' characteristics.
| S-EPMC7424146 | biostudies-literature
Project description:ObjectivesTo investigate the feasibility of the be.well app and its personalization approach which regularly considers users' preferences, amongst university students.MethodsWe conducted a mixed-methods, pre-post experiment, where participants used the app for 2 months. Eligibility criteria included: age 18-34 years; owning an iPhone with Internet access; and fluency in English. Usability was assessed by a validated questionnaire; engagement metrics were reported. Changes in physical activity were assessed by comparing the difference in daily step count between baseline and 2 months. Interviews were conducted to assess acceptability; thematic analysis was conducted.ResultsTwenty-three participants were enrolled in the study (mean age = 21.9 years, 71.4% women). The mean usability score was 5.6 ± 0.8 out of 7. The median daily engagement time was 2 minutes. Eighteen out of 23 participants used the app in the last month of the study. Qualitative data revealed that people liked the personalized activity suggestion feature as it was actionable and promoted user autonomy. Some users also expressed privacy concerns if they had to provide a lot of personal data to receive highly personalized features. Daily step count increased after 2 months of the intervention (median difference = 1953 steps/day, p-value <.001, 95% CI 782 to 3112).ConclusionsIncorporating users' preferences in personalized advice provided by a physical activity app was considered feasible and acceptable, with preliminary support for its positive effects on daily step count. Future randomized studies with longer follow up are warranted to determine the effectiveness of personalized mobile apps in promoting physical activity.
| S-EPMC9309778 | biostudies-literature
Project description:BackgroundMobile eHealth apps are important tools in personal health care management. The Patient Journey app was developed to inform patients with musculoskeletal disorders during their perioperative period. The app contains timely information, video exercises, and functional tasks. Although the Patient Journey app and other health apps are widely used, little research is available on how patients appreciate these apps.ObjectiveThe primary aim of this study was to evaluate the user-friendliness of the Patient Journey app in terms of its usability and the attitudes of users toward the app. The secondary aim was to evaluate positive and negative user experiences.MethodsA web-based questionnaire was sent to 2114 patients scheduled for surgery for a musculoskeletal disorder. Primary outcomes were usability (measured with the System Usability Scale) and user attitudes regarding the Patient Journey app (assessed with the second part of the eHealth Impact Questionnaire). The secondary outcomes were evaluated with multiple choice questions and open-ended questions, which were analyzed via inductive thematic content analyses.ResultsOf the 940 patients who responded, 526 used the Patient Journey app. The usability of the app was high (System Usability Scale: median 85.0, IQR 72.5-92.5), and users had a positive attitude toward the Information and Presentation provided via the app (eHealth Impact Questionnaire: median 78.0, IQR 68.8-84.4). The app did not adequately improve the users' confidence in discussing health with others (eHealth Impact Questionnaire: median 63.9, IQR 50.0-75.0) or motivation to manage health (eHealth Impact Questionnaire: median 61.1, IQR 55.6-72.2). Three core themes emerged regarding positive and negative user experiences: (1) content and information, (2) expectations and experiences, and (3) technical performance. Users experienced timely information and instructions positively and found that the app prepared and guided them optimally through the perioperative period. Negative user experiences were overly optimistic information, scarcely presented information about pain (medication), lack of reference data, insufficient information regarding clinical course deviations and complications, and lack of interaction with clinicians.ConclusionsThe Patient Journey app is a usable, informative, and presentable tool to inform patients with musculoskeletal disorders during their perioperative period. The qualitative analyses identified aspects that can further improve the user experiences of the app.
| S-EPMC7899805 | biostudies-literature
Project description:IntroductionIn-person dermatology clinical research studies often face recruitment and participation challenges due to travel-, time-, and cost-associated barriers. Studies incorporating virtual/asynchronous formats can potentially enhance research subject participation and satisfaction, but few mobile health tools are available to enable remote study conduct. We developed SkinTracker, a patient-facing mobile app and researcher-facing web platform, that enables longitudinal collection of skin photos, patient reported outcomes, and biometric health and environmental data.MethodsEight design thinking sessions including dermatologists, clinical research staff, software engineers, and graphic designers were held to create the components of SkinTracker. Following iterative prototyping, SkinTracker was piloted across six adult and four pediatric subjects with atopic dermatitis (AD) of varying severity levels to test and provide feedback on SkinTracker for six months.ResultsThe SkinTracker app enables collection of informed consent for study participation, baseline medical history, standardized skin photographs, patient-reported outcomes (e.g., Patient Oriented Eczema Measure (POEM), Pruritus Numerical Rating Scale (NRS), Dermatology Life Quality Index (DLQI)), medication use, adverse events, voice diary to document qualitative experiences, chat function for communication with research team, environmental and biometric data such as exercise and sleep metrics through integration with an Apple Watch. The researcher web portal allows for management and visualization of subject enrollment, skin photographs for examination and severity scoring, survey completion, and other patient modules. The pilot study requested that subjects complete surveys and photographs on a weekly to monthly basis via the SkinTracker app. Afterwards, participants rated their experience in a 7-item user experience survey covering app function, design, and desire for participation in future studies using SkinTracker. Almost all subjects agreed or strongly agreed that SkinTracker enabled more convenient participation in skin research studies compared to an in-person format.DiscussionTo our knowledge, SkinTracker is one of the first integrated app- and web-based platforms allowing collection and management of data commonly obtained in clinical research studies. SkinTracker enables detailed, frequent capture of data that may better reflect the fluctuating course of conditions such as AD, and can be modularly customized for different skin conditions to improve dermatologic research participation and patient access.
| S-EPMC10516539 | biostudies-literature
Project description:BackgroundReporting of medication errors is one of the essential mechanisms to identify risky health care systems and practices that lead to medication errors. Unreported medication errors are a real issue; one of the identified causes is a burdensome medication error reporting system. An anonymous and user-friendly mobile app for reporting medication errors could be an alternative method of reporting medication error in busy health care settings.ObjectiveThe objective of this paper is to report usability testing of the Medication Error Reporting App (MERA), a mobile app for reporting medication errors anonymously.MethodsQuantitative and qualitative methods were employed involving 45 different testers (pharmacists, doctors, and nurses) from a large tertiary hospital in Malaysia. Quantitative data was retrieved using task performance and rating of MERA and qualitative data were retrieved through focus group discussions. Three sessions, with 15 testers each session, were conducted from January to March 2018.ResultsThe majority of testers were pharmacists (23/45, 51%), female (35/45, 78%), and the mean age was 36 (SD 9) years. A total of 135 complete reports were successfully submitted by the testers (three reports per tester) and 79.2% (107/135) of the reports were correct. There was significant improvement in mean System Usability Scale scores in each session of the development process (P<.001) and mean time to report medication errors using the app was not significantly different between each session (P=.70) with an overall mean time of 6.7 (SD 2.4) minutes. Testers found the app easy to use, but doctors and nurses were unfamiliar with terms used especially medication process at which error occurred and type of error. Although, testers agreed the app can be used in the future for reporting, they were apprehensive about security, validation, and abuse of feedback featured in the app.ConclusionsMERA can be used to report medication errors easily by various health care personnel and it has the capacity to provide feedback on reporting. However, education on medication error reporting should be provided to doctors and nurses in Malaysia and the security of the app needs to be established to boost reporting by this method.
| S-EPMC6320434 | biostudies-literature
Project description:BackgroundA diet high in fermentable, oligo-, di-, monosaccharides and polyols (FODMAPs) has been shown to exacerbate symptoms of irritable bowel syndrome (IBS). Previous literature reports significant improvement in IBS symptoms with initiation of a low FODMAP diet (LFD) and monitored reintroduction. However, dietary adherence to the LFD is difficult, with patients stating that the information given by health care providers is often generalized and nonspecific, requiring them to search for supplementary information to fit their needs.ObjectiveThe aim of our study was to determine whether Heali, a novel artificial intelligence dietary mobile app can improve adherence to the LFD, IBS symptom severity, and quality of life outcomes in adults with IBS or IBS-like symptoms over a 4-week period.MethodsParticipants were randomized into 2 groups: the control group (CON), in which participants received educational materials, and the experimental group (APP), in which participants received access to the mobile app and educational materials. Over the course of this unblinded online trial, all participants completed a battery of 5 questionnaires at baseline and at the end of the trial to document IBS symptoms, quality of life, LFD knowledge, and LFD adherence.ResultsWe enrolled 58 participants in the study (29 in each group), and 25 participants completed the study in its entirety (11 and 14 for the CON and APP groups, respectively). Final, per-protocol analyses showed greater improvement in quality of life score for the APP group compared to the CON group (31.1 and 11.8, respectively; P=.04). Reduction in total IBS symptom severity score was 24% greater for the APP group versus the CON group. Although this did not achieve significance (-170 vs -138 respectively; P=.37), the reduction in the subscore for bowel habit dissatisfaction was 2-fold greater for the APP group than for the CON group (P=.05).ConclusionsThis initial study provides preliminary evidence that Heali may provide therapeutic benefit to its users, specifically improvements in quality of life and bowel habits. Although this study was underpowered, findings from this study warrant further research in a larger sample of participants to test the efficacy of Heali app use to improve outcomes for patients with IBS.Trial registrationClinicalTrials.gov NCT04256551; https://clinicaltrials.gov/ct2/show/NCT04256551.
| S-EPMC7967221 | biostudies-literature