Dataset Information

App Usage and Usability Impressions of a Barcode-Based Digital Contact Tracing Platform for COVID-19: Survey Study.

ABSTRACT:

Background

The novel coronavirus (COVID-19) has drastically changed life in the United States, as the country has recorded over 23 million cases and 383,000 deaths to date. In the lead-up to widespread vaccine deployment, testing and surveillance are critical for detecting and stopping possible routes of transmission. Contact tracing has become an important surveillance measure for COVID-19 control in the United States, and mobile health interventions have found increased prominence in this space.

Objective

The aim of this study was to investigate the use and usability of MyCOVIDKey, a mobile-based web application to assist COVID-19 contact tracing efforts during the 6-week pilot period.

Methods

A six-week study was conducted on the Vanderbilt University campus in Nashville, TN. The population, consisting primarily of graduate students, postdoctoral researchers, and faculty in the Chemistry Department at Vanderbilt University, was asked to use the MyCOVIDKey web application during the course of the study period. Paradata was collected as users engaged with the MyCOVIDKey web application. At the end of the study, all participants were asked to report on their user experience in a survey, and the results were analyzed in the context of the user paradata.

Results

MyCOVIDKey enrolled 45 users during the pilot period. An analysis of their enrollment suggests that initial recruiting efforts were effective, however participant recruitment and engagement efforts at the mid-point of the study were less effective. Application usage paralleled the number of users, indicating incentives were useful for recruiting new sign-ups, but did not result in users trying to artificially inflate their usage as a result of prize offers. Time-to-completion of key tasks were low, indicating that the main features of the application could be quickly used. Of the 45 users, 30 provided feedback through a post-pilot survey with 26 (58%) completing it in its entirety. The MyCOVIDKey app as a whole was rated 70.0 on the System Usability Scale, indicating that it performed above the accepted threshold for usability. When the key-in and self-assessment features were examined on their own, it was found that they individually crossed the same thresholds for acceptable usability, but that the key-in feature had a higher margin for improvements.

Conclusions

The MyCOVIDKey application was found overall to be a useful tool for COVID-19 contact tracing in a university setting. Most users suggested simple-to-implement improvements, such as replacing the web application framework with a native application format, or changing the placement of the scanner within the app workflow. After these updates, this tool could readily be deployed and could easily be adapted for other settings across the country. The need for digital contact tracing tools is becoming increasingly apparent, particularly as case numbers continue to increase while more businesses begin to re-open.

SUBMITTER: Scherr TF

PROVIDER: S-EPMC8006896 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe COVID-19 pandemic has forced drastic changes to daily life, from the implementation of stay-at-home orders to mandating facial coverings and limiting in-person gatherings. While the relaxation of these control measures has varied geographically, it is widely agreed that contact tracing efforts will play a major role in the successful reopening of businesses and schools. As the volume of positive cases has increased in the United States, it has become clear that there is room for digital health interventions to assist in contact tracing.ObjectiveThe goal of this study was to evaluate the use of a mobile-friendly app designed to supplement manual COVID-19 contact tracing efforts on a university campus. Here, we present the results of a development and validation study centered around the use of the MyCOVIDKey app on the Vanderbilt University campus during the summer of 2020.MethodsWe performed a 6-week pilot study in the Stevenson Center Science and Engineering Complex on Vanderbilt University's campus in Nashville, TN. Graduate students, postdoctoral fellows, faculty, and staff >18 years who worked in Stevenson Center and had access to a mobile phone were eligible to register for a MyCOVIDKey account. All users were encouraged to complete regular self-assessments of COVID-19 risk and to key in to sites by scanning a location-specific barcode.ResultsBetween June 17, 2020, and July 29, 2020, 45 unique participants created MyCOVIDKey accounts. These users performed 227 self-assessments and 1410 key-ins. Self-assessments were performed by 89% (n=40) of users, 71% (n=32) of users keyed in, and 48 unique locations (of 71 possible locations) were visited. Overall, 89% (202/227) of assessments were determined to be low risk (ie, asymptomatic with no known exposures), and these assessments yielded a CLEAR status. The remaining self-assessments received a status of NOT CLEAR, indicating either risk of exposure or symptoms suggestive of COVID-19 (7.5% [n=17] and 3.5% [n=8] of self-assessments indicated moderate and high risk, respectively). These 25 instances came from 8 unique users, and in 19 of these instances, the at-risk user keyed in to a location on campus.ConclusionsDigital contact tracing tools may be useful in assisting organizations to identify persons at risk of COVID-19 through contact tracing, or in locating places that may need to be cleaned or disinfected after being visited by an index case. Incentives to continue the use of such tools can improve uptake, and their continued usage increases utility to both organizational and public health efforts. Parameters of digital tools, including MyCOVIDKey, should ideally be optimized to supplement existing contact tracing efforts. These tools represent a critical addition to manual contact tracing efforts during reopening and sustained regular activity.

Project description:BackgroundAdoption and evaluation of contact tracing tools based on information and communications technology may expand the reach and efficacy of traditional contact tracing methods in fighting COVID-19. The Dutch Ministry of Health, Welfare and Sports initiated and developed CoronaMelder, a COVID-19 contact tracing app. This app is based on a Google/Apple Exposure Notification approach and aims to combat the spread of the coronavirus among individuals by notifying those who are at increased risk of infection due to proximity to someone who later tests positive for COVID-19. The app should support traditional contact tracing by faster tracing and greater reach compared to regular contact tracing procedures.ObjectiveThe main goal of this study is to investigate whether the CoronaMelder is able to support traditional contact tracing employed by public health authorities. To achieve this, usability tests were conducted to answer the following question: is the CoronaMelder user-friendly, understandable, reliable and credible, and inclusive?MethodsParticipants (N=44) of different backgrounds were recruited: youth with varying educational levels, youth with an intellectual disability, migrants, adults (aged 40-64 years), and older adults (aged >65 years) via convenience sampling in the region of Twente in the Netherlands. The app was evaluated with scenario-based, think-aloud usability tests and additional interviews. Findings were recorded via voice recordings, observation notes, and the Dutch User Experience Questionnaire, and some participants wore eye trackers to measure gaze behavior.ResultsOur results showed that the app is easy to use, although problems occurred with understandability and accessibility. Older adults and youth with a lower education level did not understand why or under what circumstances they would receive notifications, why they must share their key (ie, their assigned identifier), and what happens after sharing. In particular, youth in the lower-education category did not trust or understand Bluetooth signals, or comprehend timing and follow-up activities after a risk exposure notification. Older adults had difficulties multitasking (speaking with a public health worker and simultaneously sharing the key in the app). Public health authorities appeared to be unprepared to receive support from the app during traditional contact tracing because their telephone conversation protocol lacks guidance, explanation, and empathy.ConclusionsThe study indicated that the CoronaMelder app is easy to use, but participants experienced misunderstandings about its functioning. The perceived lack of clarity led to misconceptions about the app, mostly regarding its usefulness and privacy-preserving mechanisms. Tailored and targeted communication through, for example, public campaigns or social media, is necessary to provide correct information about the app to residents in the Netherlands. Additionally, the app should be presented as part of the national coronavirus measures instead of as a stand-alone app offered to the public. Public health workers should be trained to effectively and empathetically instruct users on how to use the CoronaMelder app.

Project description:BackgroundMitigation of the spread of infection relies on targeted approaches aimed at preventing nonhousehold interactions. Contact tracing in the form of digital proximity tracing apps has been widely adopted in multiple countries due to its perceived added benefits of tracing speed and breadth in comparison to traditional manual contact tracing. Assessments of user responses to exposure notifications through a guided approach can provide insights into the effect of digital proximity tracing app use on managing the spread of SARS-CoV-2.ObjectiveThe aim of this study was to demonstrate the use of Venn diagrams to investigate the contributions of digital proximity tracing app exposure notifications and subsequent mitigative actions in curbing the spread of SARS-CoV-2 in Switzerland.MethodsWe assessed data from 4 survey waves (December 2020 to March 2021) from a nationwide panel study (COVID-19 Social Monitor) of Swiss residents who were (1) nonusers of the SwissCovid app, (2) users of the SwissCovid app, or (3) users of the SwissCovid app who received exposure notifications. A Venn diagram approach was applied to describe the overlap or nonoverlap of these subpopulations and to assess digital proximity tracing app use and its associated key performance indicators, including actions taken to prevent SARS-CoV-2 transmission.ResultsWe included 12,525 assessments from 2403 participants, of whom 50.9% (1222/2403) reported not using the SwissCovid digital proximity tracing app, 49.1% (1181/2403) reported using the SwissCovid digital proximity tracing app and 2.5% (29/1181) of the digital proximity tracing app users reported having received an exposure notification. Most digital proximity tracing app users (75.9%, 22/29) revealed taking at least one recommended action after receiving an exposure notification, such as seeking SARS-CoV-2 testing (17/29, 58.6%) or calling a federal information hotline (7/29, 24.1%). An assessment of key indicators of mitigative actions through a Venn diagram approach reveals that 30% of digital proximity tracing app users (95% CI 11.9%-54.3%) also tested positive for SARS-CoV-2 after having received exposure notifications, which is more than 3 times that of digital proximity tracing app users who did not receive exposure notifications (8%, 95% CI 5%-11.9%).ConclusionsResponses in the form of mitigative actions taken by 3 out of 4 individuals who received exposure notifications reveal a possible contribution of digital proximity tracing apps in mitigating the spread of SARS-CoV-2. The application of a Venn diagram approach demonstrates its value as a foundation for researchers and health authorities to assess population-level digital proximity tracing app effectiveness by providing an intuitive approach for calculating key performance indicators.

Project description:BackgroundThe COVID-19 pandemic is the greatest public health crisis of the last 100 years. Countries have responded with various levels of lockdown to save lives and stop health systems from being overwhelmed. At the same time, lockdowns entail large socioeconomic costs. One exit strategy under consideration is a mobile phone app that traces the close contacts of those infected with COVID-19. Recent research has demonstrated the theoretical effectiveness of this solution in different disease settings. However, concerns have been raised about such apps because of the potential privacy implications. This could limit the acceptability of app-based contact tracing in the general population. As the effectiveness of this approach increases strongly with app uptake, it is crucial to understand public support for this intervention.ObjectiveThe objective of this study is to investigate the user acceptability of a contact-tracing app in five countries hit by the pandemic.MethodsWe conducted a largescale, multicountry study (N=5995) to measure public support for the digital contact tracing of COVID-19 infections. We ran anonymous online surveys in France, Germany, Italy, the United Kingdom, and the United States. We measured intentions to use a contact-tracing app across different installation regimes (voluntary installation vs automatic installation by mobile phone providers) and studied how these intentions vary across individuals and countries.ResultsWe found strong support for the app under both regimes, in all countries, across all subgroups of the population, and irrespective of regional-level COVID-19 mortality rates. We investigated the main factors that may hinder or facilitate uptake and found that concerns about cybersecurity and privacy, together with a lack of trust in the government, are the main barriers to adoption.ConclusionsEpidemiological evidence shows that app-based contact tracing can suppress the spread of COVID-19 if a high enough proportion of the population uses the app and that it can still reduce the number of infections if uptake is moderate. Our findings show that the willingness to install the app is very high. The available evidence suggests that app-based contact tracing may be a viable approach to control the diffusion of COVID-19.

Project description:BackgroundMany countries remain in the grip of the COVID-19 global pandemic, with a considerable journey still ahead toward normalcy and free mobility. Contact tracing smartphone apps are among a raft of measures introduced to reduce spread of the virus, but their uptake depends on public choice.ObjectiveThe objective of this study was to ascertain the views of citizens in Wales on their intended use of a COVID-19 contact tracing smartphone app, including self-proposed reasons for or against use and what could lead to a change of decision.MethodsWe distributed an anonymous survey among 4000 HealthWise Wales participants in May 2020. We adopted a mixed methods approach: responses to closed questions were analyzed using descriptive and inferential statistics; open question responses were analyzed and grouped into categories.ResultsA total of 976 (24.4%) people completed the survey. Smartphone usage was 91.5% overall, but this varied among age groups. In total, 97.1% were aware of contact tracing apps, but only 67.2% felt sufficiently informed. Furthermore, 55.7% intended to use an app, 23.3% refused, and 21.0% were unsure. The top reasons for app use were as follows: controlling the spread of the virus, mitigating risks for others and for oneself, and increasing freedoms. The top reasons against app use were as follows: mistrusting the government, concerns about data security and privacy, and doubts about efficacy. The top response for changing one's mind about app use from being willing to being unwilling was that nothing would; that is, they felt that nothing would cause them to become unwilling to use a contact tracing app. This was also the top response for changing one's mind from being unwilling to being willing to use contact tracing apps. Among those who were unsure of using contact tracing apps, the top response was the need for more information.ConclusionsRespondents demonstrated a keenness to help themselves, others, society, and the government to avoid contracting the virus and to control its spread. However, digital inclusion varied among age groups, precluding participation for some people. Nonetheless, unwillingness was significant, and considering the nature of the concerns raised and the perceived lack of information, policy and decision-makers need to do more to act openly, increase communication, and demonstrate trustworthiness if members of the public are to be confident in using an app.

Project description:BackgroundDigital proximity-tracing apps have been deployed in multiple countries to assist with SARS-CoV-2 pandemic mitigation efforts. However, it is unclear how their performance and effectiveness were affected by changing pandemic contexts and new viral variants of concern.ObjectiveThe aim of this study is to bridge these knowledge gaps through a countrywide digital proximity-tracing app effectiveness assessment, as guided by the World Health Organization/European Center for Prevention and Disease Control (WHO/ECDC) indicator framework to evaluate the public health effectiveness of digital proximity-tracing solutions.MethodsWe performed a descriptive analysis of the digital proximity-tracing app SwissCovid in Switzerland for 3 different periods where different SARS-CoV-2 variants of concern (ie, Alpha, Delta, and Omicron, respectively) were most prevalent. In our study, we refer to the indicator framework for the evaluation of public health effectiveness of digital proximity-tracing apps of the WHO/ECDC. We applied this framework to compare the performance and effectiveness indicators of the SwissCovid app.ResultsAverage daily registered SARS-CoV-2 case rates during our assessment period from January 25, 2021, to March 19, 2022, were 20 (Alpha), 54 (Delta), and 350 (Omicron) per 100,000 inhabitants. The percentages of overall entered authentication codes from positive tests into the SwissCovid app were 9.9% (20,273/204,741), 3.9% (14,372/365,846), and 4.6% (72,324/1,581,506) during the Alpha, Delta, and Omicron variant phases, respectively. Following receipt of an exposure notification from the SwissCovid app, 58% (37/64, Alpha), 44% (7/16, Delta), and 73% (27/37, Omicron) of app users sought testing or performed self-tests. Test positivity among these exposure-notified individuals was 19% (7/37) in the Alpha variant phase, 29% (2/7) in the Delta variant phase, and 41% (11/27) in the Omicron variant phase compared to 6.1% (228,103/3,755,205), 12% (413,685/3,443,364), and 41.7% (1,784,951/4,285,549) in the general population, respectively. In addition, 31% (20/64, Alpha), 19% (3/16, Delta), and 30% (11/37, Omicron) of exposure-notified app users reported receiving mandatory quarantine orders by manual contact tracing or through a recommendation by a health care professional.ConclusionsIn constantly evolving pandemic contexts, the effectiveness of digital proximity-tracing apps in contributing to mitigating pandemic spread should be reviewed regularly and adapted based on changing requirements. The WHO/ECDC framework allowed us to assess relevant domains of digital proximity tracing in a holistic and systematic approach. Although the Swisscovid app mostly worked, as reasonably expected, our analysis revealed room for optimizations and further performance improvements. Future implementation of digital proximity-tracing apps should place more emphasis on social, psychological, and organizational aspects to reduce bottlenecks and facilitate their use in pandemic contexts.