Dataset Information

The Dutch COVID-19 Contact Tracing App (the CoronaMelder): Usability Study.

ABSTRACT:

Background

Adoption and evaluation of contact tracing tools based on information and communications technology may expand the reach and efficacy of traditional contact tracing methods in fighting COVID-19. The Dutch Ministry of Health, Welfare and Sports initiated and developed CoronaMelder, a COVID-19 contact tracing app. This app is based on a Google/Apple Exposure Notification approach and aims to combat the spread of the coronavirus among individuals by notifying those who are at increased risk of infection due to proximity to someone who later tests positive for COVID-19. The app should support traditional contact tracing by faster tracing and greater reach compared to regular contact tracing procedures.

Objective

The main goal of this study is to investigate whether the CoronaMelder is able to support traditional contact tracing employed by public health authorities. To achieve this, usability tests were conducted to answer the following question: is the CoronaMelder user-friendly, understandable, reliable and credible, and inclusive?

Methods

Participants (N=44) of different backgrounds were recruited: youth with varying educational levels, youth with an intellectual disability, migrants, adults (aged 40-64 years), and older adults (aged >65 years) via convenience sampling in the region of Twente in the Netherlands. The app was evaluated with scenario-based, think-aloud usability tests and additional interviews. Findings were recorded via voice recordings, observation notes, and the Dutch User Experience Questionnaire, and some participants wore eye trackers to measure gaze behavior.

Results

Our results showed that the app is easy to use, although problems occurred with understandability and accessibility. Older adults and youth with a lower education level did not understand why or under what circumstances they would receive notifications, why they must share their key (ie, their assigned identifier), and what happens after sharing. In particular, youth in the lower-education category did not trust or understand Bluetooth signals, or comprehend timing and follow-up activities after a risk exposure notification. Older adults had difficulties multitasking (speaking with a public health worker and simultaneously sharing the key in the app). Public health authorities appeared to be unprepared to receive support from the app during traditional contact tracing because their telephone conversation protocol lacks guidance, explanation, and empathy.

Conclusions

The study indicated that the CoronaMelder app is easy to use, but participants experienced misunderstandings about its functioning. The perceived lack of clarity led to misconceptions about the app, mostly regarding its usefulness and privacy-preserving mechanisms. Tailored and targeted communication through, for example, public campaigns or social media, is necessary to provide correct information about the app to residents in the Netherlands. Additionally, the app should be presented as part of the national coronavirus measures instead of as a stand-alone app offered to the public. Public health workers should be trained to effectively and empathetically instruct users on how to use the CoronaMelder app.

SUBMITTER: Bente BE

PROVIDER: S-EPMC8006901 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe COVID-19 pandemic is the greatest public health crisis of the last 100 years. Countries have responded with various levels of lockdown to save lives and stop health systems from being overwhelmed. At the same time, lockdowns entail large socioeconomic costs. One exit strategy under consideration is a mobile phone app that traces the close contacts of those infected with COVID-19. Recent research has demonstrated the theoretical effectiveness of this solution in different disease settings. However, concerns have been raised about such apps because of the potential privacy implications. This could limit the acceptability of app-based contact tracing in the general population. As the effectiveness of this approach increases strongly with app uptake, it is crucial to understand public support for this intervention.ObjectiveThe objective of this study is to investigate the user acceptability of a contact-tracing app in five countries hit by the pandemic.MethodsWe conducted a largescale, multicountry study (N=5995) to measure public support for the digital contact tracing of COVID-19 infections. We ran anonymous online surveys in France, Germany, Italy, the United Kingdom, and the United States. We measured intentions to use a contact-tracing app across different installation regimes (voluntary installation vs automatic installation by mobile phone providers) and studied how these intentions vary across individuals and countries.ResultsWe found strong support for the app under both regimes, in all countries, across all subgroups of the population, and irrespective of regional-level COVID-19 mortality rates. We investigated the main factors that may hinder or facilitate uptake and found that concerns about cybersecurity and privacy, together with a lack of trust in the government, are the main barriers to adoption.ConclusionsEpidemiological evidence shows that app-based contact tracing can suppress the spread of COVID-19 if a high enough proportion of the population uses the app and that it can still reduce the number of infections if uptake is moderate. Our findings show that the willingness to install the app is very high. The available evidence suggests that app-based contact tracing may be a viable approach to control the diffusion of COVID-19.

Project description:BackgroundDuring the COVID-19 pandemic, there was limited adoption of contact-tracing apps (CTAs). Adoption was particularly low among vulnerable people (eg, people with a low socioeconomic position or of older age), while this part of the population tends to have lesser access to information and communication technology and is more vulnerable to the COVID-19 virus.ObjectiveThis study aims to understand the cause of this lagged adoption of CTAs in order to facilitate adoption and find indications to make public health apps more accessible and reduce health disparities.MethodsBecause several psychosocial variables were found to be predictive of CTA adoption, data from the Dutch CTA CoronaMelder (CM) were analyzed using cluster analysis. We examined whether subgroups could be formed based on 6 psychosocial perceptions (ie, trust in the government, beliefs about personal data, social norms, perceived personal and societal benefits, risk perceptions, and self-efficacy) of (non)users concerning CM in order to examine how these clusters differ from each other and what factors are predictive of the intention to use a CTA and the adoption of a CTA. The intention to use and the adoption of CM were examined based on longitudinal data consisting of 2 time frames in October/November 2020 (N=1900) and December 2020 (N=1594). The clusters were described by demographics, intention, and adoption accordingly. Moreover, we examined whether the clusters and the variables that were found to influence the adoption of CTAs, such as health literacy, were predictive of the intention to use and the adoption of the CM app.ResultsThe final 5-cluster solution based on the data of wave 1 contained significantly different clusters. In wave 1, respondents in the clusters with positive perceptions (ie, beneficial psychosocial variables for adoption of a CTA) about the CM app were older (P<.001), had a higher education level (P<.001), and had higher intention (P<.001) and adoption (P<.001) rates than those in the clusters with negative perceptions. In wave 2, the intention to use and adoption were predicted by the clusters. The intention to use CM in wave 2 was also predicted using the adoption measured in wave 1 (P<.001, β=-2.904). Adoption in wave 2 was predicted by age (P=.022, exp(B)=1.171), the intention to use in wave 1 (P<.001, exp(B)=1.770), and adoption in wave 1 (P<.001, exp(B)=0.043).ConclusionsThe 5 clusters, as well as age and previous behavior, were predictive of the intention to use and the adoption of the CM app. Through the distinguishable clusters, insight was gained into the profiles of CM (non)intenders and (non)adopters.Trial registrationOSF Registries osf.io/cq742; https://osf.io/cq742.

Project description:BackgroundThe Dutch CoronaMelder (CM) app is the official Dutch contact-tracing app (CTA). It has been used to contain the spread of the SARS-CoV-2 in the Netherlands. It allows its users and those of connected apps to anonymously exchange warnings about potentially high-risk contacts with individuals infected with the SARS-CoV-2.ObjectiveThe goal of this mixed methods study is to understand the use of CTA in the pandemic and its integration into the Municipal Health Services (MHS) efforts of containment through contact tracing. Moreover, the study aims to investigate both the motivations and user experience-related factors concerning adherence to quarantine and isolation measures.MethodsA topic analysis of 56 emails and a web-based survey of 1937 adults from the Netherlands, combined with a series of 48 in-depth interviews with end users of the app and 14 employees of the Dutch MHS involved in contact tracing, were conducted. Mirroring sessions were held (n=2) with representatives from the development (n=2) and communication teams (n=2) responsible for the creation and implementation of the CM app.ResultsTopic analysis and interviews identified procedural and technical issues in the use of the CTA. Procedural issues included the lack of training of MHS employees in the use of CTAs. Technical issues identified for the end users included the inability to send notifications without phone contact with the MHS, unwarranted notifications, and nightly notifications. Together, these issues undermined confidence in and satisfaction with the app's use. The interviews offered a deeper understanding of the various factors at play and their effects on users; for example, the mixed experiences of the app's users, the end user's own fears, and uncertainties concerning the SARS-CoV-2; problematic infrastructure at the time of the app's implementation on the side of the health services; the effects of the society-wide efforts in containment of the SARS-CoV-2 on the CM app's perception, resulting in further doubts concerning the app's effectiveness among MHS workers and citizens; and problems with adherence to behavioral measures propagated by the app because of the lack of confidence in the app and uncertainty concerning the execution of the behavioral measures. All findings were evaluated with the app's creators and have since contributed to improvements.ConclusionsAlthough most participants perceived the app positively, procedural and technical issues identified in this study limited satisfaction and confidence in the CM app and affected its adoption and long-term use. Moreover, these same issues negatively affected the CM app's effectiveness in improving compliance with behavioral measures aimed at reducing the spread of the SARS-CoV-2. This study offers lessons learned for future eHealth interventions in pandemics. Lessons that can aid in more effective design, implementation, and communication for more effective and readily adoptable eHealth applications.

Project description:BackgroundThe COVID-19 pandemic has drastically changed life in the United States, as the country has recorded over 23 million cases and 383,000 deaths to date. In the leadup to widespread vaccine deployment, testing and surveillance are critical for detecting and stopping possible routes of transmission. Contact tracing has become an important surveillance measure to control COVID-19 in the United States, and mobile health interventions have found increased prominence in this space.ObjectiveThe aim of this study was to investigate the use and usability of MyCOVIDKey, a mobile-based web app to assist COVID-19 contact tracing efforts, during the 6-week pilot period.MethodsA 6-week study was conducted on the Vanderbilt University campus in Nashville, Tennessee. The study participants, consisting primarily of graduate students, postdoctoral researchers, and faculty in the Chemistry Department at Vanderbilt University, were asked to use the MyCOVIDKey web app during the course of the study period. Paradata were collected as users engaged with the MyCOVIDKey web app. At the end of the study, all participants were asked to report on their user experience in a survey, and the results were analyzed in the context of the user paradata.ResultsDuring the pilot period, 45 users enrolled in MyCOVIDKey. An analysis of their enrollment suggests that initial recruiting efforts were effective; however, participant recruitment and engagement efforts at the midpoint of the study were less effective. App use paralleled the number of users, indicating that incentives were useful for recruiting new users to sign up but did not result in users attempting to artificially inflate their use as a result of prize offers. Times to completion of key tasks were low, indicating that the main features of the app could be used quickly. Of the 45 users, 30 provided feedback through a postpilot survey, with 26 (58%) completing it in its entirety. The MyCOVIDKey app as a whole was rated 70.0 on the System Usability Scale, indicating that it performed above the accepted threshold for usability. When the key-in and self-assessment features were examined on their own, it was found that they individually crossed the same thresholds for acceptable usability but that the key-in feature had a higher margin for improvement.ConclusionsThe MyCOVIDKey app was found overall to be a useful tool for COVID-19 contact tracing in a university setting. Most users suggested simple-to-implement improvements, such as replacing the web app framework with a native app format or changing the placement of the scanner within the app workflow. After these updates, this tool could be readily deployed and easily adapted to other settings across the country. The need for digital contact tracing tools is becoming increasingly apparent, particularly as COVID-19 case numbers continue to increase while more businesses begin to reopen.