Dataset Information

What do users think of the UK's three COVID-19 contact-tracing apps? A comparative analysis.

ABSTRACT:

Objectives

Our goal was to gain insights into the user reviews of the three COVID-19 contact-tracing mobile apps, developed for the different regions of the UK: 'NHS COVID-19' for England and Wales, 'StopCOVID NI' for Northern Ireland and 'Protect Scotland' for Scotland. Our two research questions are (1) what are the users' experience and satisfaction levels with the three apps? and (2) what are the main issues (problems) that users have reported about the apps?

Methods

We assess the popularity of the apps and end users' perceptions based on user reviews in app stores. We conduct three types of analysis (data mining, sentiment analysis and topic modelling) to derive insights from the combined set of 25 583 user reviews of the aforementioned three apps (submitted by users until the end of 2020).

Results

Results show that end users have been generally dissatisfied with the apps under study, except the Scottish app. Some of the major issues that users have reported are high battery drainage and doubts on whether apps are really working.

Discussion

Towards the end of 2020, the much-awaited COVID-19 vaccines started to be available, but still, analysing the users' feedback and technical issues of these apps, in retrospective, is valuable to learn the right lessons to be ready for similar circumstances in future.

Conclusion

Our results show that more work is needed by the stakeholders behind the apps (eg, apps' software engineering teams, public-health experts and decision makers) to improve the software quality and, as a result, the public adoption of these apps. For example, they should be designed to be as simple as possible to operate (need for usability).

SUBMITTER: Garousi V

PROVIDER: S-EPMC8290950 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe main German-speaking countries (Germany, Austria, and Switzerland) have implemented digital contact tracing apps to assist the authorities with COVID-19 containment strategies. Low user rates for these apps can affect contact tracing and, thus, its usefulness in controlling the spread of the novel coronavirus.ObjectiveThis study aimed to assess the early perceptions of people living in the German-speaking countries and compare them with the frames portrayed in the newspapers during the first wave of the COVID-19 pandemic.MethodsWe conducted qualitative interviews with 159 participants of the SolPan project. Of those, 110 participants discussed contact tracing apps and were included in this study. We analyzed articles regarding contact tracing apps from 12 newspapers in the German-speaking countries.ResultsStudy participants perceived and newspaper coverage in all German-speaking countries framed contact tracing apps as governmental surveillance tools and embedded them in a broader context of technological surveillance. Participants identified trust in authorities, respect of individual privacy, voluntariness, and temporary use of contact tracing apps as prerequisites for democratic compatibility. Newspapers commonly referenced the use of such apps in Asian countries, emphasizing the differences in privacy regulation among these countries.ConclusionsThe uptake of digital contact tracing apps in German-speaking countries may be undermined due to privacy risks that are not compensated by potential benefits and are rooted in a deeper skepticism towards digital tools. When authorities plan to implement new digital tools and practices in the future, they should be very transparent and proactive in communicating their objectives and the role of the technology-and how it differs from other, possibly similar, tools. It is also important to publicly address ethical, legal, and social issues related to such technologies prior to their launch.

Project description:BackgroundIn the post-COVID-19 pandemic era, many countries have launched apps to trace contacts of COVID-19 infections. Each contact-tracing app (CTA) faces a variety of issues owing to different national policies or technologies for tracing contacts.ObjectiveIn this study, we aimed to investigate all the CTAs used to trace contacts in various countries worldwide, including the technology used by each CTA, the availability of knowledge about the CTA from official websites, the interoperability of CTAs in various countries, and the infection detection rates and policies of the specific country that launched the CTA, and to summarize the current problems of the apps based on the information collected.MethodsWe investigated CTAs launched in all countries through Google, Google Scholar, and PubMed. We experimented with all apps that could be installed and compiled information about apps that could not be installed or used by consulting official websites and previous literature. We compared the information collected by us on CTAs with relevant previous literature to understand and analyze the data.ResultsAfter screening 166 COVID-19 apps developed in 197 countries worldwide, we selected 98 (59%) apps from 95 (48.2%) countries, of which 63 (66.3%) apps were usable. The methods of contact tracing are divided into 3 main categories: Bluetooth, geolocation, and QR codes. At the technical level, CTAs face 3 major problems. First, the distance and time for Bluetooth- and geolocation-based CTAs to record contact are generally set to 2 meters and 15 minutes; however, this distance should be lengthened, and the time should be shortened for more infectious variants. Second, Bluetooth- or geolocation-based CTAs also face the problem of lack of accuracy. For example, individuals in 2 adjacent vehicles during traffic jams may be at a distance of ≤2 meters to make the CTA trace contact, but the 2 users may actually be separated by car doors, which could prevent transmission and infection. In addition, we investigated infection detection rates in 33 countries, 16 (48.5%) of which had significantly low infection detection rates, wherein CTAs could have lacked effectiveness in reducing virus propagation. Regarding policy, CTAs in most countries can only be used in their own countries and lack interoperability among other countries. In addition, 7 countries have already discontinued CTAs, but we believe that it was too early to discontinue them. Regarding user acceptance, 28.6% (28/98) of CTAs had no official source of information that could reduce user acceptance.ConclusionsWe surveyed all CTAs worldwide, identified their technological policy and acceptance issues, and provided solutions for each of the issues we identified. This study aimed to provide useful guidance and suggestions for updating the existing CTAs and the subsequent development of new CTAs.

Project description:BackgroundGiven the magnitude and speed of SARS-CoV-2 transmission, achieving timely and effective manual contact tracing has been a challenging task. Early in the pandemic, contact tracing apps generated substantial enthusiasm due to their potential for automating tracing and reducing transmission rates while enabling targeted confinement strategies. However, although surveys demonstrate public interest in using such apps, their actual uptake remains limited. Their social acceptability is challenged by issues around privacy, fairness, and effectiveness, among other concerns.ObjectiveThis study aims to examine the extent to which design and implementation considerations for contact tracing apps are detailed in the available literature, focusing on aspects related to participatory and responsible eHealth innovation, and synthesize recommendations that support the development of successful COVID-19 contact tracing apps and related eHealth technologies.MethodsSearches were performed on five databases, and articles were selected based on eligibility criteria. Papers pertaining to the design, implementation, or acceptability of contact tracing apps were included. Articles published since 2019, written in English or French, and for which the full articles were available were considered eligible for analysis. To assess the scope of the knowledge found in the current literature, we used three complementary frameworks: (1) the Holistic Framework to Improve the Uptake and Impact of eHealth Technologies, (2) the Montreal model, and (3) the Responsible Innovation in Health Assessment Tool.ResultsA total of 63 articles qualified for the final analysis. Less than half of the selected articles cited the need for a participatory process (n=25, 40%), which nonetheless was the most frequently referenced item of the Framework to Improve the Uptake and Impact of eHealth Technologies. Regarding the Montreal model, stakeholder consultation was the most frequently described level of engagement in the development of contact tracing apps (n=24, 38%), while collaboration and partnership were cited the least (n=2, 3%). As for the Responsible Innovation in Health framework, all the articles (n=63, 100%) addressed population health, whereas only 2% (n=1) covered environmental considerations.ConclusionsMost studies lacked fundamental aspects of eHealth development and implementation. Our results demonstrate that stakeholders of COVID-19 contact tracing apps lack important information to be able to critically appraise this eHealth innovation. This may have contributed to the modest uptake of contact tracing apps worldwide. We make evidence-informed recommendations regarding data management, communication, stakeholder engagement, user experience, and implementation strategies for the successful and responsible development of contact tracing apps.

Project description:BackgroundCOVID-19 digital contact-tracing apps were created to assist public health authorities in curbing the pandemic. These apps require users' permission to access specific functions on their mobile phones, such as geolocation, Bluetooth or Wi-Fi connections, or personal data, to work correctly. As these functions have privacy repercussions, it is essential to establish how contact-tracing apps respect users' privacy.ObjectiveThis study aimed to systematically map existing contact-tracing apps and evaluate the permissions required and their privacy policies. Specifically, we evaluated the type of permissions, the privacy policies' readability, and the information included in them.MethodsWe used custom Google searches and existing lists of contact-tracing apps to identify potentially eligible apps between May 2020 and November 2021. We included contact-tracing or exposure notification apps with a Google Play webpage from which we extracted app characteristics (eg, sponsor, number of installs, and ratings). We used Exodus Privacy to systematically extract the number of permissions and classify them as dangerous or normal. We computed a Permission Accumulated Risk Score representing the threat level to the user's privacy. We assessed the privacy policies' readability and evaluated their content using a 13-item checklist, which generated a Privacy Transparency Index. We explored the relationships between app characteristics, Permission Accumulated Risk Score, and Privacy Transparency Index using correlations, chi-square tests, or ANOVAs.ResultsWe identified 180 contact-tracing apps across 152 countries, states, or territories. We included 85.6% (154/180) of apps with a working Google Play page, most of which (132/154, 85.7%) had a privacy policy document. Most apps were developed by governments (116/154, 75.3%) and totaled 264.5 million installs. The average rating on Google Play was 3.5 (SD 0.7). Across the 154 apps, we identified 94 unique permissions, 18% (17/94) of which were dangerous, and 30 trackers. The average Permission Accumulated Risk Score was 22.7 (SD 17.7; range 4-74, median 16) and the average Privacy Transparency Index was 55.8 (SD 21.7; range 5-95, median 55). Overall, the privacy documents were difficult to read (median grade level 12, range 7-23); 67% (88/132) of these mentioned that the apps collected personal identifiers. The Permission Accumulated Risk Score was negatively associated with the average App Store ratings (r=-0.20; P=.03; 120/154, 77.9%) and Privacy Transparency Index (r=-0.25; P<.001; 132/154, 85.7%), suggesting that the higher the risk to one's data, the lower the apps' ratings and transparency index.ConclusionsMany contact-tracing apps were developed covering most of the planet but with a relatively low number of installs. Privacy-preserving apps scored high in transparency and App Store ratings, suggesting that some users appreciate these apps. Nevertheless, privacy policy documents were difficult to read for an average audience. Therefore, we recommend following privacy-preserving and transparency principles to improve contact-tracing uptake while making privacy documents more readable for a wider public.

Project description:BackgroundTo control the COVID-19 pandemic, it is essential to trace and contain infection chains; for this reason, policymakers have endorsed the usage of contact tracing apps. To date, over 50 countries have released such apps officially or semiofficially, but those that rely on citizens' voluntary uptake suffer from low adoption rates, reducing their effectiveness. Early studies suggest that the low uptake is driven by citizens' concerns about security and privacy, as well as low perceptions of infection risk and benefits from the usage. However, these do not explore important generational differences in uptake decision or the association between individuals' prosociality and uptake.ObjectiveThe objective of our study was to examine the role of individuals' prosociality and other factors discussed in the literature, such as perceived risk and trust in government, in encouraging the usage of contact tracing apps in Japan. We paid particular attention to generational differences.MethodsA web-based survey was conducted in Japan 6 months after the release of a government-sponsored contact tracing app. Participants were recruited from individuals aged between 20 and 69 years. Exploratory factor analyses were conducted to measure prosociality, risk perception, and trust in government. Logistic regression was used to examine the association between these factors and uptake.ResultsThere was a total of 7084 respondents, and observations from 5402 respondents were used for analysis, of which 791 respondents (14.6%) had ever used the app. Two factors of prosociality were retained: agreeableness and attachment to the community. Full-sample analysis demonstrated app uptake was determined by agreeableness, attachment to the community, concern about health risks, concern about social risks, and trust in the national government; however, important differences existed. The uptake decision of respondents aged between 20 and 39 years was attributed to their attachment to the community (odds ratio [OR] 1.28, 95% CI 1.11-1.48). Agreeable personality (OR 1.18, 95% CI 1.02-1.35), concern about social risk (OR 1.17, 95% CI 1.02-1.35), and trust in national government (OR 1.16, 95% CI 1.05-1.28) were key determinants for those aged between 40 and 59 years. For those aged over 60 years, concerns about health risks determined the uptake decision (OR 1.49, 95% CI 1.24-1.80).ConclusionsPolicymakers should implement different interventions for each generation to increase the adoption rate of contact tracing apps. It may be effective to inform older adults about the health benefits of the apps. For middle-age adults, it is important to mitigate concerns about security and privacy issues, and for younger generations, it is necessary to boost their attachment to their community by utilizing social media and other web-based network tools.