Dataset Information

Quality and Adoption of COVID-19 Tracing Apps and Recommendations for Development: Systematic Interdisciplinary Review of European Apps.

ABSTRACT:

Background

Simulation study results suggest that COVID-19 contact tracing apps have the potential to achieve pandemic control. Concordantly, high app adoption rates were a stipulated prerequisite for success. Early studies on potential adoption were encouraging. Several factors predicting adoption rates were investigated, especially pertaining to user characteristics. Since then, several countries have released COVID-19 contact tracing apps.

Objective

This study's primary aim is to investigate the quality characteristics of national European COVID-19 contact tracing apps, thereby shifting attention from user to app characteristics. The secondary aim is to investigate associations between app quality and adoption. Finally, app features contributing to higher app quality were identified.

Methods

Eligible COVID-19 contact tracing apps were those released by national health authorities of European Union member states, former member states, and countries of the European Free Trade Association, all countries with comparable legal standards concerning personal data protection and app use voluntariness. The Mobile App Rating Scale was used to assess app quality. An interdisciplinary team, consisting of two health and two human-computer interaction scientists, independently conducted Mobile App Rating Scale ratings. To investigate associations between app quality and adoption rates and infection rates, Bayesian linear regression analyses were conducted.

Results

We discovered 21 national COVID-19 contact tracing apps, all demonstrating high quality overall and high-level functionality, aesthetics, and information quality. However, the average app adoption rate of 22.9% (SD 12.5%) was below the level recommended by simulation studies. Lower levels of engagement-oriented app design were detected, with substantial variations between apps. By regression analyses, the best-case adoption rate was calculated by assuming apps achieve the highest ratings. The mean best-case adoption rates for engagement and overall app quality were 39.5% and 43.6%, respectively. Higher adoption rates were associated with lower cumulative infection rates. Overall, we identified 5 feature categories (symptom assessment and monitoring, regularly updated information, individualization, tracing, and communication) and 14 individual features that contributed to higher app quality. These 14 features were a symptom checker, a symptom diary, statistics on COVID-19, app use, public health instructions and restrictions, information of burden on health care system, assigning personal data, regional updates, control over tracing activity, contact diary, venue check-in, chats, helplines, and app-sharing capacity.

Conclusions

European national health authorities have generally released high quality COVID-19 contact tracing apps, with regard to functionality, aesthetics, and information quality. However, the app's engagement-oriented design generally was of lower quality, even though regression analyses results identify engagement as a promising optimization target to increase adoption rates. Associations between higher app adoption and lower infection rates are consistent with simulation study results, albeit acknowledging that app use might be part of a broader set of protective attitudes and behaviors for self and others. Various features were identified that could guide further engagement-enhancing app development.

SUBMITTER: Kahnbach L

PROVIDER: S-EPMC8174558 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundDuring the COVID-19 pandemic, contact tracing apps have received a lot of public attention. The ongoing debate highlights the challenges of the adoption of data-driven innovation. We reflect on how to ensure an appropriate level of protection of individual data and how to maximize public health benefits that can be derived from the collected data.ObjectiveThe aim of the study was to analyze available COVID-19 contact tracing apps and verify to what extent public health interests and data privacy standards can be fulfilled simultaneously in the process of the adoption of digital health technologies.MethodsA systematic review of PubMed and MEDLINE databases, as well as grey literature, was performed to identify available contact tracing apps. Two checklists were developed to evaluate (1) the apps' compliance with data privacy standards and (2) their fulfillment of public health interests. Based on both checklists, a scorecard with a selected set of minimum requirements was created with the goal of estimating whether the balance between the objective of data privacy and public health interests can be achieved in order to ensure the broad adoption of digital technologies.ResultsOverall, 21 contact tracing apps were reviewed. In total, 11 criteria were defined to assess the usefulness of each digital technology for public health interests. The most frequently installed features related to contact alerting and governmental accountability. The least frequently installed feature was the availability of a system of medical or organizational support. Only 1 app out of 21 (5%) provided a threshold for the population coverage needed for the digital solution to be effective. In total, 12 criteria were used to assess the compliance of contact tracing apps with data privacy regulations. Explicit user consent, voluntary use, and anonymization techniques were among the most frequently fulfilled criteria. The least often implemented criteria were provisions of information about personal data breaches and data gathered from children. The balance between standards of data protection and public health benefits was achieved best by the COVIDSafe app and worst by the Alipay Health Code app.ConclusionsContact tracing apps with high levels of compliance with standards of data privacy tend to fulfill public health interests to a limited extent. Simultaneously, digital technologies with a lower level of data privacy protection allow for the collection of more data. Overall, this review shows that a consistent number of apps appear to comply with standards of data privacy, while their usefulness from a public health perspective can still be maximized.

Project description:BackgroundDespite the enormous potential of mobile health (mHealth) apps for COVID-19 contact tracing, the adoption rate in most countries remains low. Thus, the objective of the current study is to identify facilitators and barriers of mHealth apps adoption for COVID-19 contact tracing based on existing studies.MethodsWe conducted a systematic review of mHealth studies before December 2021 that evaluate facilitators and barriers associated with the adoption of mHealth apps for COVID-19 contact tracing. We assessed the risk of bias for all included studies using the Cochrane tool. We based our narrative synthesis on the facilitators-barriers to the adoption of mHealth framework comprising seven key factors.ResultsA total of 27 articles were reviewed from 16 countries representing high income countries (France, German, Italy, United Kingdom, United States, Australia, Singapore, Belgium, Republic Ireland, Netherland, Poland, and Japan), middle-income countries (Fiji), and low-middle income countries (India). We identified the main facilitators of mHealth adoption: perceived risks to COVID-19, trust, perceived benefit, social norm, and technology readiness. The main barriers of mHealth adoption were data privacy/security concerns. Among sociodemographic factors, females, lower education, lower-income, and older individual are barriers to adoption in low-middle income countries, while most of those factors were not significantly associated with adoption in a high-income country.ConclusionThe findings imply that resolving data privacy/security issues while developing trust, perceived benefits, social norms, and technology preparedness could be effective strategies for increasing adoption intentions and app use among the general public. In low-middle-income countries, addressing digital divide is critical to the app's adoption.Systematic review registrationhttps://www.crd.york.ac.uk/prospero/display_record.php?RecordID=249500, identifier RD42021249500 (PROSPERO).

Project description:BackgroundTo combat the global COVID-19 pandemic, contact tracing apps have been discussed as digital health solutions to track infection chains and provide appropriate information. However, observational studies point to low acceptance in most countries, and few studies have yet examined theory-based predictors of app use in the general population to guide health communication efforts.ObjectiveThis study utilizes established health behavior change and technology acceptance models to predict adoption intentions and frequency of current app use.MethodsWe conducted a cross-sectional online survey between May and July 2020 in a German convenience sample (N=349; mean age 35.62 years; n=226, 65.3% female). To inspect the incremental validity of model constructs as well as additional variables (privacy concerns, personalization), hierarchical regression models were applied, controlling for covariates.ResultsThe theory of planned behavior and the unified theory of acceptance and use of technology predicted adoption intentions (R2=56%-63%) and frequency of current app use (R2=33%-37%). A combined model only marginally increased the predictive value by about 5%, but lower privacy concerns and higher threat appraisals (ie, anticipatory anxiety) significantly predicted app use when included as additional variables. Moreover, the impact of perceived usefulness was positive for adoption intentions but negative for frequency of current app use.ConclusionsThis study identified several theory-based predictors of contact tracing app use. However, few constructs, such as social norms, have a consistent positive effect across models and outcomes. Further research is required to replicate these observations, and to examine the interconnectedness of these constructs and their impact throughout the pandemic. Nevertheless, the findings suggest that promulgating affirmative social norms and positive emotional effects of app use, as well as addressing health concerns, might be promising strategies to foster adoption intentions and app use in the general population.

Project description:BackgroundCOVID-19 digital contact-tracing apps were created to assist public health authorities in curbing the pandemic. These apps require users' permission to access specific functions on their mobile phones, such as geolocation, Bluetooth or Wi-Fi connections, or personal data, to work correctly. As these functions have privacy repercussions, it is essential to establish how contact-tracing apps respect users' privacy.ObjectiveThis study aimed to systematically map existing contact-tracing apps and evaluate the permissions required and their privacy policies. Specifically, we evaluated the type of permissions, the privacy policies' readability, and the information included in them.MethodsWe used custom Google searches and existing lists of contact-tracing apps to identify potentially eligible apps between May 2020 and November 2021. We included contact-tracing or exposure notification apps with a Google Play webpage from which we extracted app characteristics (eg, sponsor, number of installs, and ratings). We used Exodus Privacy to systematically extract the number of permissions and classify them as dangerous or normal. We computed a Permission Accumulated Risk Score representing the threat level to the user's privacy. We assessed the privacy policies' readability and evaluated their content using a 13-item checklist, which generated a Privacy Transparency Index. We explored the relationships between app characteristics, Permission Accumulated Risk Score, and Privacy Transparency Index using correlations, chi-square tests, or ANOVAs.ResultsWe identified 180 contact-tracing apps across 152 countries, states, or territories. We included 85.6% (154/180) of apps with a working Google Play page, most of which (132/154, 85.7%) had a privacy policy document. Most apps were developed by governments (116/154, 75.3%) and totaled 264.5 million installs. The average rating on Google Play was 3.5 (SD 0.7). Across the 154 apps, we identified 94 unique permissions, 18% (17/94) of which were dangerous, and 30 trackers. The average Permission Accumulated Risk Score was 22.7 (SD 17.7; range 4-74, median 16) and the average Privacy Transparency Index was 55.8 (SD 21.7; range 5-95, median 55). Overall, the privacy documents were difficult to read (median grade level 12, range 7-23); 67% (88/132) of these mentioned that the apps collected personal identifiers. The Permission Accumulated Risk Score was negatively associated with the average App Store ratings (r=-0.20; P=.03; 120/154, 77.9%) and Privacy Transparency Index (r=-0.25; P<.001; 132/154, 85.7%), suggesting that the higher the risk to one's data, the lower the apps' ratings and transparency index.ConclusionsMany contact-tracing apps were developed covering most of the planet but with a relatively low number of installs. Privacy-preserving apps scored high in transparency and App Store ratings, suggesting that some users appreciate these apps. Nevertheless, privacy policy documents were difficult to read for an average audience. Therefore, we recommend following privacy-preserving and transparency principles to improve contact-tracing uptake while making privacy documents more readable for a wider public.

Project description:Background and objectivePain spans a broad spectrum of diseases and types that are highly prevalent and cause substantial disease burden for individuals and society. Up to 40% of people affected by pain receive no or inadequate treatment. Providing a scalable, time-, and location-independent way for pain diagnostic, management, prevention and treatment mobile health applications (MHA) might be a promising approach to improve health care for pain. However, the commercial app market is rapidly growing and unregulated, resulting in an opaque market. Studies investigating the content, privacy and security features, quality and scientific evidence of the available apps are highly needed, to guide patients and clinicians to high quality MHA.Contributing to this challenge, the present study investigates the content, quality, and privacy features of pain apps available in the European app stores.MethodsAn automated search engine was used to identify pain apps in the European Google Play and Apple App store. Pain apps were screened and checked for systematic criteria (pain-relatedness, functionality, availability, independent usability, English or German). Content, quality and privacy features were assessed by two independent reviewers using the German Mobile Application Rating Scale (MARS-G). The MARS-G assesses quality on four objectives (engagement, functionality, aesthetics, information quality) and two subjective scales (perceived impact, subjective quality).ResultsOut of 1034 identified pain apps 218 were included. Pain apps covered eight different pain types. Content included basic information, advice, assessment and tracking, and stand-alone interventions. The overall quality of the pain apps was average M = 3.13 (SD = 0.56, min = 1, max = 4.69). The effectiveness of less than 1% of the included pain apps was evaluated in a randomized controlled trial. Major problems with data privacy were present: 59% provided no imprint, 70% had no visible privacy policy.ConclusionA multitude of pain apps is available. Most MHA lack scientific evaluation and have serious privacy issues, posing a potential threat to users. Further research on evidence and improvements privacy and security are needed. Overall, the potential of pain apps is not exploited.

Project description:BackgroundMany countries across the globe have released their own COVID-19 contact tracing apps. This has resulted in the proliferation of several apps that used a variety of technologies. With the absence of a standardized approach used by the authorities, policy makers, and developers, many of these apps were unique. Therefore, they varied by function and the underlying technology used for contact tracing and infection reporting.ObjectiveThe goal of this study was to analyze most of the COVID-19 contact tracing apps in use today. Beyond investigating the privacy features, design, and implications of these apps, this research examined the underlying technologies used in contact tracing apps. It also attempted to provide some insights into their level of penetration and to gauge their public reception. This research also investigated the data collection, reporting, retention, and destruction procedures used by each of the apps under review.MethodsThis research study evaluated 13 apps corresponding to 10 countries based on the underlying technology used. The inclusion criteria ensured that most COVID-19-declared epicenters (ie, countries) were included in the sample, such as Italy. The evaluated apps also included countries that did relatively well in controlling the outbreak of COVID-19, such as Singapore. Informational and unofficial contact tracing apps were excluded from this study. A total of 30,000 reviews corresponding to the 13 apps were scraped from app store webpages and analyzed.ResultsThis study identified seven distinct technologies used by COVID-19 tracing apps and 13 distinct apps. The United States was reported to have released the most contact tracing apps, followed by Italy. Bluetooth was the most frequently used underlying technology, employed by seven apps, whereas three apps used GPS. The Norwegian, Singaporean, Georgian, and New Zealand apps were among those that collected the most personal information from users, whereas some apps, such as the Swiss app and the Italian (Immuni) app, did not collect any user information. The observed minimum amount of time implemented for most of the apps with regard to data destruction was 14 days, while the Georgian app retained records for 3 years. No significant battery drainage issue was reported for most of the apps. Interestingly, only about 2% of the reviewers expressed concerns about their privacy across all apps. The number and frequency of technical issues reported on the Apple App Store were significantly more than those reported on Google Play; the highest was with the New Zealand app, with 27% of the reviewers reporting technical difficulties (ie, 10% out of 27% scraped reviews reported that the app did not work). The Norwegian, Swiss, and US (PathCheck) apps had the least reported technical issues, sitting at just below 10%. In terms of usability, many apps, such as those from Singapore, Australia, and Switzerland, did not provide the users with an option to sign out from their apps.ConclusionsThis article highlighted the fact that COVID-19 contact tracing apps are still facing many obstacles toward their widespread and public acceptance. The main challenges are related to the technical, usability, and privacy issues or to the requirements reported by some users.