Dataset Information

Need of care in interpreting Google Trends-based COVID-19 infodemiological study results: potential risk of false-positivity.

ABSTRACT:

Background

Google Trends (GT) is being used as an epidemiological tool to study coronavirus disease (COVID-19) by identifying keywords in search trends that are predictive for the COVID-19 epidemiological burden. However, many of the earlier GT-based studies include potential statistical fallacies by measuring the correlation between non-stationary time sequences without adjusting for multiple comparisons or the confounding of media coverage, leading to concerns about the increased risk of obtaining false-positive results. In this study, we aimed to apply statistically more favorable methods to validate the earlier GT-based COVID-19 study results.

Methods

We extracted the relative GT search volume for keywords associated with COVID-19 symptoms, and evaluated their Granger-causality to weekly COVID-19 positivity in eight English-speaking countries and Japan. In addition, the impact of media coverage on keywords with significant Granger-causality was further evaluated using Japanese regional data.

Results

Our Granger causality-based approach largely decreased (by up to approximately one-third) the number of keywords identified as having a significant temporal relationship with the COVID-19 trend when compared to those identified by Pearson or Spearman's rank correlation-based approach. "Sense of smell" and "loss of smell" were the most reliable GT keywords across all the evaluated countries; however, when adjusted with their media coverage, these keyword trends did not Granger-cause the COVID-19 positivity trends (in Japan).

Conclusions

Our results suggest that some of the search keywords reported as candidate predictive measures in earlier GT-based COVID-19 studies may potentially be unreliable; therefore, caution is necessary when interpreting published GT-based study results.

SUBMITTER: Sato K

PROVIDER: S-EPMC8286439 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundGoogle Trends is an infoveillance tool widely used by the scientific community to investigate different user behaviors related to COVID-19. However, several limitations regarding its adoption are reported in the literature.ObjectiveThis paper aims to provide an effective and efficient approach to investigating vaccine adherence against COVID-19 via Google Trends.MethodsThrough the cross-correlational analysis of well-targeted hypotheses, we investigate the predictive capacity of web searches related to COVID-19 toward vaccinations in Italy from November 2020 to November 2021. The keyword "vaccine reservation" query (VRQ) was chosen as it reflects a real intention of being vaccinated (V). Furthermore, the impact of the second most read Italian newspaper (vaccine-related headlines [VRH]) on vaccine-related web searches was investigated to evaluate the role of the mass media as a confounding factor. Fisher r-to-z transformation (z) and percentage difference (δ) were used to compare Spearman coefficients. A regression model V=f(VRH, VRQ) was built to validate the results found. The Holm-Bonferroni correction was adopted (P*). SEs are reported.ResultsSimple and generic keywords are more likely to identify the actual web interest in COVID-19 vaccines than specific and elaborated keywords. Cross-correlations between VRQ and V were very strong and significant (min r²=0.460, P*<.001, lag 0 weeks; max r²=0.903, P*<.001, lag 6 weeks). The remaining cross-correlations have been markedly lower (δ>55.8%; z>5.8; P*<.001). The regression model confirmed the greater significance of VRQ versus VRH (P*<.001 vs P=.03, P*=.29).ConclusionsThis research provides preliminary evidence in favor of using Google Trends as a surveillance and prediction tool for vaccine adherence against COVID-19 in Italy. Further research is needed to establish the appropriate use and limits of Google Trends for vaccination tracking. However, these findings prove that the search for suitable keywords is a fundamental step to reduce confounding factors. Additionally, targeting hypotheses helps diminish the likelihood of spurious correlations. It is recommended that Google Trends be leveraged as a complementary infoveillance tool by government agencies to monitor and predict vaccine adherence in this and future crises by following the methods proposed in this paper.

Project description:BackgroundCOVID-19 has caused the worst international crisis since World War II. Italy was one of the countries most affected by both the pandemic and the related infodemic. The success of anti-COVID-19 strategies and future public health policies in Italy cannot separate itself from the containment of fake news and the divulgation of correct information.ObjectiveThe aim of this paper was to analyze the impact of COVID-19 on web interest in conspiracy hypotheses and risk perception of Italian web users.MethodsGoogle Trends was used to monitor users' web interest in specific topics, such as conspiracy hypotheses, vaccine side effects, and pollution and climate change. The keywords adopted to represent these topics were mined from Bufale.net-an Italian website specializing in detecting online hoaxes-and Google Trends suggestions (ie, related topics and related queries). Relative search volumes (RSVs) of the time-lapse periods of 2016-2020 (pre-COVID-19) and 2020-2021 (post-COVID-19) were compared through percentage difference (∆%) and the Welch t test (t). When data series were not stationary, other ad hoc criteria were used. The trend slopes were assessed through Sen slope (SS). The significance thresholds have been indicatively set at P=.05 and t=1.9.ResultsThe COVID-19 pandemic drastically increased Italian netizens' interest in conspiracies (∆% ∈ [60, 288], t ∈ [6, 12]). Web interest in conspiracy-related queries across Italian regions increased and became more homogeneous compared to the pre-COVID-19 period (average RSV=80±2.8, t min=1.8, ∆min%=+12.4, min∆SD%=-25.8). In addition, a growing trend in web interest in the infodemic YouTube channel ByoBlu has been highlighted. Web interest in hoaxes has increased more than interest in antihoax services (t 1=11.3 vs t 2=4.5; Δ1%=+157.6 vs Δ2%=+84.7). Equivalently, web interest in vaccine side effects exceeded interest in pollution and climate change (SSvaccines=0.22, P<.001 vs SSpollution=0.05, P<.001; ∆%=+296.4). To date, a significant amount of fake news related to COVID-19 vaccines, unproven remedies, and origin has continued to circulate. In particular, the creation of SARS-CoV-2 in a Chinese laboratory constituted about 0.04% of the entire web interest in the pandemic.ConclusionsCOVID-19 has given a significant boost to web interest in conspiracy hypotheses and has made it more uniform across regions in Italy. The pandemic accelerated an already-growing trend in users' interest toward some fake news sources, including the 500,000-subscriber YouTube channel ByoBlu, which was removed from the platform by YouTube for disinformation in March 2021. The risk perception related to COVID-19 vaccines has been so distorted that vaccine side effect-related queries outweighed those relating to pollution and climate change, which are much more urgent issues. Moreover, a large amount of fake news has circulated about COVID-19 vaccines, remedies, and origin. Based on these findings, it is recommended that the Italian authorities implement more effective infoveillance systems, and that communication by the mass media be less sensationalistic and more consistent with the available scientific evidence. In this context, Google Trends can be used to monitor users' response to specific infodemiological countermeasures. Further research is needed to understand the psychological mechanisms that regulate risk perception.

Project description:BackgroundWith increasing globalisation, the challenges of providing accessible and safe healthcare to all are great. Studies show that there are substantial numbers of people who are not fluent in English to a level where they can make best use of health services. We examined how health professionals manage language barriers in a consultation.Methods and findingsThis was a cross-sectional study in 41 UK general practices . Health professionals completed a proforma for a randomly allocated consultation session. Seventy-seven (63%) practitioners responded, from 41(59%) practices. From 1008 consultations, 555 involved patients who did not have English as a first language; 710 took place in English; 222 were in other languages, the practitioner either communicating with the patient in their own language/using an alternative language. Seven consultations were in a mixture of English/patient's own language. Patients' first languages numbered 37 (apart from English), in contrast to health practitioners, who declared at least a basic level of proficiency in 22 languages other than English. The practitioner's reported proficiency in the language used was at a basic level in 24 consultations, whereas in 21, they reported having no proficiency at all. In 57 consultations, a relative/friend interpreted and in 6, a bilingual member of staff/community worker was used. Only in 6 cases was a professional interpreter booked. The main limitation was that only one random session was selected and assessment of patient/professional fluency in English was subjective.ConclusionsIt would appear that professional interpreters are under-used in relation to the need for them, with bilingual staff/family and friends being used commonly. In many cases where the patient spoke little/no English, the practitioner consulted in the patient's language but this approach was also used where reported practitioner proficiency was low. Further research in different setting is needed to substantiate these findings.

Project description:BackgroundWeb-based analysis of search queries has become a very useful method in various academic fields for understanding timely and regional differences in the public interest in certain terms and concepts. Particularly in health and medical research, Google Trends has been increasingly used over the last decade.ObjectiveThis study aimed to assess the search activity of pain-related parameters on Google Trends from among the most populated regions worldwide over a 3-year period from before the report of the first confirmed COVID-19 cases in these regions (January 2018) until December 2020.MethodsSearch terms from the following regions were used for the analysis: India, China, Europe, the United States, Brazil, Pakistan, and Indonesia. In total, 24 expressions of pain location were assessed. Search terms were extracted using the local language of the respective country. Python scripts were used for data mining. All statistical calculations were performed through exploratory data analysis and nonparametric Mann-Whitney U tests.ResultsAlthough the overall search activity for pain-related terms increased, apart from pain entities such as headache, chest pain, and sore throat, we observed discordant search activity. Among the most populous regions, pain-related search parameters for shoulder, abdominal, and chest pain, headache, and toothache differed significantly before and after the first officially confirmed COVID-19 cases (for all, P<.001). In addition, we observed a heterogenous, marked increase or reduction in pain-related search parameters among the most populated regions.ConclusionsAs internet searches are a surrogate for public interest, we assume that our data are indicative of an increased incidence of pain after the onset of the COVID-19 pandemic. However, as these increased incidences vary across geographical and anatomical locations, our findings could potentially facilitate the development of specific strategies to support the most affected groups.

Project description:BackgroundGoogle Trends is a novel, freely accessible tool that allows users to interact with Internet search data, which may provide deep insights into population behavior and health-related phenomena. However, there is limited knowledge about its potential uses and limitations. We therefore systematically reviewed health care literature using Google Trends to classify articles by topic and study aim; evaluate the methodology and validation of the tool; and address limitations for its use in research.Methods and findingsPRISMA guidelines were followed. Two independent reviewers systematically identified studies utilizing Google Trends for health care research from MEDLINE and PubMed. Seventy studies met our inclusion criteria. Google Trends publications increased seven-fold from 2009 to 2013. Studies were classified into four topic domains: infectious disease (27% of articles), mental health and substance use (24%), other non-communicable diseases (16%), and general population behavior (33%). By use, 27% of articles utilized Google Trends for casual inference, 39% for description, and 34% for surveillance. Among surveillance studies, 92% were validated against a reference standard data source, and 80% of studies using correlation had a correlation statistic ≥0.70. Overall, 67% of articles provided a rationale for their search input. However, only 7% of articles were reproducible based on complete documentation of search strategy. We present a checklist to facilitate appropriate methodological documentation for future studies. A limitation of the study is the challenge of classifying heterogeneous studies utilizing a novel data source.ConclusionGoogle Trends is being used to study health phenomena in a variety of topic domains in myriad ways. However, poor documentation of methods precludes the reproducibility of the findings. Such documentation would enable other researchers to determine the consistency of results provided by Google Trends for a well-specified query over time. Furthermore, greater transparency can improve its reliability as a research tool.

Project description:Objectives: With the worldwide spread of coronavirus disease 2019 (COVID-19) caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), various antibody detection kits have been developed to test for SARS-CoV-2- specific IgG, IgM, and total antibody. However, the use of different testing methods under various heat-inactivation conditions might affect the COVID-19 detection results. Methods: Seven different antibody detection kits produced by four manufacturers for detection of SARS-CoV-2 IgG, IgM, and total antibody were tested at Wuhan Huoshenshan Hospital, China. Most of the kits used the indirect immunity, capture, and double-antigen sandwich methods. The effects of various heat-inactivation conditions on SARS-CoV-2-specific IgG, IgM, and total antibody detection were analyzed for the different test methods. Results: Using the indirect immunity method, values for SARS-CoV-2 IgG antibody significantly increased and those for IgM antibody decreased with increasing temperature of heat-inactivation using indirect immunity method. However, values for SARS-CoV-2 IgM and total antibody showed no change when the capture and double-antigen sandwich methods were used. The changes in IgG and IgM antibody values with the indirect immunity method indicated that heat-inactivation could affect COVID-19 detection results obtained using this method. In particular, 18 (22.2%) SARS-CoV-2 IgM positive samples were detected as negative with heat-inactivation at 65°C for 30 min, and one (25%) IgG negative sample was detected as positive after heat-inactivation at 56°C for 60 min and 60°C for 30 min. Conclusions: Heat-inactivation could increase SARS-CoV-2 IgG antibody values, and decrease IgM antibody values, causing potential false-positive or false-negative results for COVID-19 antibody detection using the indirect immunity method. Thus, before conducting antibody testing, the testing platforms should be evaluated in accordance with the relevant requirements to ensure accurate COVID-19 detection results.