Dataset Information

The Reliability and Quality of YouTube Videos as a Source of Public Health Information Regarding COVID-19 Vaccination: Cross-sectional Study.

ABSTRACT:

Background

Recent emergency authorization and rollout of COVID-19 vaccines by regulatory bodies has generated global attention. As the most popular video-sharing platform globally, YouTube is a potent medium for the dissemination of key public health information. Understanding the nature of available content regarding COVID-19 vaccination on this widely used platform is of substantial public health interest.

Objective

This study aimed to evaluate the reliability and quality of information on COVID-19 vaccination in YouTube videos.

Methods

In this cross-sectional study, the phrases "coronavirus vaccine" and "COVID-19 vaccine" were searched on the UK version of YouTube on December 10, 2020. The 200 most viewed videos of each search were extracted and screened for relevance and English language. Video content and characteristics were extracted and independently rated against Health on the Net Foundation Code of Conduct and DISCERN quality criteria for consumer health information by 2 authors.

Results

Forty-eight videos, with a combined total view count of 30,100,561, were included in the analysis. Topics addressed comprised the following: vaccine science (n=18, 58%), vaccine trials (n=28, 58%), side effects (n=23, 48%), efficacy (n=17, 35%), and manufacturing (n=8, 17%). Ten (21%) videos encouraged continued public health measures. Only 2 (4.2%) videos made nonfactual claims. The content of 47 (98%) videos was scored to have low (n=27, 56%) or moderate (n=20, 42%) adherence to Health on the Net Foundation Code of Conduct principles. Median overall DISCERN score per channel type ranged from 40.3 (IQR 34.8-47.0) to 64.3 (IQR 58.5-66.3). Educational channels produced by both medical and nonmedical professionals achieved significantly higher DISCERN scores than those of other categories. The highest median DISCERN scores were achieved by educational videos produced by medical professionals (64.3, IQR 58.5-66.3) and the lowest median scores by independent users (18, IQR 18-20).

Conclusions

The overall quality and reliability of information on COVID-19 vaccines on YouTube remains poor. Videos produced by educational channels, especially by medical professionals, were higher in quality and reliability than those produced by other sources, including health-related organizations. Collaboration between health-related organizations and established medical and educational YouTube content producers provides an opportunity for the dissemination of high-quality information on COVID-19 vaccination. Such collaboration holds potential as a rapidly implementable public health intervention aiming to engage a wide audience and increase public vaccination awareness and knowledge.

SUBMITTER: Chan C

PROVIDER: S-EPMC8274673 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundInflammatory back pain is a chronic condition with localized pain, particularly in the axial spine and sacroiliac joints, that is associated with morning stiffness and improves with exercise. YouTube is the second most frequently used social media platform for accessing health information. This study sought to investigate the quality and reliability of YouTube videos on inflammatory back pain (IBP).MethodsThe study design was planned as cross-sectional. A search was conducted using the term "inflammatory back pain," and the first 100 videos that met the inclusion criteria were selected on October 19, 2023. The data of the videos selected according to the inclusion and exclusion criteria in the study settings were examined. Videos with English language, with audiovisual content , had a duration >30 s, non-duplicated and primary content related to IBP were included in the study. A number of video parameters such as the number of likes, number of views, duration, and content categories were assessed. The videos were assessed for reliability using the Journal of the American Medical Association (JAMA) Benchmark criteria and the DISCERN tool. Quality was assessed using the Global Quality Score (GQS). Continuous variables were checked for normality of distribution using Shapiro-Wilk test and Kolmogorov-Smirnov test. Kruskal-Wallis test and Mann-Whitney U test were used to analyze the continuous data depending on the number of groups. Categorical data were analyzed using Pearson's chi-square test.ResultsReliability assessment based on JAMA scores showed 21% of the videos to have high reliability. Quality assessment based on GQS results showed 19% of the videos to have high quality. JAMA, DISCERN, and GQS scores differed significantly by source of video (p < 0.001, < 0.001, and = 0.002, respectively). Video duration had a moderate positive correlation with scores from the GQS (r = 0.418, p < 0.001), JAMA (r = 0.484, p < 0.001), and modified DISCERN (r = 0.418, p < 0.001).ConclusionThe results of the present study showed that YouTube offers videos of low reliability and low quality on inflammatory back pain. Health authorities have a responsibility to protect public health and should take proactive steps regarding health information shared on social media platforms.

Project description:IntroductionWhilst the coronavirus disease 2019 (COVID-19) vaccination rollout is well underway, there is a concern in Africa where less than 2% of global vaccinations have occurred. In the absence of herd immunity, health promotion remains essential. YouTube has been widely utilised as a source of medical information in previous outbreaks and pandemics. There are limited data on COVID-19 information on YouTube videos, especially in languages widely spoken in Africa. This study investigated the quality and reliability of such videos.MethodsMedical information related to COVID-19 was analysed in 11 languages (English, isiZulu, isiXhosa, Afrikaans, Nigerian Pidgin, Hausa, Twi, Arabic, Amharic, French, and Swahili). Cohen's Kappa was used to measure inter-rater reliability. A total of 562 videos were analysed. Viewer interaction metrics and video characteristics, source, and content type were collected. Quality was evaluated using the Medical Information Content Index (MICI) scale and reliability was evaluated by the modified DISCERN tool.ResultsKappa coefficient of agreement for all languages was p < 0.01. Informative videos (471/562, 83.8%) accounted for the majority, whilst misleading videos (12/562, 2.13%) were minimal. Independent users (246/562, 43.8%) were the predominant source type. Transmission of information (477/562 videos, 84.9%) was most prevalent, whilst content covering screening or testing was reported in less than a third of all videos. The mean total MICI score was 5.75/5 (SD 4.25) and the mean total DISCERN score was 3.01/5 (SD 1.11).ConclusionYouTube is an invaluable, easily accessible resource for information dissemination during health emergencies. Misleading videos are often a concern; however, our study found a negligible proportion. Whilst most videos were fairly reliable, the quality of videos was poor, especially noting a dearth of information covering screening or testing. Governments, academic institutions, and healthcare workers must harness the capability of digital platforms, such as YouTube to contain the spread of misinformation.

Project description:PurposeThe purpose of this study was to evaluate the reliability and educational content of YouTube videos concerning injuries to the posterior cruciate ligament (PCL) of the knee.MethodsThe first 50 videos specific to the PCL identified through the YouTube query posterior cruciate ligament were evaluated by a method of video selection demonstrated to be feasible in prior YouTube studies. Videos were classified by content and upload source. Video reliability was assessed using the Journal of the American Medical Association (JAMA) benchmark criteria (score range 0-5). Video educational content was assessed using the Global Quality Score (GQS) (range 0-4) and the PCL Score (PCLS) (score range 0-18). Analysis of variance was used to determine differences in video reliability and educational content quality based on video content and upload source. Multivariate linear regressions were used to identify predictors of video reliability and educational content quality.ResultsThe mean number of views per video was 50,477.9 ± 15,036. Collectively, the 50 videos were viewed 14,141,285 times. Video content was classified primarily as information about disease (62.0%). The most common upload sources were physicians (24.0%) and nonphysician health care providers (26.0%). Significant between-group interactions were found between video source and the JAMA score, with physicians and medical sources having significantly higher mean JAMA scores (P = 0.037). Videos uploaded by physicians were an independent positive predictor of greater JAMA scores (β:1.27; P = 0.008). Videos uploaded by a medical source (β:2.06; P = 0.038) were an independent positive predictor of a greater GQS. There were no independent associations between video content category or upload source and the PCLS.ConclusionsVideos concerning the PCL were frequently viewed on YouTube, but the educational quality and reliability of these videos were low.Clinical relevancePhysicians and health care providers treating PCL pathology should take the initiative to counsel patients about which outside resources are reliable to better inform patients about their treatment decisions. With regard to YouTube videos specifically, providers should caution their patients that this source of information may be unreliable.