The QUEST for quality online health information: validation of a short quantitative tool.
Ontology highlight
ABSTRACT: Background
Online health information is unregulated and can be of highly variable quality. There is currently no singular quantitative tool that has undergone a validation process, can be used for a broad range of health information, and strikes a balance between ease of use, concision and comprehensiveness. To address this gap, we developed the QUality Evaluation Scoring Tool (QUEST). Here we report on the analysis of the reliability and validity of the QUEST in assessing the quality of online health information.Methods
The QUEST and three existing tools designed to measure the quality of online health information were applied to two randomized samples of articles containing information about the treatment (n?=?16) and prevention (n?=?29) of Alzheimer disease as a sample health condition. Inter-rater reliability was assessed using a weighted Cohen's kappa (?) for each item of the QUEST. To compare the quality scores generated by each pair of tools, convergent validity was measured using Kendall's tau (?) ranked correlation.Results
The QUEST demonstrated high levels of inter-rater reliability for the seven quality items included in the tool (? ranging from 0.7387 to 1.0, P?ConclusionsOur findings support the QUEST as a reliable and valid tool to evaluate online articles about health. Results provide evidence that the QUEST integrates the strengths of existing tools and evaluates quality with equal efficacy using a concise, seven-item questionnaire. The QUEST can serve as a rapid, effective, and accessible method of appraising the quality of online health information for researchers and clinicians alike.
SUBMITTER: Robillard JM
PROVIDER: S-EPMC6194721 | biostudies-literature | 2018 Oct
REPOSITORIES: biostudies-literature
Publications
The QUEST for quality online health information: validation of a short quantitative tool.
Robillard Julie M JM Jun Jessica H JH Lai Jen-Ai JA Feng Tanya L TL
BMC medical informatics and decision making 20181019 1
<h4>Background</h4>Online health information is unregulated and can be of highly variable quality. There is currently no singular quantitative tool that has undergone a validation process, can be used for a broad range of health information, and strikes a balance between ease of use, concision and comprehensiveness. To address this gap, we developed the QUality Evaluation Scoring Tool (QUEST). Here we report on the analysis of the reliability and validity of the QUEST in assessing the quality of ...[more]
Similar Datasets
Project description:BackgroundConcern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no standard quality assessment tool available for online newspapers.ObjectiveThis study aimed to develop the Health Information Quality Assessment Tool (HIQUAL) for online newspaper articles.MethodsWe reviewed previous health information quality assessment tools and related studies and accordingly developed and customized new criteria. The interrater agreement for the new assessment tool was assessed for 3 newspaper articles on different subjects (colorectal cancer, obesity genetic testing, and hypertension diagnostic criteria) using the Fleiss κ and Gwet agreement coefficient. To compare the quality scores generated by each pair of tools, convergent validity was measured using the Kendall τ ranked correlation.ResultsOverall, the HIQUAL for newspaper articles comprised 10 items across 5 domains: reliability, usefulness, understandability, sufficiency, and transparency. The interrater agreement for the article on colorectal cancer was in the moderate to substantial range (Fleiss κ=0.48, SE 0.11; Gwet agreement coefficient=0.74, SE 0.13), while for the article introducing obesity genetic testing it was in the substantial range, with values of 0.63 (SE 0.28) and 0.86 (SE 0.10) for the two measures, respectively. There was relatively low agreement for the article on hypertension diagnostic criteria at 0.20 (SE 0.10) and 0.75 (SE 0.13), respectively. Validity of the correlation assessed with the Kendall τ showed good correlation between tools (HIQUAL vs DISCERN=0.72, HIQUAL vs QUEST [Quality Evaluation Scoring Tool]=0.69).ConclusionsWe developed a new assessment tool to evaluate the quality of health information in online newspaper articles, to help consumers discern accurate sources of health information. The HIQUAL can help increase the accuracy and quality of online health information in Korea.
| S-EPMC8367132 | biostudies-literature
Project description:ObjectiveAssessment of the readability and quality of online health information regarding parathyroidectomy.Study designCross-sectional analysis.SettingWebsites providing patient-oriented health information regarding parathyroidectomy obtained via the Google search engine.MethodsThe top 75 Google search results for "parathyroidectomy,""parathyroid surgery," and "parathyroid gland removal" were reviewed. Websites were categorized by website type and country of origin. Readability was assessed by Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook. Website quality was assessed per JAMA benchmark criteria and the DISCERN instrument.ResultsA total of 74 unique websites were evaluated. The mean readability of the assessed websites exceeded the recommended sixth-grade reading level on the Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook (P < .001). Readability did not vary significantly by website type. Websites originating from the United Kingdom were significantly more readable than those from the United States. The majority of assessed websites were of poor quality (n = 42, 56.8%) on assessment based on the DISCERN instrument. Quality varied significantly by website category on the JAMA benchmark criteria (P < .001) and DISCERN score (P = .049) with commercial websites receiving the highest scores. DISCERN score also varied significantly by country of origin (P = .036) with UK sites receiving highest mean DISCERN scores.ConclusionOnline health information regarding parathyroidectomy is largely of poor quality and is poorly readable for many patients. Institutions utilizing well-defined guidelines for development of patient educational resources may provide online health information of greater quality and readability.
| S-EPMC9597036 | biostudies-literature
Project description:BackgroundCommon information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions.MethodsWe applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use.ResultsMost features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements.ConclusionsThis network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition to existing information facilities in the field of OSH, but also to other healthcare fields struggling with how to answer questions from people in practice with high quality information. In the near future, we will focus on the use of the tool and its effects on information and knowledge dissemination.
| S-EPMC2987966 | biostudies-literature
Project description:BackgroundThe Internet is a frequently used source of health information. Adolescents in particular seem to be receptive to online health information (OHI) and often incorporate such information in their decision-making processes. Yet, OHI is often incomplete, inaccurate, or unreliable. This study assessed the quality of Hebrew online (non-user-generated) content on oral contraceptives (OC), with regard to accuracy/completeness, credibility, and usability.MethodsTwenty-nine websites in Hebrew, including those of the four Israeli HMOs, were identified and evaluated. The websites were categorized as: HMO, health portal, contraception-specific, promotional-commercial, and life style and women's health. A set of established content parameters was selected by a family planning expert to assess accuracy/completeness. The Health on the Net Foundation Code of Conduct (HONcode) principles were used to assess the websites' reliability. Usability was assessed by applying items selected from the Minervation Validation and the University of Michigan's 'Website Evaluation checklist' scale. Mean scores, standard deviations (SD), and ranges were calculated for all websites and for category-specific websites. Correlation between dimensions and Inter-rater reliability were also examined.ResultsThe mean score for accuracy/completeness was 50.9% for all websites (SD=30.1%, range 8-100%). Many websites failed to provide complete information, or provided inaccurate information regarding what to do when a pill is missed and when to use back-up methods. The average credibility score for all websites was 70.6% (SD=15.1, range=38=98%). The credibility parameters that were most commonly absent were funding source, authoring, date of content creation and last modification, explicit reference to evidence-based information, and references and citations. The average usability score for all websites was 94.5% (SD=6.9%, range 79-100%). A weak correlation was found between the three quality parameters assessed.ConclusionsWide variation was noted in the quality of Hebrew-language OC websites. HMOs' websites scored highest on credibility and usability, and contraceptive-specific websites exhibited the greatest accuracy/completeness. The findings highlight the need to establish quality guidelines for health website content, train health care providers in assisting their patients to seek high quality OHI, and strengthen e-health literacy skills among online-information seekers, including perhaps health professionals.
| S-EPMC3475130 | biostudies-literature
Project description:BackgroundThe Internet has become a leading source of health information accessed by patients and the general public. It is crucial that this information is reliable and accurate.ObjectivesThe purpose of this systematic review was to evaluate the overall quality of online health information targeting patients and the general public.MethodsThe systematic review is based on a pre-established protocol and is reported according to the PRISMA statement. Eleven databases and Internet searches were performed for relevant studies. Descriptive statistics were used to synthesize data. The NIH Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies was used to assess the methodological quality of the included studies.ResultsOut of 3393 references, we included 153 cross-sectional studies evaluating 11,785 websites using 14 quality assessment tools. The quality level varied across scales. Using DISCERN, none of the websites received a category of excellent in quality, 37-79% were rated as good, and the rest were rated as poor quality. Only 18% of websites were HON Code certified. Quality varied by affiliation (governmental was higher than academic, which was higher than other media sources) and by health specialty (likely higher in internal medicine and anesthesiology).ConclusionThis comprehensive systematic review demonstrated suboptimal quality of online health information. Therefore, the Internet at the present time does not provide reliable health information for laypersons. The quality of online health information requires significant improvement which should be a mandate for policymakers and private and public organizations.
| S-EPMC6712138 | biostudies-literature
Project description:BackgroundIn China, the internet has become one of the most important ways to obtain information about breast cancer. However, quantitative evaluations of the quality of Chinese health websites and the breast cancer treatment information they publish are lacking.ObjectiveThis study aimed to evaluate the quality of Chinese breast cancer websites and the value, suitability, and accuracy of the breast cancer treatment information they publish.MethodsChinese breast cancer health websites were searched and manually screened according to their Alexa and Baidu search engine rankings. For each website included in the survey, which was conducted on April 8, 2019, the three most recently published papers on the website that met the inclusion criteria were included for evaluation. Three raters assessed all materials using the LIDA, DISCERN, and Suitability Assessment of Materials (SAM) tools and the Michigan Checklist. Data analysis was completed with the Statistical Package for Social Sciences (SPSS) version 20.0 and Microsoft Excel 2010.ResultsThis survey included 20 Chinese breast cancer websites and 60 papers on breast cancer treatment. The LIDA tool was used to evaluate the quality of the 20 websites. The LIDA's scores of the websites (mean=54.85, SD 3.498; total possible score=81) were low. In terms of the layout, color scheme, search facility, browsing facility, integration of nontextual media, submission of comments, declaration of objectives, content production method, and robust method, more than half of the websites scored 0 (never) or 1 (sometimes). For the online breast cancer treatment papers, the scores were generally low. Regarding suitability, 32 (53.33%) papers were evaluated as presenting unsuitable material. Regarding accuracy, the problems were that the papers were largely not original (44/60, 73%) and lacked references (46/60, 77%).ConclusionsThe quality of Chinese breast cancer websites is poor. The color schemes, text settings, user comment submission functions, and language designs should be improved. The quality of Chinese online breast cancer treatment information is poor; the information has little value to users, and pictorial information is scarcely used. The online breast cancer treatment information is accurate but lacks originality and references. Website developers, governments, and medical professionals should play a full role in the design of health websites, the regulation of online health information, and the use of online health information.
| S-EPMC8663447 | biostudies-literature
Project description:BackgroundOver 20,000 parents in the United States face the challenge of participating in decisions about whether to use life support for their infants born on the cusp of viability every year. Clinicians must help families grasp complex medical information about their baby's immediate prognosis as well as the risk for significant long-term morbidity. Patients faced with this decision want supplemental information and frequently seek medical information on the Internet. Empirical evidence about the quality of websites is lacking.ObjectiveWe sought to evaluate the quality of online information available about periviable birth and treatment options for infants born at the cusp of viability.MethodsWe read a counseling script to 20 pregnant participants that included information typically provided by perinatal and neonatal providers when periviable birth is imminent. The women were then asked to list terms they would use to search the Internet if they wanted additional information. Using these search terms, two reviewers evaluated the content of websites obtained via a Google search. We used two metrics to assess the quality of websites. The first was the DISCERN instrument, a validated questionnaire designed to assess the quality of patient-targeted health information for treatment choices. The second metric was the Essential Content Tool (ECT), a tool designed to address key components of counseling around periviable birth as outlined by professional organizations. DISCERN scores were classified as low quality if scores were 2, fair quality if scores were 3, and high quality if scores were 4 or higher. Scores of 6 or higher on the ECT were considered high quality. Interreviewer agreement was assessed by calculated kappa statistic.ResultsA total of 97 websites were reviewed. Over half (57/97, 59%) were for-profit sites, news stories, or personal blogs; 28% (27/97) were government or medical sites; and 13% (13/97) were nonprofit or advocacy sites. The majority of sites scored poorly in DISCERN questions designed to assess the reliability of information presented as well as data regarding treatment choices. Only 7% (7/97) of the websites were high quality as defined by the DISCERN tool. The majority of sites did not address the essential content defined by the ECT. Importantly, only 18% of websites (17/97) indicated that there are often a number of reasonable approaches to newborn care when faced with periviable birth. Agreement was strong, with kappa ranging from .72 to .91.ConclusionsMost information about periviable birth found on the Internet using common search strategies is of low quality. News stories highlighting positive outcomes are disproportionately represented. Few websites discuss comfort care or how treatment decisions impact quality of life.
| S-EPMC6716431 | biostudies-literature
Project description:Although online health communities are popular in supporting mental health, factors leading to the helpfulness of mental health information are still under-investigated. Based on the elaboration likelihood model and motivation theory, we incorporate two types of health information-related constructs, i.e., information quality (central route) and responders' effort (peripheral route), and adopt reputation as an extrinsic motivation to build our model. We crawl data from a Chinese online mental health community and extract 11 key variables, and then analyze the model with negative binomial regression. The empirical results indicate that the effect of the length of health information on its helpfulness votes is positively significant, while the effect of readability of health information on its helpfulness votes is relatively negative. In terms of responders' effort, both the timelines of the response and interactive feedback have a significant positive impact on helpfulness of health information votes, while these effects are negatively moderated by the online reputation of responders. This study contributes to the literature on information evaluation mechanisms in online health communities.
| S-EPMC9746233 | biostudies-literature
Project description:BackgroundDigitalization and the increasing availability of online information have changed the way in which information is searched for and retrieved by the public and by health professionals. The technical developments in the last two decades have transformed the methods of information retrieval. Although systematic evidence exists on the general information needs of specialists, and in particular, family physicians (FPs), there have been no recent systematic reviews to specifically address the needs of FPs and any barriers that may exist to accessing online health information.ObjectiveThis review aims to provide an up-to-date perspective on the needs of FPs in searching, retrieving, and using online information.MethodsThis systematic review of qualitative and quantitative studies searched a multitude of databases spanning the years 2000 to 2020 (search date January 2020). Studies that analyzed the online information needs of FPs, any barriers to the accessibility of information, and their information-seeking behaviors were included. Two researchers independently scrutinized titles and abstracts, analyzing full-text papers for their eligibility, the studies therein, and the data obtained from them.ResultsThe initial search yielded 4541 studies for initial title and abstract screening. Of the 144 studies that were found to be eligible for full-text screening, 41 were finally included. A total of 20 themes were developed and summarized into 5 main categories: individual needs of FPs before the search; access needs, including factors that would facilitate or hinder information retrieval; quality needs of the information to hand; utilization needs of the information available; and implication needs for everyday practice.ConclusionsThis review suggests that searching, accessing, and using online information, as well as any pre-existing needs, barriers, or demands, should not be perceived as separate entities but rather be regarded as a sequential process. Apart from accessing information and evaluating its quality, FPs expressed concerns regarding the applicability of this information to their everyday practice and its subsequent relevance to patient care. Future online information resources should cater to the needs of the primary care setting and seek to address the way in which such resources may be adapted to these specific requirements.
| S-EPMC7806443 | biostudies-literature
Project description:BackgroundThe internet is commonly used by older adults to obtain health information and this trend has markedly increased in the past decade. However, studies illustrate that much of the available online health information is not informed by good quality evidence, developed in a transparent way, or easy to use. Furthermore, studies highlight that the general public lacks the skills necessary to distinguish between online products that are credible and trustworthy and those that are not. A number of tools have been developed to assess the evidence, transparency, and usability of online health information; however, many have not been assessed for reliability or ease of use.ObjectiveThe first objective of this study was to determine if a tool assessing the evidence, transparency, and usability of online health information exists that is easy and quick to use and has good reliability. No such tool was identified, so the second objective was to develop such a tool and assess it for reliability when used to assess online health information on topics of relevant to optimal aging.MethodsAn electronic database search was conducted between 2002 and 2012 to identify published papers describing tools that assessed the evidence, transparency, and usability of online health information. Papers were retained if the tool described was assessed for reliability, assessed the quality of evidence used to create online health information, and was quick and easy to use. When no one tool met expectations, a new instrument was developed and tested for reliability. Reliability between two raters was assessed using the intraclass correlation coefficient (ICC) for each item at two time points. SPSS Statistics 22 software was used for statistical analyses and a one-way random effects model was used to report the results. The overall ICC was assessed for the instrument as a whole in July 2015. The threshold for retaining items was ICC>0.60 (ie, "good" reliability).ResultsAll tools identified that evaluated online health information were either too complex, took a long time to complete, had poor reliability, or had not undergone reliability assessment. A new instrument was developed and assessed for reliability in April 2014. Three items had an ICC<0.60 (ie, "good" reliability). One of these items was removed ("minimal scrolling") and two were retained but reworded for clarity. Four new items were added that assessed the level of research evidence that informed the online health information and the tool was retested in July 2015. The total ICC score showed excellent agreement with both single measures (ICC=0.988; CI 0.982-0.992) and average measures (ICC=0.994; CI 0.991-0.996).ConclusionsThe results of this study suggest that this new tool is reliable for assessing the evidence, transparency, and usability of online health information that is relevant to optimal aging.
| S-EPMC6715399 | biostudies-literature