A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study.
Ontology highlight
ABSTRACT: Background
Concern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no standard quality assessment tool available for online newspapers.Objective
This study aimed to develop the Health Information Quality Assessment Tool (HIQUAL) for online newspaper articles.Methods
We reviewed previous health information quality assessment tools and related studies and accordingly developed and customized new criteria. The interrater agreement for the new assessment tool was assessed for 3 newspaper articles on different subjects (colorectal cancer, obesity genetic testing, and hypertension diagnostic criteria) using the Fleiss κ and Gwet agreement coefficient. To compare the quality scores generated by each pair of tools, convergent validity was measured using the Kendall τ ranked correlation.Results
Overall, the HIQUAL for newspaper articles comprised 10 items across 5 domains: reliability, usefulness, understandability, sufficiency, and transparency. The interrater agreement for the article on colorectal cancer was in the moderate to substantial range (Fleiss κ=0.48, SE 0.11; Gwet agreement coefficient=0.74, SE 0.13), while for the article introducing obesity genetic testing it was in the substantial range, with values of 0.63 (SE 0.28) and 0.86 (SE 0.10) for the two measures, respectively. There was relatively low agreement for the article on hypertension diagnostic criteria at 0.20 (SE 0.10) and 0.75 (SE 0.13), respectively. Validity of the correlation assessed with the Kendall τ showed good correlation between tools (HIQUAL vs DISCERN=0.72, HIQUAL vs QUEST [Quality Evaluation Scoring Tool]=0.69).Conclusions
We developed a new assessment tool to evaluate the quality of health information in online newspaper articles, to help consumers discern accurate sources of health information. The HIQUAL can help increase the accuracy and quality of online health information in Korea.
SUBMITTER: Lee N
PROVIDER: S-EPMC8367132 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ObjectivesThis study aimed to explore the health inequality discourse in the Korean press by analyzing newspaper articles using a relatively new content analysis technique.MethodsThis study used the search term "health inequality" to collect articles containing that term that were published between 2000 and 2018. The collected articles went through pre-processing and topic modeling, and the contents and temporal trends of the extracted topics were analyzed.ResultsA total of 1038 articles were identified, and 5 topics were extracted. As the number of studies on health inequality has increased over the past 2 decades, so too has the number of news articles regarding health inequality. The extracted topics were public health policies, social inequalities in health, inequality as a social problem, healthcare policies, and regional health gaps. The total number of occurrences of each topic increased every year, and the trend observed for each theme was influenced by events related to its contents, such as elections. Finally, the frequency of appearance of each topic differed depending on the type of news source.ConclusionsThe results of this study can be used as preliminary data for future attempts to address health inequality in Korea. To make addressing health inequality part of the public agenda, the media's perspective and discourse regarding health inequality should be monitored to facilitate further strategic action.
| S-EPMC6893224 | biostudies-literature
Project description:BackgroundThe internet is commonly used by older adults to obtain health information and this trend has markedly increased in the past decade. However, studies illustrate that much of the available online health information is not informed by good quality evidence, developed in a transparent way, or easy to use. Furthermore, studies highlight that the general public lacks the skills necessary to distinguish between online products that are credible and trustworthy and those that are not. A number of tools have been developed to assess the evidence, transparency, and usability of online health information; however, many have not been assessed for reliability or ease of use.ObjectiveThe first objective of this study was to determine if a tool assessing the evidence, transparency, and usability of online health information exists that is easy and quick to use and has good reliability. No such tool was identified, so the second objective was to develop such a tool and assess it for reliability when used to assess online health information on topics of relevant to optimal aging.MethodsAn electronic database search was conducted between 2002 and 2012 to identify published papers describing tools that assessed the evidence, transparency, and usability of online health information. Papers were retained if the tool described was assessed for reliability, assessed the quality of evidence used to create online health information, and was quick and easy to use. When no one tool met expectations, a new instrument was developed and tested for reliability. Reliability between two raters was assessed using the intraclass correlation coefficient (ICC) for each item at two time points. SPSS Statistics 22 software was used for statistical analyses and a one-way random effects model was used to report the results. The overall ICC was assessed for the instrument as a whole in July 2015. The threshold for retaining items was ICC>0.60 (ie, "good" reliability).ResultsAll tools identified that evaluated online health information were either too complex, took a long time to complete, had poor reliability, or had not undergone reliability assessment. A new instrument was developed and assessed for reliability in April 2014. Three items had an ICC<0.60 (ie, "good" reliability). One of these items was removed ("minimal scrolling") and two were retained but reworded for clarity. Four new items were added that assessed the level of research evidence that informed the online health information and the tool was retested in July 2015. The total ICC score showed excellent agreement with both single measures (ICC=0.988; CI 0.982-0.992) and average measures (ICC=0.994; CI 0.991-0.996).ConclusionsThe results of this study suggest that this new tool is reliable for assessing the evidence, transparency, and usability of online health information that is relevant to optimal aging.
| S-EPMC6715399 | biostudies-literature
Project description:BackgroundOnline health information is unregulated and can be of highly variable quality. There is currently no singular quantitative tool that has undergone a validation process, can be used for a broad range of health information, and strikes a balance between ease of use, concision and comprehensiveness. To address this gap, we developed the QUality Evaluation Scoring Tool (QUEST). Here we report on the analysis of the reliability and validity of the QUEST in assessing the quality of online health information.MethodsThe QUEST and three existing tools designed to measure the quality of online health information were applied to two randomized samples of articles containing information about the treatment (n?=?16) and prevention (n?=?29) of Alzheimer disease as a sample health condition. Inter-rater reliability was assessed using a weighted Cohen's kappa (?) for each item of the QUEST. To compare the quality scores generated by each pair of tools, convergent validity was measured using Kendall's tau (?) ranked correlation.ResultsThe QUEST demonstrated high levels of inter-rater reliability for the seven quality items included in the tool (? ranging from 0.7387 to 1.0, P?<?.05). The tool was also found to demonstrate high convergent validity. For both treatment- and prevention-related articles, all six pairs of tests exhibited a strong correlation between the tools (? ranging from 0.41 to 0.65, P?<?.05).ConclusionsOur findings support the QUEST as a reliable and valid tool to evaluate online articles about health. Results provide evidence that the QUEST integrates the strengths of existing tools and evaluates quality with equal efficacy using a concise, seven-item questionnaire. The QUEST can serve as a rapid, effective, and accessible method of appraising the quality of online health information for researchers and clinicians alike.
| S-EPMC6194721 | biostudies-literature
Project description:BackgroundOver 20,000 parents in the United States face the challenge of participating in decisions about whether to use life support for their infants born on the cusp of viability every year. Clinicians must help families grasp complex medical information about their baby's immediate prognosis as well as the risk for significant long-term morbidity. Patients faced with this decision want supplemental information and frequently seek medical information on the Internet. Empirical evidence about the quality of websites is lacking.ObjectiveWe sought to evaluate the quality of online information available about periviable birth and treatment options for infants born at the cusp of viability.MethodsWe read a counseling script to 20 pregnant participants that included information typically provided by perinatal and neonatal providers when periviable birth is imminent. The women were then asked to list terms they would use to search the Internet if they wanted additional information. Using these search terms, two reviewers evaluated the content of websites obtained via a Google search. We used two metrics to assess the quality of websites. The first was the DISCERN instrument, a validated questionnaire designed to assess the quality of patient-targeted health information for treatment choices. The second metric was the Essential Content Tool (ECT), a tool designed to address key components of counseling around periviable birth as outlined by professional organizations. DISCERN scores were classified as low quality if scores were 2, fair quality if scores were 3, and high quality if scores were 4 or higher. Scores of 6 or higher on the ECT were considered high quality. Interreviewer agreement was assessed by calculated kappa statistic.ResultsA total of 97 websites were reviewed. Over half (57/97, 59%) were for-profit sites, news stories, or personal blogs; 28% (27/97) were government or medical sites; and 13% (13/97) were nonprofit or advocacy sites. The majority of sites scored poorly in DISCERN questions designed to assess the reliability of information presented as well as data regarding treatment choices. Only 7% (7/97) of the websites were high quality as defined by the DISCERN tool. The majority of sites did not address the essential content defined by the ECT. Importantly, only 18% of websites (17/97) indicated that there are often a number of reasonable approaches to newborn care when faced with periviable birth. Agreement was strong, with kappa ranging from .72 to .91.ConclusionsMost information about periviable birth found on the Internet using common search strategies is of low quality. News stories highlighting positive outcomes are disproportionately represented. Few websites discuss comfort care or how treatment decisions impact quality of life.
| S-EPMC6716431 | biostudies-literature
Project description:Mass media plays an important role in the construction and circulation of risk perception associated with animals. Widely feared groups such as spiders frequently end up in the spotlight of traditional and social media. We compiled an expert-curated global database on the online newspaper coverage of human-spider encounters over the past ten years (2010-2020). This database includes information about the location of each human-spider encounter reported in the news article and a quantitative characterisation of the content-location, presence of photographs of spiders and bites, number and type of errors, consultation of experts, and a subjective assessment of sensationalism. In total, we collected 5348 unique news articles from 81 countries in 40 languages. The database refers to 211 identified and unidentified spider species and 2644 unique human-spider encounters (1121 bites and 147 as deadly bites). To facilitate data reuse, we explain the main caveats that need to be made when analysing this database and discuss research ideas and questions that can be explored with it.
| S-EPMC8960780 | biostudies-literature
Project description:BackgroundIn China, the internet has become one of the most important ways to obtain information about breast cancer. However, quantitative evaluations of the quality of Chinese health websites and the breast cancer treatment information they publish are lacking.ObjectiveThis study aimed to evaluate the quality of Chinese breast cancer websites and the value, suitability, and accuracy of the breast cancer treatment information they publish.MethodsChinese breast cancer health websites were searched and manually screened according to their Alexa and Baidu search engine rankings. For each website included in the survey, which was conducted on April 8, 2019, the three most recently published papers on the website that met the inclusion criteria were included for evaluation. Three raters assessed all materials using the LIDA, DISCERN, and Suitability Assessment of Materials (SAM) tools and the Michigan Checklist. Data analysis was completed with the Statistical Package for Social Sciences (SPSS) version 20.0 and Microsoft Excel 2010.ResultsThis survey included 20 Chinese breast cancer websites and 60 papers on breast cancer treatment. The LIDA tool was used to evaluate the quality of the 20 websites. The LIDA's scores of the websites (mean=54.85, SD 3.498; total possible score=81) were low. In terms of the layout, color scheme, search facility, browsing facility, integration of nontextual media, submission of comments, declaration of objectives, content production method, and robust method, more than half of the websites scored 0 (never) or 1 (sometimes). For the online breast cancer treatment papers, the scores were generally low. Regarding suitability, 32 (53.33%) papers were evaluated as presenting unsuitable material. Regarding accuracy, the problems were that the papers were largely not original (44/60, 73%) and lacked references (46/60, 77%).ConclusionsThe quality of Chinese breast cancer websites is poor. The color schemes, text settings, user comment submission functions, and language designs should be improved. The quality of Chinese online breast cancer treatment information is poor; the information has little value to users, and pictorial information is scarcely used. The online breast cancer treatment information is accurate but lacks originality and references. Website developers, governments, and medical professionals should play a full role in the design of health websites, the regulation of online health information, and the use of online health information.
| S-EPMC8663447 | biostudies-literature
Project description:ObjectiveAssessment of the readability and quality of online health information regarding parathyroidectomy.Study designCross-sectional analysis.SettingWebsites providing patient-oriented health information regarding parathyroidectomy obtained via the Google search engine.MethodsThe top 75 Google search results for "parathyroidectomy,""parathyroid surgery," and "parathyroid gland removal" were reviewed. Websites were categorized by website type and country of origin. Readability was assessed by Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook. Website quality was assessed per JAMA benchmark criteria and the DISCERN instrument.ResultsA total of 74 unique websites were evaluated. The mean readability of the assessed websites exceeded the recommended sixth-grade reading level on the Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook (P < .001). Readability did not vary significantly by website type. Websites originating from the United Kingdom were significantly more readable than those from the United States. The majority of assessed websites were of poor quality (n = 42, 56.8%) on assessment based on the DISCERN instrument. Quality varied significantly by website category on the JAMA benchmark criteria (P < .001) and DISCERN score (P = .049) with commercial websites receiving the highest scores. DISCERN score also varied significantly by country of origin (P = .036) with UK sites receiving highest mean DISCERN scores.ConclusionOnline health information regarding parathyroidectomy is largely of poor quality and is poorly readable for many patients. Institutions utilizing well-defined guidelines for development of patient educational resources may provide online health information of greater quality and readability.
| S-EPMC9597036 | biostudies-literature
Project description:BackgroundCommon information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions.MethodsWe applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use.ResultsMost features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements.ConclusionsThis network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition to existing information facilities in the field of OSH, but also to other healthcare fields struggling with how to answer questions from people in practice with high quality information. In the near future, we will focus on the use of the tool and its effects on information and knowledge dissemination.
| S-EPMC2987966 | biostudies-literature
Project description:Assessment of diet in large epidemiological studies can be costly and time consuming. An automated dietary assessment system could potentially reduce researcher burden by automatically coding food records. myfood24 (Measure Your Food on One Day) an online 24-h dietary assessment tool (with the flexibility to be used for multiple 24 h-dietary recalls or as a food diary), has been developed for use in the UK population. Development of myfood24 was a multi-stage process. Focus groups conducted with three age groups, adolescents (11-18 years) (n = 28), adults (19-64 years) (n = 24) and older adults (? 65 years) (n = 5) informed the development of the tool, and usability testing was conducted with beta (adolescents n = 14, adults n = 8, older adults n = 1) and live (adolescents n = 70, adults n = 20, older adults n = 4) versions. Median system usability scale (SUS) scores (measured on a scale of 0-100) in adolescents and adults were marginal for the beta version (adolescents median SUS = 66, interquartile range (IQR) = 20; adults median SUS = 68, IQR = 40) and good for the live version (adolescents median SUS = 73, IQR = 22; adults median SUS = 80, IQR = 25). Myfood24 is the first online 24-h dietary recall tool for use with different age groups in the UK. Usability testing indicates that myfood24 is suitable for use in UK adolescents and adults.
| S-EPMC4488770 | biostudies-literature
Project description:BackgroundPatients are increasingly utilizing the internet to learn about dietary and herbal supplements (DHSs) for various diseases/conditions, including pain management. Online health information has been found to be inconsistent and of poor quality in prior studies, which may have detrimental effects on patient health. This study assessed the quality of online DHSs consumer health information for pain.MethodsSix search items related to DHSs and pain were used to generate the first 20 websites on Google across four English-speaking countries. The identified 480 webpages produced 68 eligible websites, which were then evaluated using the DISCERN tool. The mean scores and standard deviations (SD) of the reviewers' ratings on each of the 15 DISCERN instrument items as well as the overall total score were calculated.ResultsThe mean summed score for the 68 eligible websites was 46.6 (SD = 10.1), and the mean overall rating was 3.3 (SD = 0.8). Websites lacked information regarding areas of uncertainty, the effects of no treatment being used, and how treatments affect the overall quality of life. These shortcomings were especially apparent across commercial websites, which frequently displayed bias, failed to report the risks of DHS products, and lacked support for shared decision-making regarding the use of DHSs.ConclusionVariability exists in the quality of online consumer health information regarding DHS use for pain. Healthcare providers should be aware of and provide guidance to patients regarding the identification of reliable online resources so that they can make informed decisions about DHS use for pain management.
| S-EPMC10623267 | biostudies-literature