Dataset Information

A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study.

ABSTRACT:

Background

Concern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no standard quality assessment tool available for online newspapers.

Objective

This study aimed to develop the Health Information Quality Assessment Tool (HIQUAL) for online newspaper articles.

Methods

We reviewed previous health information quality assessment tools and related studies and accordingly developed and customized new criteria. The interrater agreement for the new assessment tool was assessed for 3 newspaper articles on different subjects (colorectal cancer, obesity genetic testing, and hypertension diagnostic criteria) using the Fleiss κ and Gwet agreement coefficient. To compare the quality scores generated by each pair of tools, convergent validity was measured using the Kendall τ ranked correlation.

Results

Overall, the HIQUAL for newspaper articles comprised 10 items across 5 domains: reliability, usefulness, understandability, sufficiency, and transparency. The interrater agreement for the article on colorectal cancer was in the moderate to substantial range (Fleiss κ=0.48, SE 0.11; Gwet agreement coefficient=0.74, SE 0.13), while for the article introducing obesity genetic testing it was in the substantial range, with values of 0.63 (SE 0.28) and 0.86 (SE 0.10) for the two measures, respectively. There was relatively low agreement for the article on hypertension diagnostic criteria at 0.20 (SE 0.10) and 0.75 (SE 0.13), respectively. Validity of the correlation assessed with the Kendall τ showed good correlation between tools (HIQUAL vs DISCERN=0.72, HIQUAL vs QUEST [Quality Evaluation Scoring Tool]=0.69).

Conclusions

We developed a new assessment tool to evaluate the quality of health information in online newspaper articles, to help consumers discern accurate sources of health information. The HIQUAL can help increase the accuracy and quality of online health information in Korea.

SUBMITTER: Lee N

PROVIDER: S-EPMC8367132 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe internet is commonly used by older adults to obtain health information and this trend has markedly increased in the past decade. However, studies illustrate that much of the available online health information is not informed by good quality evidence, developed in a transparent way, or easy to use. Furthermore, studies highlight that the general public lacks the skills necessary to distinguish between online products that are credible and trustworthy and those that are not. A number of tools have been developed to assess the evidence, transparency, and usability of online health information; however, many have not been assessed for reliability or ease of use.ObjectiveThe first objective of this study was to determine if a tool assessing the evidence, transparency, and usability of online health information exists that is easy and quick to use and has good reliability. No such tool was identified, so the second objective was to develop such a tool and assess it for reliability when used to assess online health information on topics of relevant to optimal aging.MethodsAn electronic database search was conducted between 2002 and 2012 to identify published papers describing tools that assessed the evidence, transparency, and usability of online health information. Papers were retained if the tool described was assessed for reliability, assessed the quality of evidence used to create online health information, and was quick and easy to use. When no one tool met expectations, a new instrument was developed and tested for reliability. Reliability between two raters was assessed using the intraclass correlation coefficient (ICC) for each item at two time points. SPSS Statistics 22 software was used for statistical analyses and a one-way random effects model was used to report the results. The overall ICC was assessed for the instrument as a whole in July 2015. The threshold for retaining items was ICC>0.60 (ie, "good" reliability).ResultsAll tools identified that evaluated online health information were either too complex, took a long time to complete, had poor reliability, or had not undergone reliability assessment. A new instrument was developed and assessed for reliability in April 2014. Three items had an ICC<0.60 (ie, "good" reliability). One of these items was removed ("minimal scrolling") and two were retained but reworded for clarity. Four new items were added that assessed the level of research evidence that informed the online health information and the tool was retested in July 2015. The total ICC score showed excellent agreement with both single measures (ICC=0.988; CI 0.982-0.992) and average measures (ICC=0.994; CI 0.991-0.996).ConclusionsThe results of this study suggest that this new tool is reliable for assessing the evidence, transparency, and usability of online health information that is relevant to optimal aging.

Project description:BackgroundOver 20,000 parents in the United States face the challenge of participating in decisions about whether to use life support for their infants born on the cusp of viability every year. Clinicians must help families grasp complex medical information about their baby's immediate prognosis as well as the risk for significant long-term morbidity. Patients faced with this decision want supplemental information and frequently seek medical information on the Internet. Empirical evidence about the quality of websites is lacking.ObjectiveWe sought to evaluate the quality of online information available about periviable birth and treatment options for infants born at the cusp of viability.MethodsWe read a counseling script to 20 pregnant participants that included information typically provided by perinatal and neonatal providers when periviable birth is imminent. The women were then asked to list terms they would use to search the Internet if they wanted additional information. Using these search terms, two reviewers evaluated the content of websites obtained via a Google search. We used two metrics to assess the quality of websites. The first was the DISCERN instrument, a validated questionnaire designed to assess the quality of patient-targeted health information for treatment choices. The second metric was the Essential Content Tool (ECT), a tool designed to address key components of counseling around periviable birth as outlined by professional organizations. DISCERN scores were classified as low quality if scores were 2, fair quality if scores were 3, and high quality if scores were 4 or higher. Scores of 6 or higher on the ECT were considered high quality. Interreviewer agreement was assessed by calculated kappa statistic.ResultsA total of 97 websites were reviewed. Over half (57/97, 59%) were for-profit sites, news stories, or personal blogs; 28% (27/97) were government or medical sites; and 13% (13/97) were nonprofit or advocacy sites. The majority of sites scored poorly in DISCERN questions designed to assess the reliability of information presented as well as data regarding treatment choices. Only 7% (7/97) of the websites were high quality as defined by the DISCERN tool. The majority of sites did not address the essential content defined by the ECT. Importantly, only 18% of websites (17/97) indicated that there are often a number of reasonable approaches to newborn care when faced with periviable birth. Agreement was strong, with kappa ranging from .72 to .91.ConclusionsMost information about periviable birth found on the Internet using common search strategies is of low quality. News stories highlighting positive outcomes are disproportionately represented. Few websites discuss comfort care or how treatment decisions impact quality of life.

Project description:BackgroundIn China, the internet has become one of the most important ways to obtain information about breast cancer. However, quantitative evaluations of the quality of Chinese health websites and the breast cancer treatment information they publish are lacking.ObjectiveThis study aimed to evaluate the quality of Chinese breast cancer websites and the value, suitability, and accuracy of the breast cancer treatment information they publish.MethodsChinese breast cancer health websites were searched and manually screened according to their Alexa and Baidu search engine rankings. For each website included in the survey, which was conducted on April 8, 2019, the three most recently published papers on the website that met the inclusion criteria were included for evaluation. Three raters assessed all materials using the LIDA, DISCERN, and Suitability Assessment of Materials (SAM) tools and the Michigan Checklist. Data analysis was completed with the Statistical Package for Social Sciences (SPSS) version 20.0 and Microsoft Excel 2010.ResultsThis survey included 20 Chinese breast cancer websites and 60 papers on breast cancer treatment. The LIDA tool was used to evaluate the quality of the 20 websites. The LIDA's scores of the websites (mean=54.85, SD 3.498; total possible score=81) were low. In terms of the layout, color scheme, search facility, browsing facility, integration of nontextual media, submission of comments, declaration of objectives, content production method, and robust method, more than half of the websites scored 0 (never) or 1 (sometimes). For the online breast cancer treatment papers, the scores were generally low. Regarding suitability, 32 (53.33%) papers were evaluated as presenting unsuitable material. Regarding accuracy, the problems were that the papers were largely not original (44/60, 73%) and lacked references (46/60, 77%).ConclusionsThe quality of Chinese breast cancer websites is poor. The color schemes, text settings, user comment submission functions, and language designs should be improved. The quality of Chinese online breast cancer treatment information is poor; the information has little value to users, and pictorial information is scarcely used. The online breast cancer treatment information is accurate but lacks originality and references. Website developers, governments, and medical professionals should play a full role in the design of health websites, the regulation of online health information, and the use of online health information.

Project description:BackgroundCommon information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions.MethodsWe applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use.ResultsMost features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements.ConclusionsThis network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition to existing information facilities in the field of OSH, but also to other healthcare fields struggling with how to answer questions from people in practice with high quality information. In the near future, we will focus on the use of the tool and its effects on information and knowledge dissemination.

Project description:BackgroundThe Internet is a frequently used source of health information. Adolescents in particular seem to be receptive to online health information (OHI) and often incorporate such information in their decision-making processes. Yet, OHI is often incomplete, inaccurate, or unreliable. This study assessed the quality of Hebrew online (non-user-generated) content on oral contraceptives (OC), with regard to accuracy/completeness, credibility, and usability.MethodsTwenty-nine websites in Hebrew, including those of the four Israeli HMOs, were identified and evaluated. The websites were categorized as: HMO, health portal, contraception-specific, promotional-commercial, and life style and women's health. A set of established content parameters was selected by a family planning expert to assess accuracy/completeness. The Health on the Net Foundation Code of Conduct (HONcode) principles were used to assess the websites' reliability. Usability was assessed by applying items selected from the Minervation Validation and the University of Michigan's 'Website Evaluation checklist' scale. Mean scores, standard deviations (SD), and ranges were calculated for all websites and for category-specific websites. Correlation between dimensions and Inter-rater reliability were also examined.ResultsThe mean score for accuracy/completeness was 50.9% for all websites (SD=30.1%, range 8-100%). Many websites failed to provide complete information, or provided inaccurate information regarding what to do when a pill is missed and when to use back-up methods. The average credibility score for all websites was 70.6% (SD=15.1, range=38=98%). The credibility parameters that were most commonly absent were funding source, authoring, date of content creation and last modification, explicit reference to evidence-based information, and references and citations. The average usability score for all websites was 94.5% (SD=6.9%, range 79-100%). A weak correlation was found between the three quality parameters assessed.ConclusionsWide variation was noted in the quality of Hebrew-language OC websites. HMOs' websites scored highest on credibility and usability, and contraceptive-specific websites exhibited the greatest accuracy/completeness. The findings highlight the need to establish quality guidelines for health website content, train health care providers in assisting their patients to seek high quality OHI, and strengthen e-health literacy skills among online-information seekers, including perhaps health professionals.