Dataset Information

The development and validation of an instrument to measure the quality of health research reports in the lay media.

ABSTRACT:

Background

The media serves as an important link between medical research, as reported in scholarly sources, and the public and has the potential to act as a powerful tool to improve public health. However, concerns about the reliability of health research reports have been raised. Tools to monitor the quality of health research reporting in the media are needed to identify areas of weakness in health research reporting and to subsequently work towards the efficient use of the lay media as a public health tool through which the public's health behaviors can be improved.

Methods

We developed the Quality Index for health-related Media Reports (QIMR) as a tool to monitor the quality of health research reports in the lay media. The tool was developed according to themes generated from interviews with health journalists and researchers. Item and domain characteristics and scale reliability were assessed. The scale was correlated with a global quality assessment score and media report word count to provide evidence towards its construct validity.

Results

The items and domains of the QIMR demonstrated acceptable validity and reliability. Items from the 'validity' domain were negatively skewed, suggesting possible floor effect. These items were not eliminated due to acceptable content and face validity. QIMR total scores produced a strong correlation with raters' global assessment and a moderate correlation with media report word count, providing evidence towards the construct validity of the instrument.

Conclusions

The results of this investigation indicate that QIMR can adequately measure the quality of health research reports, with acceptable reliability and validity.

SUBMITTER: Zeraatkar D

PROVIDER: S-EPMC5397754 | biostudies-literature | 2017 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The development and validation of an instrument to measure the quality of health research reports in the lay media.

Zeraatkar Dena D Obeda Michael M Ginsberg Jeffrey S JS Hirsh Jack J

BMC public health 20170420 1

<h4>Background</h4>The media serves as an important link between medical research, as reported in scholarly sources, and the public and has the potential to act as a powerful tool to improve public health. However, concerns about the reliability of health research reports have been raised. Tools to monitor the quality of health research reporting in the media are needed to identify areas of weakness in health research reporting and to subsequently work towards the efficient use of the lay media ...[more]

PMID: 28427426

Similar Datasets

Project description:Health-related quality of life (HRQOL) is one of the most important outcome measures to be assessed by medical research. This study aims to develop and validate an instrument called the "health-related quality of life with six domains" (HRQ-6D), which aims to measure an individual's health-related quality of life within a 24 h period of time. This is a questionnaire development study involving five phases, which are (i) to explore the subject matter content for gaining a better understanding of the topic, (ii) to develop the questionnaire, (iii) to assess both its content validity and face validity, (iv) to conduct a pilot study, and finally, (v) to undertake a field testing of the questionnaire. For the field-testing phase, a cross-sectional study involving a self-administered survey for HRQ-6D items was conducted among healthcare workers with various health conditions. Exploratory factor analysis was initially applied to construct the major dimensions of the HRQ-6D. Confirmatory factor analysis was subsequently applied to evaluate the model fit of the overall framework of the HRQ-6D. The clinical utility of this HRQ-6D was also assessed via its association with actual clinical evidence. A total of 406 respondents participated in the survey. Six domains were identified from the analysis, namely "pain", "physical strength", "emotion", "self-care", "mobility", and "perception of future health" comprising two items in each domain. Each domain was reported to have a minimum value of Cronbach's alpha of 0.731, and the model fit for the overall framework of the HRQ-6D was also found to be excellent. Exploratory factor analysis was undertaken for the 12 items of the HRQ-6D. All the domains can be categorized into three major dimensions, namely "health", "body function", and "future perception", with a minimum value for their factor loadings of at least 0.507. A notable finding was that the HRQ-6D was significantly associated with an individual's existing comorbidities and current status of health (p < 0.05). This study successfully validated the HRQ-6D, and we found it to possess both excellent levels of reliability and validity and a satisfactory degree of model fit; it was also significantly associated with actual clinical evidence.

Project description:BackgroundThis paper describes the development of the Chinese Quality of Life Instrument (ChQOL) which is a self-report health status instrument. Chinese Medicine relies very much on asking subjective feelings of patients in the process of diagnosis and monitoring of treatment. For thousands of years, Chinese Medicine practitioners have accumulated a good wealth of experiences in asking questions about health of their patients based on the concept of health in Chinese Medicine. These experiences were then transformed into questions for the ChQOL. It is believed that ChQOL can contribute to the existing Patient Report Outcome measures. This paper outlines the concept of health and disease in Traditional Chinese Medicine, the building of the conceptual framework of the ChQOL, the steps of drafting, selecting and validating the items, and the psychometric properties of the ChQOL.MethodsThe development of the ChQOL was based on the concept of health in Traditional Chinese Medicine with a theory driven approach. Based on the results of literature review, the research team developed an initial model of health which encompassed the concept of health in TCM. An expert panel was then invited to comment and give suggestions for improvement of the initial model. According to their suggestions, the model was refined and a set of initial items for the ChQOL was drafted. The refined model, together with the key domains, facets and initial items of the ChQOL were then mailed to a sample of about 100 Chinese medicine practitioners throughout Mainland China for their comments and advice. A revised set of items were developed for linguistic testing by a convenience sample consisting of both healthy people and people who attended Chinese Medicine treatment. After that, an item pool was developed for field-testing. Field test was conducted on a convenience sample of healthy and patient subjects to determine the construct validity and psychometric properties of the ChQOL.ResultsConstruct validity was established by various methods, i.e. the internal consistency in all facets and domains were good; the correlation between facets to domain, and domains to overall ChQOL correlation were high; confirmatory factor analysis showed that the structure fitness of all facets, domain and overall structure were good with CFI > 0.9. Test-retest reliability was also good, especially in the domain scores with ICC value ranging from 0.83 to 0.90. No ceiling or floor effect was noted which indicated that ChQOL can be applied to subjects with a wide range of health status. Most facet scores, domain scores and the overall CHQOL scores were able to discriminate groups of subjects with known differences in health status. The ChQOL had mild positive convergence with the other generic health related QOL measures, i.e. the WHOQOL-100 and the SF-36, with moderate correlations.ConclusionIn conclusion, the study indicated that the ChQOL is conceptually valid with satisfactory psychometric properties. It can provide additional information on health and QOL on top of the existing generic health related QOL measures. Furthermore, it forms basis for further testing and applications in clinical trials.

Project description:Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument.The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined.Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years.The AEQ is a valid and reliable instrument. Initial validation supports its use to measure students' perceptions of the assessment environment in an undergraduate medical program.

Project description:BackgroundEvaluation of health-related quality of life (HRQoL) is considered an important aspect of clinical assessment and health research. Chronic Otitis Media (COM) is related to the quality of life deterioration subsequent to COM symptoms, social communication impairments, and lower work performance. However, there is no reliable information regarding the impact of this disease on health and quality of life in many resource-poor countries. Therefore, we translated into Spanish the Chronic Otitis Media Questionnaire-12 (COMQ-12) for the evaluation of HRQoL of Chronic Otitis Media (COM) in adult patients. Also, we assessed the psychometric properties of the Spanish version of the questionnaire.MethodsTwo otology referral centers in Bogotá, Colombia were included. The Spanish version of COMQ-12 was applied twice to 200 adult patients with confirmed COM diagnosis and 31 healthy controls to perform the validation process and assess the internal consistency of this questionnaire. Psychometric characteristics (internal consistency, test-retest reliability, and construct validity) of the COMQ-12 were assessed. Exploratory Factor Analysis and Confirmatory Factor Analysis were conducted via structural equation modeling to test the questionnaire's structure.ResultsThe Spanish version of the COMQ-12 showed good internal consistency (Cronbach's Alpha: 0.86, McDonald's Omega: 0.89). Coefficients corresponding to Lin's Concordance test and test-retest reliability were 0.95 and 0.83 respectively. Correlation between the Visual Analogue Scale (VAS) and the COMQ-12 was 0.68 (95% CI 0.59-0.75, p value < 0.001). Factor analysis of the Spanish version of the COMQ-12 indicated a questionnaire structure with three domains: smelly discharge related symptoms; hearing loss related symptoms; and impact on work, lifestyle, and health services.ConclusionThis Spanish version of the COMQ-12 showed high reliability and high internal consistency. This questionnaire can be used as an objective clinical tool to assess the HRQoL of patients who have a COM diagnosis.Trial registrationHospital Universitario Fundación Santa Fe, Ethical Committee Registration ID: CCEI-8807-2018. Hospital de San José, Ethical Committee: Record number 500, DI-I-0632-18.

Dataset Information

The development and validation of an instrument to measure the quality of health research reports in the lay media.

Background

Methods

Results

Conclusions

Publications

The development and validation of an instrument to measure the quality of health research reports in the lay media.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets