Dataset Information

Current experience with applying the GRADE approach to public health interventions: an empirical study.

ABSTRACT:

Background

The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach has been adopted by many national and international organisations as a systematic and transparent framework for evidence-based guideline development. With reference to an ongoing debate in the literature and within public health organisations, this study reviews current experience with the GRADE approach in rating the quality of evidence in the field of public health and identifies challenges encountered.

Methods

We conducted semi-structured interviews with individuals/groups that have applied the GRADE approach in the context of systematic reviews or guidelines in the field of public health, as well as with representatives of groups or organisations that actively decided against its use. We initially contacted potential participants by email. Responses were obtained by telephone interview or email, and written interview summaries were validated with participants. We analysed data across individual interviews to distil common themes and challenges.

Results

Based on 25 responses, we undertook 18 interviews and obtained 15 in-depth responses relating to specific systematic reviews or guideline projects; a majority of the latter were contributed by groups within the World Health Organization. All respondents that have used the GRADE approach appreciated the systematic and transparent process of assessing the quality of the evidence. However, respondents reported a range of minor and major challenges relating to complexity of public health interventions, choice of outcomes and outcome measures, ability to discriminate between different types of observational studies, use of non-epidemiological evidence, GRADE terminology and the GRADE and guideline development process. Respondents' suggestions to make the approach more applicable to public health interventions included revisiting terminology, offering better guidance on how to apply GRADE to complex interventions and making modifications to the current grading scheme.

Conclusions

Our findings suggest that GRADE principles are applicable to public health and well-received but also highlight common challenges. They provide a starting point for exploring options for improvements and, where applicable, testing these across different types of public health interventions. Several public health organisations are currently testing GRADE, and the GRADE Working Group is eager to engage with these groups to find ways to address concerns.

SUBMITTER: Rehfuess EA

PROVIDER: S-EPMC3546302 | biostudies-literature | 2013 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Current experience with applying the GRADE approach to public health interventions: an empirical study.

Rehfuess Eva A EA Akl Elie A EA

BMC public health 20130108

<h4>Background</h4>The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach has been adopted by many national and international organisations as a systematic and transparent framework for evidence-based guideline development. With reference to an ongoing debate in the literature and within public health organisations, this study reviews current experience with the GRADE approach in rating the quality of evidence in the field of public health and identifies challenge ...[more]

PMID: 23294803

Similar Datasets

Project description:BackgroundAccurate, comprehensive, cause-specific mortality estimates are crucial for informing public health decision making worldwide. Incorrectly or vaguely assigned deaths, defined as garbage-coded deaths, mask the true cause distribution. The Global Burden of Disease (GBD) study has developed methods to create comparable, timely, cause-specific mortality estimates; an impactful data processing method is the reallocation of garbage-coded deaths to a plausible underlying cause of death. We identify the pattern of garbage-coded deaths in the world and present the methods used to determine their redistribution to generate more plausible cause of death assignments.MethodsWe describe the methods developed for the GBD 2019 study and subsequent iterations to redistribute garbage-coded deaths in vital registration data to plausible underlying causes. These methods include analysis of multiple cause data, negative correlation, impairment, and proportional redistribution. We classify garbage codes into classes according to the level of specificity of the reported cause of death (CoD) and capture trends in the global pattern of proportion of garbage-coded deaths, disaggregated by these classes, and the relationship between this proportion and the Socio-Demographic Index. We examine the relative importance of the top four garbage codes by age and sex and demonstrate the impact of redistribution on the annual GBD CoD rankings.ResultsThe proportion of least-specific (class 1 and 2) garbage-coded deaths ranged from 3.7% of all vital registration deaths to 67.3% in 2015, and the age-standardized proportion had an overall negative association with the Socio-Demographic Index. When broken down by age and sex, the category for unspecified lower respiratory infections was responsible for nearly 30% of garbage-coded deaths in those under 1 year of age for both sexes, representing the largest proportion of garbage codes for that age group. We show how the cause distribution by number of deaths changes before and after redistribution for four countries: Brazil, the United States, Japan, and France, highlighting the necessity of accounting for garbage-coded deaths in the GBD.ConclusionsWe provide a detailed description of redistribution methods developed for CoD data in the GBD; these methods represent an overall improvement in empiricism compared to past reliance on a priori knowledge.

Project description:BackgroundIn dealing with community spread of COVID-19, two active interventions have been attempted or advocated-containment, and mitigation. Given the extensive impact of COVID-19 globally, there is international interest to learn from best practices that have been shown to work in controlling community spread to inform future outbreaks. This study explores the trajectory of COVID-19 infection in Singapore had the government intervention not focused on containment, but rather on mitigation. In addition, we estimate the actual COVID-19 infection cases in Singapore, given that confirmed cases are publicly available.Methods and findingsWe developed a COVID-19 infection model, which is a modified SIR model that differentiate between detected (diagnosed) and undetected (undiagnosed) individuals and segments total population into seven health states: susceptible (S), infected asymptomatic undiagnosed (A), infected asymptomatic diagnosed (I), infected symptomatic undiagnosed (U), infected symptomatic diagnosed (E), recovered (R), and dead (D). To account for the infection stages of the asymptomatic and symptomatic infected individuals, the asymptomatic infected individuals were further disaggregated into three infection stages: (a) latent (b) infectious and (c) non-infectious; while the symptomatic infected were disaggregated into two stages: (a) infectious and (b) non-infectious. The simulation result shows that by the end of the current epidemic cycle without considering the possibility of a second wave, under the containment intervention implemented in Singapore, the confirmed number of Singaporeans infected with COVID-19 (diagnosed asymptomatic and symptomatic cases) is projected to be 52,053 (with 95% confidence range of 49,370-54,735) representing 0.87% (0.83%-0.92%) of the total population; while the actual number of Singaporeans infected with COVID-19 (diagnosed and undiagnosed asymptomatic and symptomatic infected cases) is projected to be 86,041 (81,097-90,986), which is 1.65 times the confirmed cases and represents 1.45% (1.36%-1.53%) of the total population. A peak in infected cases is projected to have occurred on around day 125 (27/05/2020) for the confirmed infected cases and around day 115 (17/05/2020) for the actual infected cases. The number of deaths is estimated to be 37 (34-39) among those infected with COVID-19 by the end of the epidemic cycle; consequently, the perceived case fatality rate is projected to be 0.07%, while the actual case fatality rate is estimated to be 0.043%. Importantly, our simulation model results suggest that there about 65% more COVID-19 infection cases in Singapore that have not been captured in the official reported numbers which could be uncovered via a serological study. Compared to the containment intervention, a mitigation intervention would have resulted in early peak infection, and increase both the cumulative confirmed and actual infection cases and deaths.ConclusionEarly public health measures in the context of targeted, aggressive containment including swift and effective contact tracing and quarantine, was likely responsible for suppressing the number of COVID-19 infections in Singapore.

Project description:ObjectivesThe objectives of this study are to (1) identify Graduate Public Health (GPH) programmes with an integrated practicum, (2) determine current practice for practicum design and (3) use the information to make recommendations to inform the design of Public Health Graduate programme practicums.DesignScoping review.Data sourcesAcademic Ranking World Universities 2019 was used to identify top 10 institutions in each geographical hub offering GPH programmes. Each GPH programme website was searched for practicum information.Eligibility criteriaGPH programmes offering a practice-based component as a requirement in their curriculum.Data extraction and synthesisOne reviewer screened GPH websites for eligibility and extracted data. Verification of data for accuracy and completeness was done on 10% of the sample by the second author. Data were compiled into an Excel file and were analysed to describe the duration, timing, credit, contact hours, preceptor requirements, prerequisites, objectives, deliverables and methods of evaluation of the practice-based component.ResultsOut of the 108 GPH programmes screened, a total of 35 programmes were included. There was a significant variation in required practicum duration ranging from 4 to 16 weeks. Only 31% specifically outlined prerequisites to be completed before the initiation of the practicum. More than half (57%) had a published list of core competencies. A majority of practicum did not provide criteria for appropriate preceptors (63%) and their responsibilities (66%). All programmes listed assessment criteria however the majority (57%) did not specify if the practicum was graded or a for-credit component.ConclusionsThe integration of practical components into curricula is inconsistent. This research resulted in 14 recommendations intended to guide GPH practicum design. We propose that this study be used as a tool to spark a global dialogue about best practices in GPH education through the identification of common practices and opportunities for improvement.

Project description:BACKGROUND:Digital health interventions (DHIs) are poised to reduce target symptoms in a scalable, affordable, and empirically supported way. DHIs that involve coaching or clinical support often collect text data from 2 sources: (1) open correspondence between users and the trained practitioners supporting them through a messaging system and (2) text data recorded during the intervention by users, such as diary entries. Natural language processing (NLP) offers methods for analyzing text, augmenting the understanding of intervention effects, and informing therapeutic decision making. OBJECTIVE:This study aimed to present a technical framework that supports the automated analysis of both types of text data often present in DHIs. This framework generates text features and helps to build statistical models to predict target variables, including user engagement, symptom change, and therapeutic outcomes. METHODS:We first discussed various NLP techniques and demonstrated how they are implemented in the presented framework. We then applied the framework in a case study of the Healthy Body Image Program, a Web-based intervention trial for eating disorders (EDs). A total of 372 participants who screened positive for an ED received a DHI aimed at reducing ED psychopathology (including binge eating and purging behaviors) and improving body image. These users generated 37,228 intervention text snippets and exchanged 4285 user-coach messages, which were analyzed using the proposed model. RESULTS:We applied the framework to predict binge eating behavior, resulting in an area under the curve between 0.57 (when applied to new users) and 0.72 (when applied to new symptom reports of known users). In addition, initial evidence indicated that specific text features predicted the therapeutic outcome of reducing ED symptoms. CONCLUSIONS:The case study demonstrates the usefulness of a structured approach to text data analytics. NLP techniques improve the prediction of symptom changes in DHIs. We present a technical framework that can be easily applied in other clinical trials and clinical presentations and encourage other groups to apply the framework in similar contexts.

Dataset Information

Current experience with applying the GRADE approach to public health interventions: an empirical study.

Background

Methods

Results

Conclusions

Publications

Current experience with applying the GRADE approach to public health interventions: an empirical study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets