Dataset Information

A critical review of methods to evaluate the impact of FDA regulatory actions.

ABSTRACT: To conduct a synthesis of the literature on methods to evaluate the impacts of FDA regulatory actions and identify best practices for future evaluations.We searched MEDLINE for manuscripts published between January 1948 and August 2011 that included terms related to FDA, regulatory actions, and empirical evaluation; the review additionally included FDA-identified literature. We used a modified Delphi method to identify preferred methodologies. We included studies with explicit methods to address threats to validity and identified designs and analytic methods with strong internal validity that have been applied to other policy evaluations.We included 18 studies out of 243 abstracts and papers screened. Overall, analytic rigor in prior evaluations of FDA regulatory actions varied considerably; less than a quarter of studies (22%) included control groups. Only 56% assessed changes in the use of substitute products/services, and 11% examined patient health outcomes. Among studies meeting minimal criteria of rigor, 50% found no impact or weak/modest impacts of FDA actions and 33% detected unintended consequences. Among those studies finding significant intended effects of FDA actions, all cited the importance of intensive communication efforts. There are preferred methods with strong internal validity that have yet to be applied to evaluations of FDA regulatory actions.Rigorous evaluations of the impact of FDA regulatory actions have been limited and infrequent. Several methods with strong internal validity are available to improve trustworthiness of future evaluations of FDA policies.

SUBMITTER: Briesacher BA

PROVIDER: S-EPMC3825208 | biostudies-literature | 2013 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A critical review of methods to evaluate the impact of FDA regulatory actions.

Briesacher Becky A BA Soumerai Stephen B SB Zhang Fang F Toh Sengwee S Andrade Susan E SE Wagner Joann L JL Shoaibi Azadeh A Gurwitz Jerry H JH

Pharmacoepidemiology and drug safety 20130712 9

<h4>Purpose</h4>To conduct a synthesis of the literature on methods to evaluate the impacts of FDA regulatory actions and identify best practices for future evaluations.<h4>Methods</h4>We searched MEDLINE for manuscripts published between January 1948 and August 2011 that included terms related to FDA, regulatory actions, and empirical evaluation; the review additionally included FDA-identified literature. We used a modified Delphi method to identify preferred methodologies. We included studies ...[more]

PMID: 23847020

Similar Datasets

Project description:BackgroundPersistent income inequality, the increase in precarious employment, the inadequacy of many welfare systems, and economic impact of the COVID-19 pandemic have increased interest in Basic Income (BI) interventions. Ensuring that social interventions, such as BI, are evaluated appropriately is key to ensuring their overall effectiveness. This systematic review therefore aims to report on available methods and domains of assessment, which have been used to evaluate BI interventions. These findings will assist in informing future program and research development and implementation.MethodsStudies were identified through systematic searches of the indexed and grey literature (Databases included: Scopus, Embase, Medline, CINAHL, Web of Science, ProQuest databases, EBSCOhost Research Databases, and PsycINFO), hand-searching reference lists of included studies, and recommendations from experts. Citations were independently reviewed by two study team members. We included studies that reported on methods used to evaluate the impact of BI, incorporated primary data from an observational or experimental study, or were a protocol for a future BI study. We extracted information on the BI intervention, context and evaluation method.Results86 eligible articles reported on 10 distinct BI interventions from the last six decades. Workforce participation was the most common outcome of interest among BI evaluations in the 1960-1980 era. During the 2000s, studies of BI expanded to include outcomes related to health, educational attainment, housing and other key facets of life impacted by individuals' income. Many BI interventions were tested in randomized controlled trials with data collected through surveys at multiple time points.ConclusionsOver the last two decades, the assessment of the impact of BI interventions has evolved to include a wide array of outcomes. This shift in evaluation outcomes reflects the current hypothesis that investing in BI can result in lower spending on health and social care. Methods of evaluation ranged but emphasized the use of randomization, surveys, and existing data sources (i.e., administrative data). Our findings can inform future BI intervention studies and interventions by providing an overview of how previous BI interventions have been evaluated and commenting on the effectiveness of these methods.RegistrationThis systematic review was registered with PROSPERO (CRD 42016051218).

Project description:BackgroundCombination prevention is currently considered the best approach to combat HIV epidemic. It is based upon the combination of structural, behavioral, and biomedical interventions. Such interventions are frequently implemented in a health-promoting manner due to their aims, the approach that was adopted, and their complexity. The impact evaluation of these interventions often relies on methods inherited from the biomedical field. However, these methods have limitations and should be adapted to be relevant for these complex interventions. This systematic review aims to map the evidence-based methods used to quantify the impact of these interventions and analyze how these methods are implemented.MethodsThree databases (Web of Science, Scopus, PubMed) will be used to identify impact evaluation studies of health promotion interventions that aimed at reducing the incidence or prevalence of HIV infection. Only studies based on quantitative design assessing intervention impact on HIV prevalence or incidence will be included. Two reviewers will independently screen studies based on titles and abstracts and then on the full text. The information about study characteristics will be extracted to understand the context in which the interventions are implemented. The information specific to quantitative methods of impact evaluation will be extracted using items from the Mixed Methods Appraisal Tool (MMAT), the guidelines for reporting Statistical Analyses and Methods in the Published Literature (SAMPL), and the guidelines for Strengthening The Reporting of Empirical Simulation Studies (STRESS). This review will be conducted according to the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) statement.DiscussionThe impact evaluation of HIV prevention interventions is a matter of substantial importance given the growing need for evidence of the effectiveness of these interventions, whereas they are increasingly complex. These evaluations allow to identify the most effective strategies to be implemented to fight the epidemic. It is therefore relevant to map the methods to better implement them and adapt them according to the type of intervention to be evaluated.Systematic review registrationPROSPERO CRD42020210825.

Project description:Biofilms are multicellular communities of bacteria that can adhere to virtually any surface. Bacterial biofilms are clinically relevant, as they are responsible for up to two-thirds of hospital acquired infections and contribute to chronic infections. Troublingly, the bacteria within a biofilm are adaptively resistant to antibiotic treatment and it can take up to 1000 times more antibiotic to kill cells within a biofilm when compared to planktonic bacterial cells. Identifying and optimizing compounds that specifically target bacteria growing in biofilms is required to address this growing concern and the reported antibiofilm activity of natural and synthetic host defence peptides has garnered significant interest. However, a standardized assay to assess the activity of antibiofilm agents has not been established. In the present work, we describe two simple assays that can assess the inhibitory and eradication capacities of peptides towards biofilms that are formed by both Gram-positive and negative bacteria. These assays are suitable for high-throughput workflows in 96-well microplates and they use crystal violet staining to quantify adhered biofilm biomass as well as tetrazolium chloride dye to evaluate the metabolic activity of the biofilms. The effect of media composition on the readouts of these biofilm detection methods was assessed against two strains of Pseudomonas aeruginosa (PAO1 and PA14), as well as a methicillin resistant strain of Staphylococcus aureus. Our results demonstrate that media composition dramatically alters the staining patterns that were obtained with these dye-based methods, highlighting the importance of establishing appropriate biofilm growth conditions for each bacterial species to be evaluated. Confocal microscopy imaging of P. aeruginosa biofilms grown in flow cells revealed that this is likely due to altered biofilm architecture under specific growth conditions. The antibiofilm activity of several antibiotics and synthetic peptides were then evaluated under both inhibition and eradication conditions to illustrate the type of data that can be obtained using this experimental setup.

Dataset Information

A critical review of methods to evaluate the impact of FDA regulatory actions.

Publications

A critical review of methods to evaluate the impact of FDA regulatory actions.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets