Dataset Information

The evidence base for psychotropic drugs approved by the European Medicines Agency: a meta-assessment of all European Public Assessment Reports.

ABSTRACT:

Aims

To systematically assess the level of evidence for psychotropic drugs approved by the European Medicines Agency (EMA).

Methods

Cross-sectional analysis of all European Public Assessment Reports (EPARs) and meta-analyses of the many studies reported in these EPARs. Eligible EPARs were identified from the EMA's website and individual study reports were requested from the Agency when necessary. All marketing authorisation applications (defined by the drug, the route of administration and given indications) for psychotropic medications for adults (including drugs used in psychiatry and addictology) were considered. EPARs solely based on bioequivalence studies were excluded. Our primary outcome measure was the presence of robust evidence of comparative effectiveness, defined as at least two 'positive' superiority studies against an active comparator. Various other features of the approvals were assessed, such as evidence of non-inferiority v. active comparator and superiority v. placebo. For studies with available data, effect sizes were computed and pooled using a random effect meta-analysis for each dose of each drug in each indication.

Results

Twenty-seven marketing authorisations were identified. For one, comparative effectiveness was explicitly considered as not needed in the EPAR. Of those remaining, 21/26 (81%) did not provide any evidence of superiority against an active comparator, 2/26 (8%) were based on at least two trials showing superiority against active comparator and three (11%) were based on one positive trial; 1/26 provided evidence for two positive non-inferiority analyses v. active comparator and seven (26%) provided evidence for one. In total, 20/27 (74%) evaluations reported evidence of superiority v. placebo with two or more trials. Among the meta-analyses of initiation studies against active comparator (57 available comparisons), the median effect size was 0.051 (range -0.503; 0.318). Twenty approved evaluations (74%) reported evidence of superiority v. placebo on the basis of two or more initiation trials and seven based on a single trial. Among meta-analyses of initiation studies against placebo (125 available comparisons), the median effect size was -0.283 (range -0.820; 0.091). Importantly, among the 89 study reports requested on the EMA website, only 19 were made available 1 year after our requests.

Conclusions

The evidence for psychiatric drug approved by the EMA was in general poor. Small to modest effects v. placebo were considered sufficient in indications where an earlier drug exists. Data retrieval was incomplete after 1 year despite EMA's commitment to transparency. Improvements are needed.

SUBMITTER: Erhel F

PROVIDER: S-EPMC7214735 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The evidence base for psychotropic drugs approved by the European Medicines Agency: a meta-assessment of all European Public Assessment Reports.

Erhel Florian F Scanff Alexandre A Naudet Florian F

Epidemiology and psychiatric sciences 20200427

<h4>Aims</h4>To systematically assess the level of evidence for psychotropic drugs approved by the European Medicines Agency (EMA).<h4>Methods</h4>Cross-sectional analysis of all European Public Assessment Reports (EPARs) and meta-analyses of the many studies reported in these EPARs. Eligible EPARs were identified from the EMA's website and individual study reports were requested from the Agency when necessary. All marketing authorisation applications (defined by the drug, the route of administr ...[more]

PMID: 32336312

Similar Datasets

Project description:BackgroundTransparency and reproducibility are expected to be normative practices in clinical trials used for decision-making on marketing authorisations for new medicines. This registered report introduces a cross-sectional study aiming to assess inferential reproducibility for main trials assessed by the European Medicines Agency.MethodsTwo researchers independently identified all studies on new medicines, biosimilars and orphan medicines given approval by the European Commission between January 2017 and December 2019, categorised as 'main studies' in the European Public Assessment Reports (EPARs). Sixty-two of these studies were randomly sampled. One researcher retrieved the individual patient data (IPD) for these studies and prepared a dossier for each study, containing the IPD, the protocol and information on the conduct of the study. A second researcher who had no access to study reports used the dossier to run an independent re-analysis of each trial. All results of these re-analyses were reported in terms of each study's conclusions, p-values, effect sizes and changes from the initial protocol. A team of two researchers not involved in the re-analysis compared results of the re-analyses with published results of the trial.ResultsTwo hundred ninety-two main studies in 173 EPARs were identified. Among the 62 studies randomly sampled, we received IPD for 10 trials. The median number of days between data request and data receipt was 253 [interquartile range 182-469]. For these ten trials, we identified 23 distinct primary outcomes for which the conclusions were reproduced in all re-analyses. Therefore, 10/62 trials (16% [95% confidence interval 8% to 28%]) were reproduced, as the 52 studies without available data were considered non-reproducible. There was no change from the original study protocol regarding the primary outcome in any of these ten studies. Spin was observed in the report of one study.ConclusionsDespite their results supporting decisions that affect millions of people's health across the European Union, most main studies used in EPARs lack transparency and their results are not reproducible for external researchers. Re-analyses of the few trials with available data showed very good inferential reproducibility.Trial registrationhttps://osf.io/mcw3t/.

Project description:ObjectivesTo evaluate the added benefit and revenues of oncology drugs, explore their association, and investigate potential discrepancies between added benefit and revenues across different approval pathways of the European Medicines Agency (EMA).DesignRetrospective cohort study.SettingOncology drugs and their indications approved by the EMA between 1995 and 2020.Main outcome measuresAdded benefit was evaluated using ratings published by seven organisations: health technology assessment agencies from the United States, France, Germany, and Italy, two medical oncology societies, and a drug bulletin. All retrieved ratings were recategorised using a four point ranking scale to indicate negative or non-quantifiable, minor, substantial, or major added benefit. Revenue data were extracted from publicly available financial reports and compared with published estimates of research and development (R&D) costs. Finally, the association between added benefit and revenue was evaluated. All analyses were performed within the overall study cohort, and within subgroups based on the EMA approval pathway: standard marketing authorisation, conditional marketing authorisation, and authorisation under exceptional circumstances.Results131 oncology drugs with 166 indications were evaluated for their added benefit by at least one organisation within the required timeframe, yielding a total of 458 added benefit ratings; 189 (41%) were negative or non-quantifiable. The median time to offset the median R&D costs ($684m, £535m, €602m, adjusted to 2020 values) was three years; 50 of 55 (91%) drugs recovered these costs within eight years. Drugs with higher added benefit ratings generally had greater revenues. Negative or non-quantifiable added benefit ratings were more frequent for conditional marketing authorisations and authorisations under exceptional circumstances than for standard marketing authorisations (relative risk 1.53, 95% confidence interval 1.23 to 1.89). Conditional marketing authorisations generated lower revenues and took longer to offset R&D costs than standard marketing authorisations (four years compared with three years).ConclusionsWhile revenues seem to align with added benefit, most oncology drugs recover R&D costs within a few years despite providing little added benefit. This is particularly true for drugs approved through conditional marketing authorisations, which inherently appear to lack comprehensive evidence. Policy makers should evaluate whether current regulatory and reimbursement incentives effectively promote development of the most effective drugs for patients with the greatest needs.

Project description:BACKGROUND:Clinical study reports (CSRs) have been increasingly utilised within academic research in recent years. European Medicines Agency (EMA) Policy 0070 'Phase 1,' which came into effect in January 2015, requires the publication of regulatory documents such as CSRs from central applications in an anonymised format. EMA Policy 0070 requires sponsors to demonstrate careful consideration of data utility within anonymised CSRs published within the scope of the policy, yet the concept of data utility is not clearly defined in the associated anonymisation guidance. OBJECTIVE:To review the use of data from CSRs in published academic research and to hypothesise the potential data utility of CSRs anonymised under the objectives of EMA Policy 0070 for future academic research. METHODS:Review of the objectives, research methodologies and findings of academic research reports using unpublished data from CSRs (prior to EMA Policy 0070). Semi-structured interviews with authors of academic research reports, including questions related to data utility of anonymised CSRs published under EMA Policy 0070. RESULTS:Thirteen academic research reports were identified and reviewed. The research purposes ranged from assessment of reporting bias, comparison of methods and results with published data sources, detailed evaluation of harms and adverse events, re-analysis and novel analyses including systematic reviews and meta-analysis. All of the examples identified required access to the methods and results sections of CSRs (including aggregated summary tables) and research purposes relating to evaluation of adverse events also required access to participant narratives. Retaining anonymised participant narratives relating to interventions, findings and events, while maintaining an acceptably low risk of participant re-identification, may provide an important gain in data utility and further understanding of drug safety profiles. CONCLUSIONS:This work provides an initial insight into the previous use of CSR data and current practices for including regulatory data in academic research. This work also provides early guidance to qualitatively assess and document data utility within anonymised CSRs published under EMA Policy 0070.

Project description:ImportanceFor patients with cancer treated with palliative intent, quality of life (QOL) is a critical aspect of treatment decision-making, alongside survival. However, regulatory approval can be based solely on survival measures or antitumor activities, without QOL evidence.ObjectiveTo investigate whether recently approved oncology therapies demonstrate clinically meaningful improvements in QOL.Evidence reviewThis systematic review study identified oncology drug indications approved by the US Food and Drug Administration (FDA) and European Medicines Agency (EMA) from January 2006 to December 2017 and supporting clinical trials (QOL publications identified to October 2019). Indications were evaluated for the presence of published QOL evidence; QOL benefits according to the American Society of Clinical Oncology Value Framework version 2.0 (ASCO-VF) and European Society of Medical Oncology Magnitude of Clinical Benefit Scale version 1.1 (ESMO-MCBS) QOL bonus criteria; and clinically meaningful improvements in QOL beyond minimal clinically important differences. Hematology trials were not evaluated by ESMO-MCBS. Associations between QOL evidence and approval year were examined using logistic regression models.FindingsIn total, 214 FDA-approved (77 [36%] hematological) and 170 EMA-approved (52 [31%] hematological) indications were included. QOL evidence was published for 40% and 58% of FDA- and EMA-approved indications, respectively. QOL bonus criterion for ASCO-VF and ESMO-MCBS was met in 13% and 17% of FDA-approved and 21% and 24% of EMA-approved indications, respectively. Clinically meaningful improvements in QOL beyond minimal clinically important differences were noted in 6% and 11% of FDA- and EMA-approved indications, respectively. Availability of published QOL evidence at the time of approval increased over time for EMA (odds ratio [OR], 1.13; P = .03), however not for FDA (OR, 1.10; P = .12). Over time, no increase in awarded QOL bonuses or clinically meaningful improvements in QOL were found.Conclusions and relevanceThe findings of this systematic review suggest that approved systemic oncology therapies often do not have published evidence to suggest QOL improvement, despite its recognized importance. Of indications with evidence of statistical improvement, few have demonstrated clinically meaningful improvements.

Dataset Information

The evidence base for psychotropic drugs approved by the European Medicines Agency: a meta-assessment of all European Public Assessment Reports.

Aims

Methods

Results

Conclusions

Publications

The evidence base for psychotropic drugs approved by the European Medicines Agency: a meta-assessment of all European Public Assessment Reports.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets