Project description:Over the first half of March 2021, the majority of European governments suspended Astrazeneca's Vaxzevria vaccine as a precaution following media reports of rare blood clots. We analyse the impact of the European Medicines Agency's (EMA) March 18th statement assuring the public of the safety of Vaxzevria and the immediate reinstatement of the vaccine by most countries on respondents' intention to get vaccinated. By relying on survey data collected in Luxembourg and neighbouring areas between early March and mid-April, we observe that the willingness to be vaccinated was severely declining in the days preceding the EMA statement. We implement a regression discontinuity design exploiting the time at which respondents completed the survey and find that the vaccine reinstatement substantially restored vaccination intentions.
Project description:AimsTo systematically assess the level of evidence for psychotropic drugs approved by the European Medicines Agency (EMA).MethodsCross-sectional analysis of all European Public Assessment Reports (EPARs) and meta-analyses of the many studies reported in these EPARs. Eligible EPARs were identified from the EMA's website and individual study reports were requested from the Agency when necessary. All marketing authorisation applications (defined by the drug, the route of administration and given indications) for psychotropic medications for adults (including drugs used in psychiatry and addictology) were considered. EPARs solely based on bioequivalence studies were excluded. Our primary outcome measure was the presence of robust evidence of comparative effectiveness, defined as at least two 'positive' superiority studies against an active comparator. Various other features of the approvals were assessed, such as evidence of non-inferiority v. active comparator and superiority v. placebo. For studies with available data, effect sizes were computed and pooled using a random effect meta-analysis for each dose of each drug in each indication.ResultsTwenty-seven marketing authorisations were identified. For one, comparative effectiveness was explicitly considered as not needed in the EPAR. Of those remaining, 21/26 (81%) did not provide any evidence of superiority against an active comparator, 2/26 (8%) were based on at least two trials showing superiority against active comparator and three (11%) were based on one positive trial; 1/26 provided evidence for two positive non-inferiority analyses v. active comparator and seven (26%) provided evidence for one. In total, 20/27 (74%) evaluations reported evidence of superiority v. placebo with two or more trials. Among the meta-analyses of initiation studies against active comparator (57 available comparisons), the median effect size was 0.051 (range -0.503; 0.318). Twenty approved evaluations (74%) reported evidence of superiority v. placebo on the basis of two or more initiation trials and seven based on a single trial. Among meta-analyses of initiation studies against placebo (125 available comparisons), the median effect size was -0.283 (range -0.820; 0.091). Importantly, among the 89 study reports requested on the EMA website, only 19 were made available 1 year after our requests.ConclusionsThe evidence for psychiatric drug approved by the EMA was in general poor. Small to modest effects v. placebo were considered sufficient in indications where an earlier drug exists. Data retrieval was incomplete after 1 year despite EMA's commitment to transparency. Improvements are needed.
Project description:BackgroundTransparency and reproducibility are expected to be normative practices in clinical trials used for decision-making on marketing authorisations for new medicines. This registered report introduces a cross-sectional study aiming to assess inferential reproducibility for main trials assessed by the European Medicines Agency.MethodsTwo researchers independently identified all studies on new medicines, biosimilars and orphan medicines given approval by the European Commission between January 2017 and December 2019, categorised as 'main studies' in the European Public Assessment Reports (EPARs). Sixty-two of these studies were randomly sampled. One researcher retrieved the individual patient data (IPD) for these studies and prepared a dossier for each study, containing the IPD, the protocol and information on the conduct of the study. A second researcher who had no access to study reports used the dossier to run an independent re-analysis of each trial. All results of these re-analyses were reported in terms of each study's conclusions, p-values, effect sizes and changes from the initial protocol. A team of two researchers not involved in the re-analysis compared results of the re-analyses with published results of the trial.ResultsTwo hundred ninety-two main studies in 173 EPARs were identified. Among the 62 studies randomly sampled, we received IPD for 10 trials. The median number of days between data request and data receipt was 253 [interquartile range 182-469]. For these ten trials, we identified 23 distinct primary outcomes for which the conclusions were reproduced in all re-analyses. Therefore, 10/62 trials (16% [95% confidence interval 8% to 28%]) were reproduced, as the 52 studies without available data were considered non-reproducible. There was no change from the original study protocol regarding the primary outcome in any of these ten studies. Spin was observed in the report of one study.ConclusionsDespite their results supporting decisions that affect millions of people's health across the European Union, most main studies used in EPARs lack transparency and their results are not reproducible for external researchers. Re-analyses of the few trials with available data showed very good inferential reproducibility.Trial registrationhttps://osf.io/mcw3t/.
Project description:The recent Regulation (EU) 2019/1381, published on the 6th September 2019, aims to improve the transparency and sustainability of the EU risk assessment in the food chain by amending the General Food Law Regulation (EC 178/2002) and a number of other regulations related to the food sector. This Regulation is introduced as a response to the Fitness Check of the General Food Law Regulation as well as a response to public concerns expressed by a European Citizens' Initiative on glyphosate and pesticides. This article evaluates the amendments introduced by Regulation 2019/1381with respect to the institutional and regulatory environment in the food chain and more specifically concerning the risk assessment procedure. For this purpose, we perform a comparison of the institutional and organizational characteristics of the European Food Safety Authority (EFSA) and European Medicines Agency (EMA) in relation to the processes of risk assessment and risk evaluation, especially the processes surrounding genetically modified foods and pesticides, and how these characteristics affect the politicization of these processes. We conclude that the risk assessment process followed by EFSA would have benefitted and become more effective and less politicized, if the recent Regulation 2019/1381 had introduced some of EMA's institutional structures and methods on risk evaluation.
Project description:ObjectivesStratified medicine is often heralded as the future of clinical practice. Key part of stratified medicine is the use of predictive biomarkers, which identify patient subgroups most likely to benefit (or least likely to experience harm) from an intervention. We investigated how many and what predictive biomarkers are currently included in European Medicines Agency (EMA) licensing.SettingEMA licensing.ParticipantsIndications and contraindications of all drugs considered by the EMA and published in 883 European Public Assessment Reports and Pending Decisions.Primary and secondary outcome measuresData were collected on: the type of the biomarker, whether it selected a subgroup of patients based on efficacy or toxicity, therapeutic area, marketing status, date of licensing decision, date of inclusion of the biomarker in the indication or contraindication and on orphan designation.Results49 biomarker-indication-drug (B-I-D) combinations were identified over 16 years, which included 37 biomarkers and 41 different drugs. All identified biomarkers were molecular. Six drugs (relating to 10 B-I-D combinations) had an orphan designation at the time of licensing. The identified B-I-D combinations were mainly used in cancer and HIV treatment, and also in hepatitis C and three other indications (cystic fibrosis, hyperlipoproteinaemia type I and methemoglobinaemia). In 45 B-I-D combinations, biomarkers were used as predictive of drug efficacy and in four of drug toxicity. It appeared that there was an increase in the number of B-I-D combinations introduced each year; however, the numbers were too small to identify any trends.ConclusionsGiven the large body of literature documenting research into potential predictive biomarkers and extensive investment into stratified medicine, we identified relatively few predictive biomarkers included in licensing. These were also limited to a small number of clinical areas. This might suggest a need for improvement in methods of translation from laboratory findings to clinical practice.
Project description:ObjectivesTo assess the use, and evaluate the usefulness, of non-interventional studies and routinely collected healthcare data in postmarketing assessments conducted by the European Medicines Agency (EMA).DesignWe reviewed and systematically assessed all referrals to the EMA made due to safety or efficacy concerns that were evaluated between 1 January 2013 and 30 June 2017. We extracted information from the assessment report and the referral notification. Two reviewers independently assessed the contribution of non-interventional evidence to decision-making.ResultsThe preliminary evidence leading to the assessment in 52 eligible referrals was mostly from spontaneous reports (cited in 26 of 52 referrals) and randomised trials (22/52). In contrast, many evidence types were used for the full assessment. Non-interventional studies were frequently used in the full assessment for the evaluation of product safety (31/52) and product efficacy (18/52). In particular, non-interventional studies were relied on for the evaluation of safety and efficacy in subgroups, the evaluation of safety relating to a rare adverse event, understanding product usage and misuse and for evaluation of the effectiveness of risk minimisation measures. The most common recommendations were changes to product information (43/52) and marketing authorisation withdrawal or suspension (12/52). In the majority of referrals, non-interventional evidence was judged to contribute to the decision made (30/52) and in three referrals it was the primary source of evidence.ConclusionsEuropean regulatory decision-making relies on multiple evidence types, particularly randomised trials, spontaneous reports and non-interventional studies. Non-interventional studies had an important role particularly for the characterisation and quantification of adverse events, the evaluation of product usage and for evaluating the effectiveness of regulatory action to minimise risk.
Project description:Mobility is defined as the ability to independently move around the environment and is a key contributor to quality of life, especially in older age. The aim of this study was to evaluate the use of mobility as a decisive outcome for the marketing authorisation of drugs by the European Medicines Agency (EMA). Fifteen therapeutic areas which commonly lead to relevant mobility impairments and alter the quantity and/or the quality of walking were selected: two systemic neurological diseases, four conditions primarily affecting exercise capacity, seven musculoskeletal diseases and two conditions representing sensory impairments. European Public Assessment Reports (EPARs) published by the EMA until September 2020 were examined for mobility endpoints included in their 'main studies'. Clinical study registries and primary scientific publications for these studies were also reviewed. Four hundred and eighty-four EPARs yielded 186 relevant documents with 402 'main studies'. The EPARs reported 153 primary and 584 secondary endpoints which considered mobility; 70 different assessment tools (38 patient-reported outcomes, 13 clinician-reported outcomes, 8 performance outcomes and 13 composite endpoints) were used. Only 15.7% of those tools distinctly informed on patients' mobility status. Out of 402, 105 (26.1%) of the 'main studies' did not have any mobility assessment. Furthermore, none of these studies included a digital mobility outcome. For conditions with a high impact on mobility, mobility assessment was given little consideration in the marketing authorisation of drugs by the EMA. Where mobility impairment was considered to be a relevant outcome, questionnaires or composite scores susceptible to reporting biases were predominantly used.
Project description:ObjectivesTo describe the characteristics of clinical study report (CSR) documents published by the European Medicines Agency (EMA), and for included pivotal trials, to quantify the timeliness of access to trial results from CSRs compared with conventional published sources.DesignCross-sectional analysis of CSR documents published by the EMA from 2016 to 2018.MethodsCSR files and medication summary information were downloaded from the EMA. Individual trials in each submission were identified using document filenames. Number and length of documents and trials were determined. For pivotal trials, trial phase, dates of EMA document publication and matched journal and registry publications were obtained.ResultsThe EMA published documents on 142 medications that were submitted for regulatory drug approval. Submissions were for initial marketing authorisations in 64.1%. There was a median of 15 (IQR 5-46) documents, 5 (IQR 2-14) trials and 9629 (IQR 2711-26,673) pages per submission, and a median of 1 (IQR 1-4) document and 336 (IQR 21-1192) pages per trial. Of all identified pivotal trials, 60.9% were phase 3 and 18.5% were phase 1. Of 119 unique submissions to the EMA, 46.2% were supported by a single pivotal trial, with 13.4% based on a single pivotal phase 1 trial. No trial registry results were identified for 26.1% trials, no journal publications for 16.7% and 13.5% of trials had neither. EMA publication was the earliest information source for 5.8% of pivotal trials, available a median 523 days (IQR 363-882 days) before the earliest publication.ConclusionsThe EMA Clinical Data website contains lengthy clinical trial documents. Almost half of submissions to the EMA were based on single pivotal trials, many of which were phase 1 trials. CSRs were the only source and a timelier source of information for many trials. Access to unpublished trial information should be open and timely to support decision-making for patients.
Project description:Background: An increasing number of medicines authorised in Europe recommend or require biomarker-based patient selection. For some of these the use of a companion diagnostic (CDx), a subset of in vitro diagnostics (IVDs), to identify patient populations eligible for a specific medicinal product may be required. The information and recommendations of use of a medicinal product for which a CDx is required is particularly important to healthcare professionals for correct patient identification. Methods: We reviewed the existing information in SmPCs and European Public Assessment Reports (EPARs) of EU medicinal products approved via the centralised procedure at EMA where reference was made to biomarker testing, including by CDx, for patient selection. Results: The results show that varying levels of detail are provided for the biomarker and the diagnostic test, including variability in where the information was presented. The overall results demonstrate transparent but sometimes heterogeneous reporting of CDx in the SmPC and EPAR. Conclusions: With the introduction of the new Regulation (EU) 2017/746 on in vitro diagnostic medical devices, medicines regulatory authorities' will be required to be consulted during the review of CDx conformity assessment and so, there is opportunity for more consistent and transparent information on CDx to be provided in the SmPC and EPAR.