Dataset Information

Development and validation of COMPASS: clinical evidence of orphan medicinal products - an assessment tool.

ABSTRACT:

Background

Rare diseases are defined as life-threatening or chronically debilitating diseases with a prevalence of 50 out of 100,000 individuals or less. Orphan medicinal products (OMPs) are intended for the treatment of rare diseases. The assessment of quality of evidence in small populations is often complex. Many generic tools are unfit. Therefore, the aim of this study was to develop and validate a new tool to assess the quality of OMPs' clinical evidence (COMPASS).

Methods

Firstly, a draft version of the COMPASS tool, developed by the authors and consisting of three parts, was amended based on suggestions obtained in four rounds of expert consultation. Secondly, the tool was put through three rounds of validation. The data source was information provided on the Orphanet website and in European Public Assessment Report (EPAR) document of the European Medicines Agency.

Results

The first pilot round revealed a high (92.2%) inter-rater agreement for part one of the tool. After further improvements, the final inter-rater agreement was 86.4% for part two (on methodological quality) and three (on quality of reporting) of the tool. The COMPASS tool does not attempt to score or rank the quality of clinical evidence, but rather to give an outline of various, key elements with respect to quality of clinical evidence of OMP studies.

Conclusions

The COMPASS tool can be applied to assess the quality of evidence of an OMP based on information in the registration dossier, for example by local reimbursement agencies, pharmacists or clinicians. In that way, the tool can contribute to making reimbursement and/or treatment decisions increasingly more founded on the principles of evidence-based decision making.

SUBMITTER: Picavet E

PROVIDER: S-EPMC3856624 | biostudies-literature | 2013 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and validation of COMPASS: clinical evidence of orphan medicinal products - an assessment tool.

Picavet Eline E Cassiman David D Aertgeerts Bert B Simoens Steven S

Orphanet journal of rare diseases 20131009

<h4>Background</h4>Rare diseases are defined as life-threatening or chronically debilitating diseases with a prevalence of 50 out of 100,000 individuals or less. Orphan medicinal products (OMPs) are intended for the treatment of rare diseases. The assessment of quality of evidence in small populations is often complex. Many generic tools are unfit. Therefore, the aim of this study was to develop and validate a new tool to assess the quality of OMPs' clinical evidence (COMPASS).<h4>Methods</h4>Fi ...[more]

PMID: 24107467

Similar Datasets

Project description:BackgroundTo assess uncertainty in regulatory decision-making for orphan medicinal products (OMP), a summary of the current basis for approval is required; a systematic grouping of medical conditions may be useful in summarizing information and issuing recommendations for practice.MethodsA grouping of medical conditions with similar characteristics regarding the potential applicability of methods and designs was created using a consensus approach. The 125 dossiers for authorised OMP published between 1999 and 2014 on the EMA webpage were grouped accordingly and data was extracted from European Public Assessment Reports (EPARs) to assess the extent and robustness of the pivotal evidence supporting regulatory decisions.Results88% (110/125) of OMP authorizations were based on clinical trials, with 35% (38/110) including replicated pivotal trials. The mean (SD) number of pivotal trials per indication was 1.4 (0.7), and the EPARs included a median of three additional non-pivotal supportive studies. 10% of OMPs (13/125) were authorised despite only negative pivotal trials. One-third of trials (53/159) did not include a control arm, one-third (50/159) did not use randomisation, half the trials (75/159) were open-label and 75% (119/159) used intermediate or surrogate variables as the main outcome. Chronic progressive conditions led by multiple system/organs, conditions with single acute episodes and progressive conditions led by one organ/system were the groups where the evidence deviated most from conventional standards. Conditions with recurrent acute episodes had the most robust datasets. The overall size of the exposed population at the time of authorisation of OMP?-?mean(SD) 190.5 (202.5)?-?was lower than that required for the qualification of clinically-relevant adverse reactions.ConclusionsThe regulatory evidence supporting OMP authorization showed substantial uncertainties, including weak protection against errors, substantial use of designs unsuited for conclusions on causality, use of intermediate variables, lack of a priorism and insufficient safety data to quantify risks of relevant magnitude. Grouping medical conditions based on clinical features and their methodological requirements may facilitate specific methodological and regulatory recommendations for the study of OMP to strengthen the evidence base.

Project description:ObjectivesThe primary objective of this study was to compare the availability and access of orphan medicinal products (OMPs) in the devolved nations in the United Kingdom (UK), France, Germany, Italy and Spain. Availability is defined as the possibility to prescribe OMPs. Access refers to their full or partial reimbursement by the public health service.MethodsData were collated on: marketing authorisations, Health Technology Assessment (HTA) decisions, commissioning, and reimbursement decisions, and respective dates of these events for all the OMPs centrally authorised. Indicators of availability of and access to OMPs were calculated in each country and compared.ResultsWe found that since the implementation of the OMPs Regulation in 2000 to end of May 2016, 143 OMPs obtained a marketing authorisation in the European Union. These OMPs are most widely accessible in Germany and France. In the other countries between 30 and 60% of OMPs are reimbursed. In particular in England, less than 50% of centrally authorised OMPs are routinely funded by the NHS, with one-third of these recommended by NICE. In Germany reimbursement is automatically granted to all medicines which receive a marketing authorisation, immediately after authorisation - but since 2011, there is an evaluation and potentially a pricing negotiation between companies and sickness funds (third party payers). In the other countries, the shortest time from authorisation to a reimbursement decision is observed in Italy and France where it takes 18.6 and 19.5 months respectively on average.ConclusionsMarketing authorisation granted to OMPs is only the first step, as medicines reach patients when reimbursement decisions are implemented by national health systems (this applies to non-OMPs too). We found that more than a half of centrally authorised OMPs were available in the five selected countries, but that access to patients was further restricted by different national reimbursement policies, especially in the UK, Italy and Spain.

Project description:BackgroundFunding of orphan medicinal products (OMPs) is an increasing challenge in the European Union (EU).ObjectivesTo identify the different methods for public funding of OMPs in order to map the availability for rare disease patients, as well as to compare the public expenditures on OMPs in 8 EU member states.MethodsInformation on the reimbursement status of 83 OMPs was collected in 8 countries by distinguishing standard and special reimbursements. In two consecutive years, the total public expenditures on OMPs were calculated by using annual EUR exchange rates. Annual total public expenditures were calculated per capita, and as a proportion of GDP, total public pharmaceutical and healthcare budgets. Differences between countries were compared by calculating the deviations from the average spending of countries.ResultsIn 2015 29.4-92.8% of the 83 OMPs were available with any kind of public reimbursement in participant countries including special reimbursement on an individual basis. In Austria, Belgium and France more OMPs were accessible for patients with public reimbursement than in Bulgaria, Czech Republic, Hungary and Poland. Standard reimbursement through retail pharmacies and/or hospitals was applied from 0 to 41% of OMPs. The average annual total public expenditure ranged between 1.4-23.5 €/capita in 2013 and 2014. Higher income countries spent more OMPs in absolute terms. Participant countries spent 0.018-0.066% of their GDPs on funding OMPs. Average expenditures on OMPs were ranged between 2.25-6.51% of the public pharmaceutical budget, and 0.44-0.96% of public healthcare expenditures.ConclusionsStandard and special reimbursement techniques play different roles in participant countries. The number of accessible OMPs indicated an equity gap between Eastern and Western Europe. The spending on OMPs as a proportion of GDP, public pharmaceutical and healthcare expenditure was not higher in lower income countries, which indicates substantial differences in patient access to OMPs in favour of higher-income countries. Equity in access for patients with rare diseases is an important policy objective in each member state of the EU; however, equity in access should be harmonized at the European level.

Project description:BACKGROUND:The Office of Orphan Products Development (OOPD) of the United States (U.S.) Food and Drug Administration (FDA) has awarded over 700 grants to conduct clinical trials of medicals products for rare diseases since 1983, leading to over 70 marketing approvals. However, despite recent progress in rare disease product development, thousands of rare diseases still have no approved treatments. An assessment of this clinical trial grants program was undertaken to provide an in-depth analysis of the characteristics and outcomes of the program. Results of this analysis will be used to inform future goals of the program, as well as internal data collection to continue to maximize the program's impact in supporting rare disease product development. RESULTS:Between fiscal years 2007-2011, OOPD funded 85 clinical trial grants. These grants spanned 18 therapeutic areas, included all pre-approval phases (Phases 1-3), and approximately 75% of the grants studied small molecule drugs. Nine (11%) product approvals, of seven drugs and two devices, were at least partially supported by grants funded within this 5-year timeframe. Four of the seven drugs approved were new molecular entities (NMEs). The average time from funding to approval was seven years. We also found a suggested association between collaboration with multiple types of stakeholders and the success of grants, where we defined success as either positive or negative study findings or a future marketing approval. CONCLUSIONS:The clinical trials funded by OOPD provided valuable information for future product development, and there were a notable number of approvals that occurred using the support of the grants program. There was a suggested association between collaboration and successful outcomes. Efficient and innovative trial designs and collaboration among stakeholders appear vital to continue to effectively bring products to rare disease patients. Ongoing program assessments will ensure that the funding continues to be used to optimally meet the treatment needs of the rare disease community.

Project description:ImportanceClinician compassion is a vital element of health care quality. Currently, there appears to be no validated and feasible method for health care organizations to measure patient assessment of clinician compassion on a large scale.ObjectiveTo develop and validate a tool for measuring patient assessment of clinician compassion that can be used in conjunction with the Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) survey.Design, setting, and participantsThis prospective cohort study took place from June 1 to August 30, 2018, at a US academic health care system among a pilot cohort consisting of 3325 adult patients and a validation cohort consisting of 3483 adult patients, both of whom had an outpatient clinic visit and completed the CG-CAHPS survey.Main outcomes and measurementsAfter a comprehensive literature review, 12 candidate survey items were developed. Face and construct validity were performed. Candidate items were disseminated to patients in conjunction with the CG-CAHPS survey in a series of 2 studies: (1) exploratory factor analysis in one cohort to determine the factor structure and the most parsimonious set of items; and (2) validity testing in a second cohort using confirmatory factor analysis. Reliability was tested using Cronbach α. Convergent validity was tested with patient assessment of clinician communication and overall satisfaction questions from CG-CAHPS survey.ResultsOverall, 6493 patient responses were analyzed. The mean (SD) age was 60 (15) years, 4239 patients (65.3%) were women, and 5079 (78.2%) were white. Exploratory factor analyses identified a 5-item compassion measure to be the most parsimonious. Confirmatory factor analyses found good fit. The compassion measure demonstrated good internal consistency (α = 0.94) and convergent validity (clinician communication: ρ = 0.44; overall satisfaction: ρ = 0.52) but reflected a patient experience domain (compassionate care) distinct from what is currently captured in the CG-CAHPS survey.Conclusions and relevanceA simple 5-item tool to measure patient assessment of clinician compassion was developed and validated for use in conjunction with CG-CAHPS survey.

Dataset Information

Development and validation of COMPASS: clinical evidence of orphan medicinal products - an assessment tool.

Background

Methods

Results

Conclusions

Publications

Development and validation of COMPASS: clinical evidence of orphan medicinal products - an assessment tool.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets