Dataset Information

Advancing regulatory science and assessment of FDA REMS programs: A mixed-methods evaluation examining physician survey response.

ABSTRACT:

Purpose

Food and Drug Administration's (FDA) Draft Guidance for Industry on pharmaceutical REMS (Risk Evaluation and Mitigation Strategies) assessment and survey methodology highlights physician knowledge-attitudes-behaviors (KAB) surveys as regulatory science tools. This mixed-methods evaluation advances regulatory science and the assessment of FDA REMS programs when using physician surveys. We: (1) reviewed published physician survey response rates; and (2) assessed response bias in a simulation study of secondary survey data using different accrual cut-off strategies.

Methods

A systematic literature review was conducted of US physician surveys (2000-2014) on pharmaceutical use (n = 75). Kruskal-Wallis tests were used to examine the relationships between response rates and survey design characteristics. The simulation was conducted using secondary data from a population-based physician KAB survey on diabetes risk management with antipsychotic use in Missouri Medicaid (n = 973 accrued over 30 weeks). Survey item responses were compared using Pearson's chi-square tests for two faster completion simulations: Fixed Sample (n = 300) and Fixed Time (8 weeks).

Results

Survey response rates ranged from 7% to 100% (median = 48%, IQR = 34%-68%). Surveys of targeted populations and surveys using member lists were associated with higher response rates (p = 0.02). In the simulation, 9 of 20 (45%) KAB items, including diabetes screening advocacy, differed significantly using the smaller Fixed Sample strategy (achieved in 12 days) versus full accrual. Fewer response differences were found using the Fixed Time strategy (2 of 20 [10%] items).

Conclusions

Published data on physician surveys report low response rates with most associated with the sample source selected. FDA REMS assessments should include formal evaluation of survey accrual and response bias.

SUBMITTER: Brewer SE

PROVIDER: S-EPMC6799639 | biostudies-literature | 2019 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Advancing regulatory science and assessment of FDA REMS programs: A mixed-methods evaluation examining physician survey response.

Brewer Sarah E SE Campagna Elizabeth J EJ Morrato Elaine H EH

Journal of clinical and translational science 20190801 4

<h4>Purpose</h4>Food and Drug Administration's (FDA) <i>Draft Guidance for Industry</i> on pharmaceutical REMS (Risk Evaluation and Mitigation Strategies) assessment and survey methodology highlights physician knowledge-attitudes-behaviors (KAB) surveys as regulatory science tools. This mixed-methods evaluation advances regulatory science and the assessment of FDA REMS programs when using physician surveys. We: (1) reviewed published physician survey response rates; and (2) assessed response bia ...[more]

PMID: 31660244

Similar Datasets

Project description:BackgroundA Risk Evaluation and Mitigation Strategy (REMS) is a drug safety program for certain medications with serious safety concerns required by the U.S. Food and Drug Administration (FDA) of manufacturers to implement to help ensure the benefits of the medication outweigh its risks. FDA is encouraging "the research community to develop novel methods for assessing REMS," conveying the unmet need for a standardized evaluation method of these regulatory-mandated healthcare programs. The objective of this research is to evaluate FDA REMS assessment plans using established implementation science frameworks and identify opportunities for strengthening REMS evaluation.MethodsA content analysis was conducted of publicly available assessment plans for all REMS programs (N = 23) approved 1/1/2014-12/31/2018 for new drug applications (NDAs) and biologics license applications (BLAs) requiring FDA-mandated Elements to Assure Safe Use (ETASU). Blinded reviewers critically appraised REMS assessment measures (n = 674) using three established implementation science frameworks: RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance); PRECEDE-PROCEED (Predisposing, Reinforcing, and Enabling Constructs in Educational/Environmental Diagnosis and Evaluation - Policy, Regulatory, and Organizational Constructs in Educational and Environmental Development); and CFIR (Consolidated Framework for Implementation Research). Framework constructs were mapped to REMS Assessment categories as defined by FDA Guidance for Industry to evaluate congruence.ResultsREMS assessment measures demonstrated strong congruence (> 90% mapping rate) with the evaluative constructs of RE-AIM, PRECEDE-PROCEED, and CFIR. Application of the frameworks revealed that REMS assessment measures heavily emphasize implementation and operations, focus less on health outcomes, and do not evaluate program context and design assumptions.ConclusionsImplementation science frameworks have utility for evaluating FDA-mandated drug safety programs including the selection of primary measures to determine whether REMS goals are being met and of secondary measures to evaluate contextual factors affecting REMS effectiveness in varying organizational settings.

Project description:BackgroundTo describe the ethical issues and experiences of scientists conducting mixed methods health services research and to advance empirical and conceptual discussion on ethical integrity in mixed methods health research.MethodsThe study was conducted with 64 scholars, faculty and consultants from the NIH-funded Mixed Methods Research Training Program (MMRTP) for the Health Sciences. This was a cross-sectional study. Survey results were analyzed using descriptive statistics to characterize responses and open coding to summarize strategies about eight ethical mixed methods research issues. Respondents completed an online survey to elicit experiences related to eight ethical issues (informed consent, confidentiality, data management, burden, safety, equitable recruitment, communication, and dissemination) and strategies for addressing them.ResultsOnly about one-third of respondents thought their research ethics training helped them plan, conduct, or report mixed methods research. The most frequently occurring ethical issues were participant burden, dissemination and equitable recruitment (> 70% endorsement). Despite occurring frequently, < 50% of respondents rated each ethical issue as challenging. The most challenging ethical issues were related to managing participant burden, communication, and dissemination. Strategies reported to address ethical issues were largely not specific or unique to mixed methods with the exception of strategies to mitigate participant burden and, to a lesser degree, to facilitate equitable recruitment and promote dissemination of project results.ConclusionsMixed methods health researchers reported encountering ethical issues often yet varying levels of difficulty and effectiveness in the strategies used to mitigate ethical issues. This study highlights some of the unique challenges faced by mixed methods researchers to plan for and appropriately respond to arising ethical issues such as managing participant burden and confidentiality across data sources and utilizing effective communication and dissemination strategies particularly when working with a multidisciplinary research team. As one of the first empirical studies to examine mixed methods research ethics, our findings highlight the need for greater attention to ethics in health services mixed methods research and training.

Project description:IntroductionThe development of postgraduate programs for physician assistants (PAs) began in 1973 and by 2020 there were approximately 72 programs spread across a broad range of medical and surgical disciplines. PA Post-graduate education programs are voluntary and available to American licensed PAs. Therefore, an assessment of the characteristics of PA post-graduate fellowships and residencies programs was initiated.MethodA non-experimental, descriptive research study was designed to obtain information on the characteristics of PA postgraduate education programs in the US. The source of information was from surveyed members of the Association of Postgraduate Physician Assistant Programs (APPAP). Questions were drawn from consensus discussions. Directors of postgraduate programs that were operational in 2020 were eligible to participate.ResultsSeventy-two postgraduate program directors were invited to the survey and 34 program directors replied. These programs are geographically distributed across the US in 13 states. The respondents represent a wide range of medicine: surgery, emergency medicine, critical care, orthopaedics, hospitalist, psychiatry, oncology, primary care, pediatrics, and cardiology. Most programs are associated with an academic medical center and some institutions have more than one postgraduate specialty track. The curriculum includes bedside teaching, lectures, mentorship, assigned reading, procedures, simulation, and conferences. An average program length is 12 months and awards a certificate. Stipends for PA fellows are $50,000-80,000 (2020 dollars) and benefits include paid time off, health and liability insurance. About half of the programs bill for the services rendered by the PA. Over 90% of graduates are employed within 2 months of completing a PA postgraduate training program.ConclusionA trend is underway in American medicine to include PAs in postgraduate education. PA postgraduate training occurs across a broad spectrum of medical and surgical areas, as well as diverse institutions and organizations overseeing these programs. Most PA postgraduate programs are in teaching hospitals where the PA resident or PA fellow also serves as a house officer alongside a categorical resident. This study sets the stage for more granular economic and social research on this growing phenomenon in American medicine.

Project description:BackgroundThe UK's transition from the European Union creates both an urgent need and key opportunity for the UK and its global collaborators to consider new approaches to the regulation of emerging technologies, underpinned by regulatory science. This survey aimed to identify the most accurate definition of regulatory science, to define strategic areas of the regulation of healthcare innovation which can be informed through regulatory science and to explore the training and infrastructure needed to advance UK and international regulatory science.MethodsA survey was distributed to UK healthcare professionals, academics, patients, health technology assessment agencies, ethicists and trade associations, as well as international regulators, pharmaceutical companies and small or medium enterprises which have expertise in regulatory science and in developing or applying regulation in healthcare. Subsequently, a descriptive quantitative analyses of survey results and directed thematic analysis of free-text comments were applied.ResultsPriority areas for UK regulatory science identified by 145 participants included the following: flexibility: the capability of regulations to adapt to novel products and target patient outcomes; co-development: collaboration across sectors, e.g. patients, manufacturers, regulators, and educators working together to develop appropriate training for novel product deployment; responsiveness: the preparation of frameworks which enable timely innovation required by emerging events; speed: the rate at which new products can reach the market; reimbursement: developing effective tools to track and evaluate outcomes for "pay for performance" products; and education and professional development.ConclusionsThe UK has a time-critical opportunity to establish its national and international strategy for regulatory science leadership by harnessing broader academic input, developing strategic cross-sector collaborations, incorporating patients' experiences and perspectives, and investing in a skilled workforce.

Project description:BackgroundPatient safety research has lagged within academic settings, including chiropractic teaching institutions. To develop a robust patient safety culture, the Institute of Medicine emphasized the need for employee's attitudes to be understanding and positive. To initiate the assessment of the current culture and future needs, this study evaluated patient safety attitudes among chiropractic teaching clinic stakeholders (supervising clinicians, student interns, and administrative staff) and compared their standardized survey scores to established medical survey databases.MethodsWe conducted a cross-sectional, mixed methods survey design with quantitative analytic priority. Chiropractic interns, clinical faculty, and clinic staff of 5 international chiropractic educational programs completed a modified version of the Agency for Healthcare Research and Quality (AHRQ) Patient Safety Culture for Medical Offices Survey with open-ended comment fields between 2014 and 2016. Composite means of positive responses were calculated and compared to patient safety, quality of care, and overall self-ratings benchmarks from Canadian providers and academic settings in the AHRQ database. Qualitative responses were thematically categorized for a convergent analysis of quantitative results for the chiropractic sample.ResultsChiropractic survey response rate was 45.3% (n = 645). Quantitative survey results indicated moderate scores and ranges (57-85%) on all patient safety dimensions for the chiropractic samples. Academic medicine and chiropractic providers' benchmarks scored higher positive responses than chiropractic teaching clinics on most quantitative dimensions, except for work pressure/pace. Teamwork, organizational learning, and patient tracking/follow-up were the most positively endorsed quantitative dimensions, with communication, staff training, office standardization, and leadership support considered areas for improvement in both settings. Qualitative responses for the chiropractic clinics identified a need for open communication; additional staff training and student involvement in creating safety cultures; standardization of office processes including information exchange, scheduling, and equipment maintenance; and leadership support that focused on decreasing work pressure/pace and setting safety priorities.ConclusionAs the first report of patient safety attitudes from stakeholders in chiropractic teaching clinics, specific areas of improvement were identified. Chiropractic teaching programs might consider incorporating these and related patient safety concepts into their formal curricula. Mixed methods approach offers teaching clinics opportunities to assess stakeholders' insights and enhance safe delivery of chiropractic care.

Dataset Information

Advancing regulatory science and assessment of FDA REMS programs: A mixed-methods evaluation examining physician survey response.

Purpose

Methods

Results

Conclusions

Publications

Advancing regulatory science and assessment of FDA REMS programs: A mixed-methods evaluation examining physician survey response.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets