Dataset Information

European Public Assessment Report (EPAR) summaries for the public: are they fit for purpose? A user-testing study.

ABSTRACT:

Objectives

Apply 'user testing' methodology to test the readability of a European Public Assessment Report (EPAR) summary-which describes how the decision was made by the European Medicines Agency to approve a medicine.

Design

User testing uses mixed methods (questionnaire and semistructured interview), applied iteratively, to assess document performance-can people find and understand key points of information.

Setting and participants

Testing was undertaken with 40 members of the public in four consecutive rounds of 10. Inclusion criteria, matched across rounds, included range of ages and educational attainment.

Tested documents

In round 1 we tested 19 key points of information in a printed version of the EPAR summary for Bondronat (a cancer medicine). This was then revised to address the findings, and tested in round 2. In round 3 we tested the summary on-screen, and in round 4, tested a revised on-screen version, after addressing findings from both rounds 1 and 3.

Primary outcome measure

The target followed European guidance for medicine leaflets: for each point of information 90% of participants should be able to find, and of those, 90% able to show understanding of the point.

Results

For the original EPAR summary, 6 of the 19 points of information reached the target (both paper-based and on-screen). After revisions to format and content, using good practice in information writing and design, 14 and 16 points, respectively, met the target. The problems related to both finding (dependent on layout, headings and design) and understanding (words and sentences used, as well as design). We devised a new heading structure, increased use of bullet points, replaced difficult and technical words and divided long sentences.

Conclusions

People had difficulty finding and understanding key messages in the summary, but user testing identified the problems, and application of good practice resulted in a revised format which performed well.

SUBMITTER: Raynor DK

PROVIDER: S-EPMC3780304 | biostudies-literature | 2013 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

European Public Assessment Report (EPAR) summaries for the public: are they fit for purpose? A user-testing study.

Raynor David K DK Bryant David D

BMJ open 20130918 9

<h4>Objectives</h4>Apply 'user testing' methodology to test the readability of a European Public Assessment Report (EPAR) summary-which describes how the decision was made by the European Medicines Agency to approve a medicine.<h4>Design</h4>User testing uses mixed methods (questionnaire and semistructured interview), applied iteratively, to assess document performance-can people find and understand key points of information.<h4>Setting and participants</h4>Testing was undertaken with 40 members ...[more]

PMID: 24048625

Similar Datasets

Project description:BackgroundTools for shared decision-making (e.g. decision aids) are intended to support health care professionals and patients engaged in clinical encounters involving shared decision-making. However, decision aids are hard to produce, and onerous to update. Consequently, they often do not reflect best current evidence, and show limited uptake in practice. In response, we initiated the Sharing Evidence to Inform Treatment decisions (SHARE-IT) project. Our goal was to develop and refine a new generation of decision aids that are generically produced along digitally structured guidelines and evidence summaries.MethodsApplying principles of human-centred design and following the International Patient Decision Aid Standards (IPDAS) and GRADE methods for trustworthy evidence summaries we developed a decision aid prototype in collaboration with the Developing and Evaluating Communication strategies to support Informed Decisions and practice based on Evidence project (DECIDE). We iteratively user-tested the prototype in clinical consultations between clinicians and patients. Semi-structured interviews of participating clinicians and patients were conducted. Qualitative content analysis of both user-testing sessions and interviews was performed and results categorized according to a revised Morville's framework of user-experience. We made it possible to produce, publish and use these decision aids in an electronic guideline authoring and publication platform (MAGICapp).ResultsDirect observations and analysis of user-testing of 28 clinical consultations between physicians and patients informed four major iterations that addressed readability, understandability, usability and ways to cope with information overload. Participants reported that the tool supported natural flow of the conversation and induced a positive shift in consultation habits towards shared decision-making. We integrated the functionality of SHARE-IT decision aids in MAGICapp, which has since generated numerous decision aids.ConclusionOur study provides a proof of concept that encounter decision aids can be generically produced from GRADE evidence summaries and clinical guidelines. Online authoring and publication platforms can help scale up production including continuous updating of electronic encounter decision aids, fully integrated with evidence summaries and clinical practice guidelines.

Project description:BackgroundPolygenic scores-which quantify inherited risk by integrating information from many common sites of DNA variation-may enable a tailored approach to clinical medicine. However, alongside considerable enthusiasm, we and others have highlighted a lack of standardized approaches for score disclosure. Here, we review the landscape of polygenic score reporting and describe a generalizable approach for development of a polygenic score disclosure tool for coronary artery disease.MethodsWe assembled a working group of clinicians, geneticists, data visualization specialists, and software developers. The group reviewed existing polygenic score reports and then designed a two-page mock report for coronary artery disease. We then conducted a qualitative user-experience study with this report using an interview guide focused on comprehension, experience, and attitudes. Interviews were transcribed and analyzed for themes identification to inform report revision.ResultsReview of nine existing polygenic score reports from commercial and academic groups demonstrated significant heterogeneity, reinforcing the need for additional efforts to study and standardize score disclosure. Using a newly developed mock score report, we conducted interviews with ten adult individuals (50% females, 70% without prior genetic testing experience, age range 20-70 years) recruited via an online platform. We identified three themes from interviews: (1) visual elements, such as color and simple graphics, enable participants to interpret, relate to, and contextualize their polygenic score, (2) word-based descriptions of risk and polygenic scores presented as percentiles were the best recognized and understood, (3) participants had varying levels of interest in understanding complex genomic information and therefore would benefit from additional resources that can adapt to their individual needs in real time. In response to user feedback, colors used for communicating risk were modified to minimize unintended color associations and odds ratios were removed. All 10 participants expressed interest in receiving a polygenic score report based on their personal genomic information.ConclusionsOur findings describe a generalizable approach to develop a polygenic score report understandable by potential patients. Although additional studies are needed across a wider spectrum of patient populations, these results are likely to inform ongoing efforts related to polygenic score disclosure within clinical practice.

Project description:Rationale, aims and objectivesThe field of implementation science is critical for embedding research evidence into healthcare practice, benefiting individuals, organizations, governments, and the broader community. Implementation science is messy and complex, underpinned by many theories and frameworks. Efficacious interventions for older people with multiple comorbidities exist, yet many lack effectiveness evaluation relevant to pragmatic implementation within aged care practice. This article outlines the conceptualization and development of an Implementation Framework for Aged Care (IFAC), fit-for-purpose for an aged care organization, Bolton Clarke, intent on embedding evidence into practice.MethodA four-stage process was adopted to (1) explore context and relevant literature to conceptualize the IFAC; (2) identify key elements for a draft IFAC; (3) expand elements and refine the draft in consultation with experts and (4) apply the IFAC to three existing projects, identifying key learnings. A checklist to operationalize the IFAC was then developed.ResultsThe IFAC is grounded in codesign principles and encapsulated by the implementation context, from a social, cultural and political perspective. The IFAC addresses the questions of (1) why do we need to change?; (2) what do we know?; (3) who will benefit?; (4) who will make the change?; (5) what strategies will be used?; and (6) what difference are we making? Three pilot projects: early adoption of a Wellness and Reablement approach; a care worker and virtual physiotherapist-led program to prevent falls; and a therapeutic horticulture program for residential communities, highlight learnings of applying the IFAC in practice.ConclusionThis fit-for-purpose IFAC was developed for a proactive and responsive aged care provider. The simplicity of the six-question IFAC is underpinned by substantial theoretical perspectives for its elements and their connections. This complexity is then consolidated into an 18-question checklist to operationalize the IFAC, necessary to advance the translation of evidence into clinical practice.

Project description:Exosomes are defined as submicron (30-150 nm), lipid bilayer-enclosed extracellular vesicles (EVs), specifically generated by the late endosomal compartment through fusion of multivesicular bodies with the plasma membrane. Produced by almost all cells, exosomes were originally considered to represent just a mechanism for jettisoning unwanted cellular moieties. Although this may be a major function in most cells, evolution has recruited the endosomal membrane-sorting pathway to duties beyond mere garbage disposal, one of the most notable examples being its cooption by retroviruses for the generation of Trojan virions. It is, therefore, tempting to speculate that certain cell types have evolved an exosome subclass active in intracellular communication. We term this EV subclass "signalosomes" and define them as exosomes that are produced by the "signaling" cells upon specific physiological or environmental cues and harbor cargo capable of modulating the programming of recipient cells. Our recent studies have established that signalosomes released by mesenchymal stem/stromal cells (MSCs) represent the main vector of MSC immunomodulation and therapeutic action in animal models of lung disease. The efficacy of MSC-exosome treatments in a number of preclinical models of cardiovascular and pulmonary disease supports the promise of application of exosome-based therapeutics across a wide range of pathologies within the near future. However, the full realization of exosome therapeutic potential has been hampered by the absence of standardization in EV isolation, and procedures for purification of signalosomes from the main exosome population. This is mainly due to immature methodologies for exosome isolation and characterization and our incomplete understanding of the specific characteristics and molecular composition of signalosomes. In addition, difficulties in defining metrics for potency of exosome preparations and the challenges of industrial scale-up and good manufacturing practice compliance have complicated smooth and timely transition to clinical development. In this manuscript, we focus on cell culture conditions, exosome harvesting, dosage, and exosome potency, providing some empirical guidance and perspectives on the challenges in bringing exosome-based therapies to clinic.

Dataset Information

European Public Assessment Report (EPAR) summaries for the public: are they fit for purpose? A user-testing study.

Objectives

Design

Setting and participants

Tested documents

Primary outcome measure

Results

Conclusions

Publications

European Public Assessment Report (EPAR) summaries for the public: are they fit for purpose? A user-testing study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure