Tools for measuring patient safety in primary care settings using the RAND/UCLA appropriateness method.
Ontology highlight
ABSTRACT: Background
The majority of patient contacts occur in general practice but general practice patient safety has been poorly described and under-researched to date compared to hospital settings. Our objective was to produce a set of patient safety tools and indicators that can be used in general practices in any healthcare setting and develop a 'toolkit' of feasible patient safety measures for general practices in England.Methods
A RAND/UCLA Appropriateness Method exercise was conducted with a panel of international experts in general practice patient safety. Statements were developed from an extensive systematic literature review of patient safety in general practice. We used standard RAND/UCLA Appropriateness Method rating methods to identify necessary items for assessing patient safety in general practice, framed in terms of the Structure-Process-Outcome taxonomy. Items were included in the toolkit if they received an overall panel median score of ≥ 7 with agreement (no more than two panel members rating the statement outside a 3-point distribution around the median).Results
Of 205 identified statements, the panel rated 101 as necessary for assessing the safety of general practices. Of these 101 statements, 73 covered structures or organisational issues, 22 addressed processes and 6 focused on outcomes.Conclusions
We developed and tested tools that can lead to interventions to improve safety outcomes in general practice. This paper reports the first attempt to systematically develop a patient safety toolkit for general practice, which has the potential to improve safety, cost effectiveness and patient experience, in any healthcare system.
SUBMITTER: Bell BG
PROVIDER: S-EPMC4060097 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:To further develop and validate previously published national prescribing appropriateness criteria to assist in identifying drug-related problems (DRPs) for commonly occurring medications and medical conditions in older (≥65 years old) Australians. RAND/UCLA appropriateness method. A panel of medication management experts were identified consisting of geriatricians/pharmacologists, clinical pharmacists and disease management advisors to organisations that produce Australian evidence-based therapeutic publications. This resulted in a round-one panel of 15 members, and a round-two panel of 12 members. Agreement on all criteria. Forty-eight prescribing criteria were rated. In the first rating round via email, there was disagreement regarding 17 of the criteria according to median panel ratings. During a face-to-face second round meeting, discussion resulted in retention of 25 criteria after amendments, agreement for 14 criteria with no changes required and deletion of 9 criteria. Two new criteria were added, resulting in a final validated list of 41 prescribing appropriateness criteria. Agreement after round two was reached for all 41 criteria, measured by median panel ratings and the amount of dispersion of panel ratings, based on the interpercentile range. A set of 41 Australian prescribing appropriateness criteria were validated by an expert panel. Use of these criteria, together with clinical judgement and other medication review processes such as patient interview, is intended to assist in improving patient care by efficiently detecting potential DRPs related to commonly occurring medicines and medical conditions in older Australians. These criteria may also contribute to the medication management education of healthcare professionals.
| S-EPMC3467596 | biostudies-literature
Project description:Medicines are the most used health technology in Long-Term Care. The prevalence of potentially inappropriate medicines amongst Long-Term Care patients is high. Pharmacists, assisted by prescribing-assessment tools, can play an important role in optimizing medication use at this level of care. Through a modified RAND/UCLA Appropriateness Method, 13 long-term care and hospital pharmacists assessed as 'appropriate', 'uncertain', or 'inappropriate' a collection of commonly used prescribing-assessment tools as to its suitability in assisting pharmacy practice in institutional long-term care settings. A qualitative analysis of written or transcribed comments of participants was pursued to identify relevant characteristics of prescribing-assessment tools and potential hinders in their use. From 24 different tools, pharmacists classified 9 as 'appropriate' for pharmacy practice targeted to long-term care patients, while 3 were classified as 'inappropriate'. The tools feature most appreciated by study participants was the indication of alternatives to potentially inappropriate medication. Lack of time and/or pharmacists and limited access to clinical information seems to be the most relevant hinders for prescribing-assessment tools used in daily practice.
| S-EPMC8708836 | biostudies-literature
Project description:BackgroundHealth care-related harm is an internationally recognized threat to public health. The United Kingdom's national health services demonstrate that upwards of 90% of health care encounters can be delivered in ambulatory settings. Other countries are transitioning to more family practice-based health care systems, and efforts to understand avoidable harm in these settings is needed.MethodsWe developed 100 scenarios reflecting a range of diseases and informed by the World Health Organization definition of 'significant harm'. Scenarios included different types of patient safety incidents occurring by commission and omission, demonstrated variation in timeliness of intervention, and conditions where evidence-based guidelines are available or absent. We conducted a two-round RAND / UCLA Appropriateness Method consensus study with a panel of family practitioners in England to define "avoidable harm" within family practice. Panelists rated their perceptions of avoidability for each scenario. We ran a k-means cluster analysis of avoidability ratings.ResultsPanelists reached consensus for 95 out of 100 scenarios. The panel agreed avoidable harm occurs when a patient safety incident could have been probably, or totally, avoided by the timely intervention of a health care professional in family practice (e.g. investigations, treatment) and / or an administrative process (e.g. referrals, alerts in electronic health records, procedures for following up results) in accordance with accepted evidence-based practice and clinical governance. Fifty-four scenarios were deemed avoidable, whilst 31 scenarios were rated unavoidable and reflected outcomes deemed inevitable regardless of family practice intervention. Scenarios with low avoidability ratings (1?s or 2?s) were not represented by the categories that were used to generate scenarios, whereas scenarios with high avoidability ratings (7?s 8?s or 9?s) were represented by these a priori categories.DiscussionThe findings from this RAND/UCLA Appropriateness Method study define the characteristics and conditions that can be used to standardize measurement of outcomes for primary care patient safety.ConclusionWe have developed a definition of avoidable harm that has potential for researchers and practitioners to apply across primary care settings, and bolster international efforts to design interventions to target avoidable patient safety incidents that cause the most significant harm to patients.
| S-EPMC6777037 | biostudies-literature
Project description:Background: Discharge from acute mental health inpatient units is often a vulnerable period for patients. Multiple professionals and agencies are involved and processes and procedures are not standardized, often resulting in communication delays and co-ordination failures. Early and appropriate discharge planning and standardization of procedures could make inpatient care safer. Aim: To inform the development of a multi-component best practice guidance for discharge planning (including the 6 component SAFER patient flow bundle) to support safer patient transition from mental health hospitals to the community. Methods: Using the RAND/UCLA Appropriateness method, a panel of 10 professional stakeholders (psychiatrists, psychiatric nurses, clinical psychologists, pharmacists, academics, and policy makers) rated evidence-based statements. Six hundred and sixty-eight statements corresponding to 10 potential components of discharge planning best practice were rated on a 9-point integer scale for clarity, appropriateness and feasibility (median ≥ 7-9) using an online questionnaire then remote online face-to-face meetings. Results: Five of the six "SAFER" patient flow bundle components were appropriate and feasible for inpatient mental health. One component, "Early Flow," was rated inappropriate as mental health settings require more flexibility. Overall, 285 statements were rated as appropriate and feasible. Forty-four statements were considered appropriate but not feasible to implement. Discussion: This consensus study has identified components of a best practice guidance/intervention for discharge planning for UK mental health settings. Although some components describe processes that already happen in everyday clinical interactions (i.e., review by a senior clinician), standardizing such processes could have important safety benefits alongside a tailored and timely approach to post-discharge care.
| S-EPMC8680088 | biostudies-literature
Project description:IntroductionOlder adults have high rates of primary care utilisation, and quality primary care has the potential to address their complex medical needs. Family physicians have different levels of knowledge and skills in caring for older patients, which may influence the quality of care delivery and resulting health outcomes. In this study, we aim to establish consensus on practice-based metrics that characterise quality of care for older primary care patients and can be examined using secondary, administrative data.Methods and analysisWe describe a two-round RAND/UCLA Appropriateness Method (RAM) study to assess the consensus of a technical expert panel. We will recruit pan-Canadian experts who demonstrate excellence in clinical practice or scholarship related to the primary care of older adults. A literature review will generate a candidate list of practice-based quality indicators. The first round aims to evaluate the appropriateness and importance of candidate indicators through an online questionnaire. We will then develop technical definitions for each endorsed indicator using ICES data holdings. Panellists will offer feedback on the technical definitions in a virtual synchronous meeting and provide ratings on the same criteria in a second questionnaire.Ethics and disseminationOur study has been approved by the Hamilton Integrated Research Ethics Board (Project ID #15545). Findings will be disseminated via manuscripts, presentations and the lead author's thesis.Trial registration numberISRCTN17074347.
| S-EPMC10503316 | biostudies-literature
Project description:Bronchial asthma is the most frequent chronic disease in children and affects up to 20% of the pediatric population, depending on the geographical area. Asthma symptoms vary over time and in intensity, and acute asthma attack can resolve spontaneously or in response to therapy. The aim of this project was to define the care pathway for pediatric patients who come to the primary care pediatrician or Emergency Room with acute asthmatic access. The project was developed in the awareness that for the management of these patients, broad coordination of interventions in the pre-hospital phase and the promotion of timely and appropriate assistance modalities with the involvement of all health professionals involved are important. Through the application of the RAND method, which obliges to discuss the statements derived from the guidelines, there was a clear increase in the concordance in the behavior on the management of acute asthma between primary care pediatricians and hospital pediatricians. The RAND method was found to be useful for the selection of good practices forming the basis of an evidence-based approach, and the results obtained form the basis for further interventions that allow optimizing the care of the child with acute asthma attack at the family and pediatric level. An important point of union between the primary care pediatrician and the specialist hospital pediatrician was the need to share spirometric data, also including the use of new technologies such as teleconsultation. Monitoring the progress of asthma through spirometry could allow the pediatrician in the area to intervene early by modifying the maintenance therapy and help the patient to achieve good control of the disease.
| S-EPMC8657661 | biostudies-literature
Project description:BackgroundThe United Kingdom (UK) is experiencing a general practitioner (GP) workforce retention crisis. Research has focused on investigating why GPs intend to quit, but less is known about the acceptability and effectiveness of policies and strategies to improve GP retention. Using evidence from research and key stakeholder organisations, we generated a set of potential policies and strategies aimed at maximising GP retention and tested their appropriateness for implementation by systematically consulting with GPs.Methods28 GP Partners and GPs working in national stakeholder organisations from South West England and London were purposively sampled, and asked to take part in a RAND/UCLA Appropriateness Method panel. Panellists were asked to read an evidence briefing summary, and then complete an online survey on two occasions. During each round, participants rated the appropriateness of policies and strategies aimed at improving GP retention using a nine point scale (1 'extremely inappropriate' to 9 'extremely appropriate'). Fifty-four potential policies and strategies (equating to 100 statements) were tested, focusing on factors influencing job satisfaction (e.g. well-being, workload, incentives and remuneration, flexible working, human resources systems). Ratings were analysed for panel consensus and categorised based on appropriateness ('appropriate', 'uncertain', 'inappropriate').Results12/28 GPs approached agreed to take part, 9/28 completed two rounds of the online survey between February and June 2018. Panellists identified 24/54 policy and strategy areas (41/100 statements) as 'appropriate'. Examples included providing GP practices 'at risk' of experiencing GP shortages with a toolkit for managing recruitment and retention, and interventions to facilitate peer support to enhance health and wellbeing, or support portfolio careers. Strategies to limit GP workload, and manage patient demand were also endorsed.ConclusionsThe panel of experienced GPs identified a number of practical ways to improve GP retention through interventions that might enhance job satisfaction and work-life balance. Future research should evaluate the impact of implementing these recommendations.
| S-EPMC6743144 | biostudies-literature
Project description:Headache is the most frequent neurological symptom in childhood and the main reason for admission to pediatric emergency departments. The aim of this consensus document is to define a shared clinical pathway between primary care pediatricians (PCP) and hospitals for the management of children presenting with headache. For the purposes of the study, a group of hospital pediatricians and a group of PCP from the Emilia Romagna's health districts were selected to achieve consensus using the RAND/UCLA appropriateness method. Thirty-nine clinical scenarios were developed: for each scenario, participants were asked to rank the appropriateness of each option from 1 to 9. Agreement was reached if ≥75% of participants ranked within the same range of appropriateness. The answers, results, and discussion helped to define the appropriateness of procedures with a low level of evidence regarding different steps of the diagnostic-therapeutic process: primary care evaluation, emergency department evaluation, hospital admission, acute therapy, prophylaxis, and follow-up. The RAND proved to be a valid method to value appropriateness of procedures and define a diagnostic-therapeutic pathway suitable to the local reality in the management of pediatric headache. From our results, some useful recommendations were developed for optimizing the healthcare professionals' network among primary care services and hospitals.
| S-EPMC8877535 | biostudies-literature
Project description:BackgroundIron deficiency is a common and undertreated problem in inflammatory bowel disease (IBD).AimTo develop an online tool to support treatment choice at the patient-specific level.MethodsUsing the RAND/UCLA Appropriateness Method (RUAM), a European expert panel assessed the appropriateness of treatment regimens for a variety of clinical scenarios in patients with non-anaemic iron deficiency (NAID) and iron deficiency anaemia (IDA). Treatment options included adjustment of IBD medication only, oral iron supplementation, high-/low-dose intravenous (IV) regimens, IV iron plus erythropoietin-stimulating agent (ESA), and blood transfusion. The panel process consisted of two individual rating rounds (1148 treatment indications; 9-point scale) and three plenary discussion meetings.ResultsThe panel reached agreement on 71% of treatment indications. 'No treatment' was never considered appropriate, and repeat treatment after previous failure was generally discouraged. For 98% of scenarios, at least one treatment was appropriate. Adjustment of IBD medication was deemed appropriate in all patients with active disease. Use of oral iron was mainly considered an option in NAID and mildly anaemic patients without disease activity. IV regimens were often judged appropriate, with high-dose IV iron being the preferred option in 77% of IDA scenarios. Blood transfusion and IV+ESA were indicated in exceptional cases only.ConclusionsThe RUAM revealed high agreement amongst experts on the management of iron deficiency in patients with IBD. High-dose IV iron was more often considered appropriate than other options. To facilitate dissemination of the recommendations, panel outcomes were embedded in an online tool, accessible via http://ferroscope.com/.
| S-EPMC3886296 | biostudies-literature
Project description:BackgroundInternationally, the need for appropriately structured, high-quality care in psycho-oncology is more and more recognized and quality-oriented care is to be established. Quality indicators are becoming increasingly important for a systematic development and improvement of the quality of care. The aim of this study was to develop a set of quality indicators for a new form of care, a cross-sectoral psycho-oncological care program in the German health care system.MethodsThe widely established RAND/UCLA Appropriateness Method was combined with a modified Delphi technique. A systematic literature review was conducted to identify existing indicators. All identified indicators were evaluated and rated in a two-round Delphi process. Expert panels embedded in the Delphi process assessed the indicators in terms of relevance, data availability and feasibility. An indicator was accepted by consensus if at least 75% of the ratings corresponded to category 4 or 5 on a five-point Likert scale.ResultsOf the 88 potential indicators derived from a systematic literature review and other sources, 29 were deemed relevant in the first Delphi round. After the first expert panel, 28 of the dissented indicators were re-rated and added. Of these 57 indicators, 45 were found to be feasible in terms of data availability by the second round of expert panel. In total, 22 indicators were transferred into a quality report, implemented and tested within the care networks for participatory quality improvement. In the second Delphi round, the embedded indicators were tested for their practicability. The final set includes 16 indicators that were operationalized in care practice and rated by the expert panel as relevant, comprehensible, and suitable for care practice.ConclusionThe developed set of quality indicators has proven in practical testing to be a valid quality assurance tool for internal and external quality management. The study findings could contribute to traceable high quality in cross-sectoral psycho-oncology by providing a valid and comprehensive set of quality indicators.Trial registration"Entwicklung eines Qualitätsmanagementsystems in der integrierten, sektorenübergreifenden Psychoonkologie-AP "Qualitätsmanagement und Versorgungsmanagement" zur Studie "integrierte, sektorenübergreifende Psychoonkologie (isPO)" a sub-project of the "integrierte, sektorenübergreifende Psychoonkologie (isPO)", was registered in the German Clinical Trials Register (DRKS) (DRKS-ID: DRKS00021515) on 3rd September 2020. The main project was registered on 30th October 2018 (DRKS-ID: DRKS00015326).
| S-EPMC10249931 | biostudies-literature