Dataset Information

Referral Decision Making of General Practitioners: A Signal Detection Study.

ABSTRACT:

Background

Signal detection theory (SDT) describes how respondents categorize ambiguous stimuli over repeated trials. It measures separately "discrimination" (ability to recognize a signal amid noise) and "criterion" (inclination to respond "signal" v. "noise"). This is important because respondents may produce the same accuracy rate for different reasons. We employed SDT to measure the referral decision making of general practitioners (GPs) in cases of possible lung cancer.

Methods

We constructed 44 vignettes of patients for whom lung cancer could be considered and estimated their 1-year risk. Under UK risk-based guidelines, half of the vignettes required urgent referral. We recruited 216 GPs from practices across England. Practices differed in the positive predictive value (PPV) of their urgent referrals (chance of referrals identifying cancer) and the sensitivity (chance of cancer patients being picked up via urgent referral from their practice). Participants saw the vignettes online and indicated whether they would refer each patient urgently or not. We calculated each GP's discrimination ( d?') and criterion ( c) and regressed these on practice PPV and sensitivity, as well as on GP experience and gender.

Results

Criterion was associated with practice PPV: as PPV increased, GPs' c also increased, indicating lower inclination to refer ( b = 0.06 [0.02-0.09]; P = 0.001). Female GPs were more inclined to refer than male GPs ( b = -0.20 [-0.40 to -0.001]; P = 0.049). Average discrimination was modest ( d' = 0.77), highly variable (range, -0.28 to 1.91), and not associated with practice referral performance.

Conclusions

High referral PPV at the organizational level indicates GPs' inclination to avoid false positives, not better discrimination. Rather than bluntly mandating increases in practice PPV via more referrals, it is necessary to increase discrimination by improving the evidence base for cancer referral decisions.

SUBMITTER: Kostopoulou O

PROVIDER: S-EPMC6311616 | biostudies-literature | 2019 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Referral Decision Making of General Practitioners: A Signal Detection Study.

Kostopoulou Olga O Nurek Martine M Cantarella Simona S Okoli Grace G Fiorentino Francesca F Delaney Brendan C BC

Medical decision making : an international journal of the Society for Medical Decision Making 20190101 1

<h4>Background</h4>Signal detection theory (SDT) describes how respondents categorize ambiguous stimuli over repeated trials. It measures separately "discrimination" (ability to recognize a signal amid noise) and "criterion" (inclination to respond "signal" v. "noise"). This is important because respondents may produce the same accuracy rate for different reasons. We employed SDT to measure the referral decision making of general practitioners (GPs) in cases of possible lung cancer.<h4>Methods</ ...[more]

PMID: 30799690

Similar Datasets

Project description:BackgroundGeneral practitioners (GPs) provide the most antidepressant prescriptions and psychologist referrals in Australia, yet little is known about how they decide between treatments for depressive symptoms.AimsThis study examined the decision cues that GPs use when deciding how to treat depressive symptoms and the meaning they attribute to these associations.MethodsStructured interviews were conducted with 16 Australian GPs in a "think-aloud" verbal protocol analysis format. The transcripts were analyzed using content coding and thematic analysis, informed by the dual processes model of decision making.ResultsParticipants associated prescribing antidepressants with severe depressive symptoms, and psychologist referrals were the preferred initial treatment provided patients were willing to engage. Four main themes emerged from the thematic analysis: 1) psychologist as default, 2) the risk is just too high, 3) medication as supplement, and 4) drivers of antidepressants. Contrary to previous findings, participants identified a strong heuristic association between depressive symptoms and psychologist referral. Antidepressant prescription was associated with severe symptoms, higher risk, and a cluster of cues that lead them away from psychologist referral.ConclusionsParticipants demonstrated an oversensitivity to depressive symptom severity, associating psychologist referrals with subclinical depressive symptoms, and starting antidepressants for suicidal ideation and significant functional decline.HighlightsPsychologist referrals were the default preference for GPs when treating depressive symptoms, whereas antidepressants were reserved for patients with elevated risk from severe depressive symptoms and suicidal ideation.Participants' conceptualization of depression severity was oversensitive compared with treatment guidelines.Contrary to treatment guidelines, GPs in this study demonstrated their discomfort for referring patients with suicidal ideation to a psychologist without initiating antidepressants.GPs should consider whether patients within their mild to moderate assessment range can be treated exclusively with more cost-effective means than psychological therapy such as e-mental health programs, guided self-help, and lifestyle changes alone.

Project description:BackgroundMedical decision-making relies partly on the probability of disease. Current recommendations for the management of common diseases are based increasingly on scores that use arbitrary probability thresholds.ObjectiveTo assess decision-making in pharyngitis and appendicitis using a set of clinical vignettes, and the extent to which management is congruent with the true probability of having the disease.DesignWe developed twenty-four clinical vignettes with clinical presentations corresponding to specific probabilities of having disease defined by McIsaac (pharyngitis) or Alvarado (appendicitis) scores. Each participant answered four randomly selected web-based vignettes.ParticipantsGeneral practitioners (GP) working in primary care structures in Switzerland and the USA.Main measuresA comparison between the GP's management decision according to the true probability of having the disease and to the GP's estimated probability, investigating the GP's ability to estimate probability of disease.Key resultsThe mean age of the GPs was 48 years (SD 12) and 66% were men. The correlation between the GP's clinical management decision based on the vignette and the recommendations was stronger for appendicitis than pharyngitis (kw = 0.74, 95% CI 0.70-0.78 vs. kw = 0.66, 95% CI 0.62-0.71). On the other hand, the association between the clinical management decision and the probability of disease estimated by GPs was more congruent with recommendations for pharyngitis than appendicitis (kw = 0.70, 95% CI 0.66-0.73 vs. 0.61, 95% CI 0.56-0.66). Only a minority of GPs correctly estimated the probability of disease (29% for appendicitis and 39% for pharyngitis).ConclusionsDespite the fact that general practitioners often misestimate the probability of disease, their management decisions are usually in line with recommendations. This means that they use other approaches, perhaps more subjective, to make decisions, such as clinical judgment or reasoning that integrate factors other than just the risk of the disease.

Project description:IntroductionThe participation of general practitioners (GPs) in primary care research is variable and often poor. We aimed to develop a substantive and empirical theoretical framework to explain GPs' decision-making process to participate in research.MethodsWe used the grounded theory approach to construct a substantive theory to explain the decision-making process of GPs to participate in research activities. Five in-depth interviews and four focus group discussions were conducted among 21 GPs. Purposeful sampling followed by theoretical sampling were used to attempt saturation of the core category. Data were collected using semi-structured open-ended questions. Interviews were recorded, transcribed verbatim and checked prior to analysis. Open line-by-line coding followed by focus coding were used to arrive at a substantive theory. Memoing was used to help bring concepts to higher abstract levels.ResultsThe GPs' decision to participate in research was attributed to their inner drive and appreciation for primary care research and their confidence in managing their social and research environments. The drive and appreciation for research motivated the GPs to undergo research training to enhance their research knowledge, skills and confidence. However, the critical step in the GPs' decision to participate in research was their ability to align their research agenda with priorities in their social environment, which included personal life goals, clinical practice and organisational culture. Perceived support for research, such as funding and technical expertise, facilitated the GPs' participation in research. In addition, prior experiences participating in research also influenced the GPs' confidence in taking part in future research.ConclusionsThe key to GPs deciding to participate in research is whether the research agenda aligns with the priorities in their social environment. Therefore, research training is important, but should be included in further measures and should comply with GPs' social environments and research support.

Project description:BackgroundLittle research has examined whether shared decision making (SDM) occurs in consultations for acute respiratory infections (ARIs), including what, and how, antibiotic benefits and harms are discussed. We aimed to analyse the extent and nature of SDM in consultations between GPs and patients with ARIs, and explore communication with and without the use of patient decision aids.MethodsThis was an observational study in Australian general practices, nested within a cluster randomised trial of decision aids (for acute otitis media [AOM], sore throat, acute bronchitis) designed for general practitioners (GPs) to use with patients, compared with usual care (no decision aids). Audio-recordings of consultations of a convenience sample of consenting patients seeing a GP for an ARI were independently analysed by two raters using the OPTION-12 (observing patient involvement in decision making) scale (maximum score of 100) and 5 items (about communicating evidence) from the Assessing Communication about Evidence and Patient Preferences (ACEPP) tool (maximum score of 5). Patients also self-completed a questionnaire post-consultation that contained items from CollaboRATE-5 (perceptions of involvement in the decision-making process), a decisional conflict scale, and a decision self-efficacy scale. Descriptive statistics were calculated for each measure.ResultsThirty-six consultations, involving 13 GPs, were recorded (20 for bronchitis, 10 sore throat, 6 AOM). The mean (SD) total OPTION-12 score was 29.4 (12.5; range 4-54), with item 12 (need to review decision) the highest (mean = 3) and item 10 (eliciting patients' preferred level of decision-making involvement) the lowest (mean = 0.1). The mean (SD) total ACEPP score was 2 (1.6), with the item about discussing benefits scoring highest. In consultations where a decision aid was used (15, 42%), compared to the 21 usual care consultations, mean observer-assessed SDM scores (OPTION-12, ACEPP scores) were higher and antibiotic harms mentioned in all (compared to only 1) consultations. Patients generally reported high decision involvement and self-efficacy, and low decisional conflict.ConclusionsThe extent of observer-assessed SDM between GPs and patients with ARIs was generally low. Balanced discussion of antibiotic benefits and harms occurred more often when decision aids were used.

Project description:BackgroundA number of studies have identified advanced age as a barrier to accessing specialised oncological care. Many factors can influence the care provided for elderly patients after a diagnosis of cancer has been established or is suspected. Only one European study has analysed the decision processes leading general practitioners (GPs) to refer elderly patients with cancer to oncologists. The objectives of the current study are to describe the factors that influence these decisions and to identify the particular factors and GP characteristics that are associated with systematic referral of these patients in South-West France.MethodsThis is a cross-sectional study on a representative sample of GPs in Aquitaine, South-West France. Questionnaire items were selected using a Delphi consensus approach and sent by post. Two logistic regression models were constructed to investigate GPs' decisions to refer these patients.ResultsThe response rate obtained was 30%. Half of the general practitioners reported "always" referring their elderly cancer patients to oncologists. More than 75% reported being influenced by patient-related elements (patient and/or family wishes, comorbid factors, unsuitability of invasive investigations, physical and mental autonomy), by cancer-related elements (severity of symptoms, expected side-effects) and an organisational element (whether the general practitioner was used to collaborating with oncologists). Logistic regression analysis showed that cancer site and organisational difficulties in patient management were significantly associated with the decision to refer elderly patients with early-stage cancer. For advanced stages, oncology training, patient age, organisational difficulties in patient management and stage of cancer were significantly associated with the decision to refer elderly patients.ConclusionsCancer-linked factors and organisational difficulties have been highlighted as influencing the decisions of GPs in the referral of elderly patients to a cancer team. These results highlight the need to implement continuous medical education specific for the management of elderly patients, to better apprehend the nature of these difficulties and to suggest solutions suited to local settings.

Project description:BackgroundDiagnostic errors are a major cause of preventable patient harm. Studies suggest that presenting inaccurate diagnostic suggestions can cause errors in physicians' diagnostic reasoning processes. It is common practice for general practitioners (GPs) to suggest a diagnosis when referring a patient to secondary care. However, it remains unclear via which underlying processes this practice can impact diagnostic performance. This study therefore examined the effect of a diagnostic suggestion in a GP's referral letter to the emergency department on the diagnostic performance of medical interns.MethodsMedical interns diagnosed six clinical cases formatted as GP referral letters in a randomized within-subjects experiment. They diagnosed two referral letters stating a main complaint without a diagnostic suggestion (control), two stating a correct suggestion, and two stating an incorrect suggestion. The referral question and case order were randomized. We analysed the effect of the referral question on interns' diagnostic accuracy, number of differential diagnoses, confidence, and time taken to diagnose.ResultsForty-four medical interns participated. Interns considered more diagnoses in their differential without a suggested diagnosis (M = 1.85, SD = 1.09) than with a suggested diagnosis, independent of whether this suggestion was correct (M = 1.52, SD = 0.96, d = 0.32) or incorrect ((M = 1.42, SD = 0.97, d = 0.41), χ2(2) =7.6, p = 0.022). The diagnostic suggestion did not influence diagnostic accuracy (χ2(2) = 1.446, p = 0.486), confidence, (χ2(2) = 0.058, p = 0.971) or time to diagnose (χ2(2) = 3.128, p = 0.209).ConclusionsA diagnostic suggestion in a GPs referral letter did not influence subsequent diagnostic accuracy, confidence, or time to diagnose for medical interns. However, a correct or incorrect suggestion reduced the number of diagnoses considered. It is important for healthcare providers and teachers to be aware of this phenomenon, as fostering a broad differential could support learning. Future research is necessary to examine whether these findings generalize to other healthcare workers, such as more experienced specialists or triage nurses, whose decisions might affect the diagnostic process later on.Trial registrationThe study protocol was preregistered and is available online at Open Science Framework ( https://osf.io/7de5g ).

Dataset Information

Referral Decision Making of General Practitioners: A Signal Detection Study.

Background

Methods

Results

Conclusions

Publications

Referral Decision Making of General Practitioners: A Signal Detection Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets