Rating Communication in GP Consultations: The Association Between Ratings Made by Patients and Trained Clinical Raters.
Ontology highlight
ABSTRACT:
SUBMITTER: Burt J
PROVIDER: S-EPMC5858640 | biostudies-literature | 2018 Apr
REPOSITORIES: biostudies-literature
Publications
Rating Communication in GP Consultations: The Association Between Ratings Made by Patients and Trained Clinical Raters.
Burt Jenni J Abel Gary G Elmore Natasha N Newbould Jenny J Davey Antoinette A Llanwarne Nadia N Maramba Inocencio I Paddison Charlotte C Benson John J Silverman Jonathan J Elliott Marc N MN Campbell John J Roland Martin M
Medical care research and review : MCRR 20161003 2
Patient evaluations of physician communication are widely used, but we know little about how these relate to professionally agreed norms of communication quality. We report an investigation into the association between patient assessments of communication quality and an observer-rated measure of communication competence. Consent was obtained to video record consultations with Family Practitioners in England, following which patients rated the physician's communication skills. A sample of consult ...[more]
Similar Datasets
Project description:BACKGROUND:The aim of the study was to confirm the validity and reliability of the Observation Scheme-12, a measurement tool for rating clinical communication skills. METHODS:The study is a sub-study of an intervention study using audio recordings to assess the outcome of communication skills training. This paper describes the methods used to validate the assessment tool Observation Scheme-12 by operationalizing the crude 5-point scale into specific elements described in a codebook. Reliability was tested by calculating the intraclass correlation coefficients for interrater and intrarater reliability. RESULTS:The validation of the Observation Scheme-12 produced a rating tool with 12 items. Each item has 0 to 5 described micro-skills. For each item, the codebook described the criteria for delivering a rating from 0 to 4 depending on how successful the different micro-skills (or number of used jargon words) was accomplished. Testing reliability for the overall score intraclass correlation coefficients was 0.74 for interrater reliability and 0.86 for intrarater reliability. An intraclass correlation coefficient greater than 0.5 was observed for 10 of 12 items. CONCLUSION:The development of a codebook as a supplement to the assessment tool Observation Scheme-12 enables an objective rating of audiotaped clinical communication with acceptable reliability. The Observation Scheme-12 can be used to assess communication skills based on the Calgary-Cambridge Guide.
| S-EPMC7201796 | biostudies-literature
Project description:Little information is available about whether the use of self-assessment instruments in primary care affects depression course and outcome. The purpose was to evaluate whether using a depression self-rating scale in recurrent person-centred GP consultations affected depression severity, quality of life, medication use, and sick leave frequency.Patients in the intervention group met their GP regularly at least 4 times during the 3 months intervention. In addition to treatment as usual (TAU), patients completed a self-assessment instrument (Montgomery-Asberg Depression Rating Scale) on each occasion, and then GPs used the completed instrument as the basis for a person-centred discussion of changes in depression symptoms. The control group received TAU. Frequency of visits in the TAU arm was the result of the GPs' and patients' joint assessments of care need in each case. Depression severity was measured with Beck Depression Inventory-II (BDI-II), quality of life with EQ-5D, and psychological well-being with the General Health Questionnaire-12 (GHQ-12). Data on sick leave, antidepressant and sedatives use, and care contacts were collected from electronic patient records. All variables were measured at baseline and 3, 6, and 12 months. Mean intra-individual changes were compared between the intervention and TAU group.There were no significant differences between the intervention and control group in depression severity reduction or remission rate, change in quality of life, psychological well-being, sedative prescriptions, or sick leave during the whole 12-month follow-up. However, significantly more patients in the intervention group continued antidepressants until the 6 month follow-up (86/125 vs 78/133, p?<?0.05).When GPs used a depression self-rating scale in recurrent consultations, patients more often continued antidepressant medication according to guidelines, compared to TAU patients. However, reduction of depressive symptoms, remission rate, quality of life, psychological well-being, sedative use, sick leave, and health care use 4-12 months was not significantly different from the TAU group. These findings suggest that frequent use of depression rating scales in person-centred primary care consultations has no further additional effect on patients' depression or well-being, sick leave, or health care use.ClinicalTrials.gov Identifier: NCT01402206 . Registered June 27 2011(retrospectively registered).
| S-EPMC5244530 | biostudies-literature
Project description:We consider the problem of assessing inter-rater agreement when there are missing data and a large number of raters. Previous studies have shown only 'moderate' agreement between pathologists in grading breast cancer tumour specimens. We analyse a large but incomplete data-set consisting of 24,177 grades, on a discrete 1-3 scale, provided by 732 pathologists for 52 samples.We review existing methods for analysing inter-rater agreement for multiple raters and demonstrate two further methods. Firstly, we examine a simple non-chance-corrected agreement score based on the observed proportion of agreements with the consensus for each sample, which makes no allowance for missing data. Secondly, treating grades as lying on a continuous scale representing tumour severity, we use a Bayesian latent trait method to model cumulative probabilities of assigning grade values as functions of the severity and clarity of the tumour and of rater-specific parameters representing boundaries between grades 1-2 and 2-3. We simulate from the fitted model to estimate, for each rater, the probability of agreement with the majority. Both methods suggest that there are differences between raters in terms of rating behaviour, most often caused by consistent over- or under-estimation of the grade boundaries, and also considerable variability in the distribution of grades assigned to many individual samples. The Bayesian model addresses the tendency of the agreement score to be biased upwards for raters who, by chance, see a relatively 'easy' set of samples.Latent trait models can be adapted to provide novel information about the nature of inter-rater agreement when the number of raters is large and there are missing data. In this large study there is substantial variability between pathologists and uncertainty in the identity of the 'true' grade of many of the breast cancer tumours, a fact often ignored in clinical studies.
| S-EPMC2488396 | biostudies-other
Project description:BackgroundPhysician rating websites (PRWs) have been developed as part of a wider move toward transparency around health care quality, and these allow patients to anonymously rate, comment, and discuss physicians' quality on the Web. The first Swiss PRWs were established in 2008, at the same time as many international PRWs. However, there has been limited research conducted on PRWs in Switzerland to date. International research has indicated that a key shortcoming of PRWs is that they have an insufficient number of ratings.ObjectiveThe aim of this study was to examine the frequency of quantitative ratings and narrative comments on the Swiss PRWs.MethodsIn November 2017, a random stratified sample of 966 physicians was generated from the regions of Zürich and Geneva. Every selected physician was searched for on 4 rating websites (OkDoc, DocApp, Medicosearch, and Google) between November 2017 and July 2018. It was recorded whether the physician could be identified, what the physician's quantitative rating was, and whether the physician had received narrative comments. In addition, Alexa Internet was used to examine the number of visitors to the PRWs, compared with other websites.ResultsOverall, the portion of physicians able to be identified on the PRWs ranged from 42.4% (410/966) on OkDoc to 87.3% (843/966) on DocApp. Of the identifiable physicians, only a few of the selected physicians had been rated quantitatively (4.5% [38/843] on DocApp to 49.8% [273/548] on Google) or received narrative comments (4.5% [38/843] on DocApp to 31.2% [171/548] on Google) at least once. Rated physicians also had, on average, a low number of quantitative ratings (1.47 ratings on OkDoc to 3.74 rating on Google) and narrative comments (1.23 comment on OkDoc to 3.03 comments on Google). All 3 websites allowing ratings used the same rating scale (1-5 stars) and had a very positive average rating: DocApp (4.71), Medicosearch (4.69), and Google (4.41). There were significant differences among the PRWs (with the majority of ratings being posted on Google in past 2 years) and regions (with physicians in Zurich more likely to have been rated and have more ratings on average). Only Google (position 1) and Medicosearch (position 8358) are placed among the top 10,000 visited websites in Switzerland.ConclusionsIt appears that this is the first time Google has been included in a study examining physician ratings internationally and it is noticeable how Google has had substantially more ratings than the 3 dedicated PRWs in Switzerland over the past 2 and a half years. Overall, this study indicates that Swiss PRWs are not yet a reliable source of unbiased information regarding patient experiences and satisfaction with Swiss physicians; many selected physicians were unable to be identified, only a few physicians had been rated, and the ratings posted were overwhelmingly positive.
| S-EPMC6688440 | biostudies-literature
Project description:To investigate initial reliability of the Global Consultation Rating Scale (GCRS: an instrument to assess the effectiveness of communication across an entire doctor-patient consultation, based on the Calgary-Cambridge guide to the medical interview), in simulated patient consultations.Multiple ratings of simulated general practitioner (GP)-patient consultations by trained GP evaluators.UK primary care.21 GPs and six trained GP evaluators.GCRS score.6 GP raters used GCRS to rate randomly assigned video recordings of GP consultations with simulated patients. Each of the 42 consultations was rated separately by four raters. We considered whether a fixed difference between scores had the same meaning at all levels of performance. We then examined the reliability of GCRS using mixed linear regression models. We augmented our regression model to also examine whether there were systematic biases between the scores given by different raters and to look for possible order effects.Assessing the communication quality of individual consultations, GCRS achieved a reliability of 0.73 (95% CI 0.44 to 0.79) for two raters, 0.80 (0.54 to 0.85) for three and 0.85 (0.61 to 0.88) for four. We found an average difference of 1.65 (on a 0-10 scale) in the scores given by the least and most generous raters: adjusting for this evaluator bias increased reliability to 0.78 (0.53 to 0.83) for two raters; 0.85 (0.63 to 0.88) for three and 0.88 (0.69 to 0.91) for four. There were considerable order effects, with later consultations (after 15-20 ratings) receiving, on average, scores more than one point higher on a 0-10 scale.GCRS shows good reliability with three raters assessing each consultation. We are currently developing the scale further by assessing a large sample of real-world consultations.
| S-EPMC3948635 | biostudies-literature
Project description:BackgroundPeople with intellectual disabilities (IDs) face significant communication barriers when accessing health care services; they find it difficult to identify and describe conditions clearly enough to support practitioners in making an accurate diagnosis. In addition, medical professionals generally have little knowledge and understanding of the needs of people with ID, which may result in the use of consultation techniques that do not cater to their patients' skills.ObjectiveThis review aims to identify and synthesize the literature on alternative and augmentative communication technologies that are used to support adults with mild ID during the exchange of information with medical practitioners.MethodsWe performed a scoping review of studies published in English that describe the technologies that are used to promote communication with patients with mild ID during medical consultations. The databases searched were PubMed, ACM Digital Library, and Google Scholar. A qualitative framework-based approach was used to synthesize the data and discern key recurring themes across the identified literature.ResultsOf the 1557 articles screened, 15 (0.96%) met our inclusion criteria. The bulk of the communication aids used focused on low-tech solutions, including patient passports, note-based prompts, Talking Mats, health diaries, and easy-read information sheets. Their influence on current practice ranged from advancing medical professionals' knowledge of the health and communication needs of people with ID to increasing interagency collaboration, patient advocacy skills, and health promotion activities. The major barriers to the implementation of low-tech aids were a lack of portability and increased maintenance efforts. Only 3 studies explored the use of mobile apps to promote communication. Their findings indicated that high-tech solutions offer greater customization with regard to the accessibility and health care needs of people with ID.ConclusionsAlternative and augmentative communication technologies have the potential to increase the quality of care provided to patients with mild ID; however, little work has been carried out in this area. Greater emphasis must be placed on (high-tech) two-way communication aids that empower patients to become involved in decisions regarding their care. Quantitative evaluation methods should be used to discern the true benefits of such aids, and researchers should describe their study protocols in depth to promote replication and generalizability.
| S-EPMC8235287 | biostudies-literature
Project description:BackgroundPatient hand-offs at physician shift changes have limited ability to convey the primary team's longitudinal insight. The Patient Acuity Rating (PAR) is a previously validated, 7-point scale that quantifies physician judgment of patient stability, where a higher score indicates a greater risk of clinical deterioration. Its impact on cross-covering physician understanding of patients is not known.ObjectiveTo determine PAR contribution to sign-outs.DesignCross-sectional survey.SubjectsIntern physicians at a university teaching hospital.InterventionsSubjects were surveyed using randomly chosen, de-identified patient sign-outs, previously assigned PAR scores by their primary teams. For each sign-out, subjects assigned a PAR score, then responded to hypothetical cross-cover scenarios before and after being informed of the primary team's PAR.Main measureChanges in intern assessment of the scenario before and after being informed of the primary team's PAR were measured. In addition, responses between novice and experienced interns were compared.Key resultsBetween May and July 2008, 23 of 39 (59 %) experienced interns and 25 of 42 (60 %) novice interns responded to 480 patient scenarios from ten distinct sign-outs. The mean PAR score assigned by subjects was 4.2 ± 1.6 vs. 3.8 ± 1.8 by the primary teams (p < 0.001). After viewing the primary team's PAR score, interns changed their level of concern in 47.9 % of cases, their assessment of the importance of immediate bedside evaluation in 48.7 % of cases, and confidence in their assessment in 43.2 % of cases. For all three assessments, novice interns changed their responses more frequently than experienced interns (p = 0.03, 0.009, and <0.001, respectively). Overall interns reported the PAR score to be theoretically helpful in 70.8 % of the cases, but this was more pronounced in novice interns (81.2 % vs 59.6 %, p < 0.001).ConclusionsThe PAR adds valuable information to sign-outs that could impact cross-cover decision-making and potentially benefit patients. However, correct training in its use may be required to avoid unintended consequences.
| S-EPMC3579954 | biostudies-literature
Project description:BACKGROUND: There is a paucity of research evidence concerning communication in paediatric consultations between GPs, adults, and child patients. AIM: This study was carried out to identify features of the interaction between a doctor, a child patient aged 6-12 years, and their carer in the consultation associated with the child's participation. DESIGN OF STUDY: A qualitative analysis of video recordings of 31 primary care paediatric consultations was undertaken, using strategies from the methodology of conversation analysis. SETTING: Primary care, Suffolk, UK. METHOD: NHS GPs from three primary care trusts (PCTs), were invited to participate in this study. Sixteen volunteers from this sample took part. RESULTS: Analysis of the interaction in the consultations revealed that the children had little involvement. Children participated when invited to do so, and took more time than adults to answer a doctor's question. An adult carer was less likely to answer on behalf of a child, when they were in a position to see that the doctor's gaze was directed at the child, and the doctor addressed the child by name. Adult carers, who had not voiced their own concerns first, were seen to interrupt doctor-child talk. In consultations where the participants sat in a triangular arrangement, all parties being an equal distance apart, triadic talk was noted. CONCLUSION: Child involvement in the primary care consultation is associated with adult carers being able to voice their own concerns early in the consultation, and children being invited to speak with the appropriate recipient design.
| S-EPMC2169310 | biostudies-literature
Project description:Background and purposeTelestroke has been demonstrated to be a cost-effective means to expand access to care and improve outcomes in stroke; however, information on patient perceptions of this system of care delivery are limited. This study seeks to examine patient feedback of a national telestroke system within the Veterans Health Administration.MethodsPatients who received a telestroke consultation were eligible for a phone interview 2 weeks later, including questions about technology quality, telepresence, and telestroke provider communication. Satisfaction scores ranged from 1 to 7 (higher=more satisfied) and for analyses were dichotomized as 6 to 7 indicating high satisfaction versus <6. Patient variables including stroke severity (measured by the National Institutes of Health Stroke Scale) were obtained from study records. Generalized estimating equation models were used to determine what factors were associated with patient satisfaction.ResultsOver 18 months, 186 interviews were completed, and 142 (76%) reported high satisfaction with telestroke. Patients with more severe stroke were less likely to recall the consultation. Factors significantly associated with patient satisfaction were higher ratings of the technology (P<0.0001), telepresence (P<0.0001), provider communication ratings (P<0.0001), and overall Veterans Affairs satisfaction (P=0.02). In the multivariate model, telepresence (odds ratio, 3.10 [95% CI, 1.81-5.31]) and provider ratings (odds ratio, 2.37 [95% CI, 1.20-4.68]) were independently associated with satisfaction. Veterans who were satisfied were more likely to recommend the technology (P<0.0001).ConclusionsProvider qualities, including telepresence and provider ratings, were associated with overall Veteran satisfaction with the telestroke consultation. Technology quality may be necessary but not sufficient to impact patient experience. Training providers to improve telepresence could improve patient experience with telestroke consultation.
| S-EPMC7770021 | biostudies-literature
Project description:Childhood aggressive behavior (AGG) has a substantial heritability of around 50%. Here we present a genome-wide association meta-analysis (GWAMA) of childhood AGG, in which all phenotype measures across childhood ages from multiple assessors were included. We analyzed phenotype assessments for a total of 328 935 observations from 87 485 children aged between 1.5 and 18 years, while accounting for sample overlap. We also meta-analyzed within subsets of the data, i.e., within rater, instrument and age. SNP-heritability for the overall meta-analysis (AGGoverall) was 3.31% (SE = 0.0038). We found no genome-wide significant SNPs for AGGoverall. The gene-based analysis returned three significant genes: ST3GAL3 (P = 1.6E-06), PCDH7 (P = 2.0E-06), and IPO13 (P = 2.5E-06). All three genes have previously been associated with educational traits. Polygenic scores based on our GWAMA significantly predicted aggression in a holdout sample of children (variance explained = 0.44%) and in retrospectively assessed childhood aggression (variance explained = 0.20%). Genetic correlations (rg) among rater-specific assessment of AGG ranged from rg = 0.46 between self- and teacher-assessment to rg = 0.81 between mother- and teacher-assessment. We obtained moderate-to-strong rgs with selected phenotypes from multiple domains, but hardly with any of the classical biomarkers thought to be associated with AGG. Significant genetic correlations were observed with most psychiatric and psychological traits (range [Formula: see text]: 0.19-1.00), except for obsessive-compulsive disorder. Aggression had a negative genetic correlation (rg = ~-0.5) with cognitive traits and age at first birth. Aggression was strongly genetically correlated with smoking phenotypes (range [Formula: see text]: 0.46-0.60). The genetic correlations between aggression and psychiatric disorders were weaker for teacher-reported AGG than for mother- and self-reported AGG. The current GWAMA of childhood aggression provides a powerful tool to interrogate the rater-specific genetic etiology of AGG.
| S-EPMC8324785 | biostudies-literature