Assessing anaesthesiology and intensive care specialty physicians: An Italian language multisource feedback system.
Ontology highlight
ABSTRACT: Background
Physician professionalism, including anaesthesiologists and intensive care doctors, should be continuously assessed during training and subsequent clinical practice. Multi-source feedback (MSF) is an assessment system in which healthcare professionals are assessed on several constructs (e.g., communication, professionalism, etc.) by multiple people (medical colleagues, coworkers, patients, self) in their sphere of influence. MSF has gained widespread acceptance for both formative and summative assessment of professionalism for reflecting on how to improve clinical practice.Methods
Instrument development and psychometric analysis (feasibility, reliability, construct validity via exploratory factor analysis) for MSF questionnaires in a postgraduate specialty training in Anaesthesiology and intensive care in Italy. Sixty-four residents at the Università del Piemonte Orientale (Italy) Anesthesiology Residency Program. Main outcomes assessed were: development and psychometric testing of 4 questionnaires: self, medical colleague, coworker and patient assessment.Results
Overall 605 medical colleague questionnaires (mean of 9.3 ±1.9) and 543 coworker surveys (mean 8.4 ±1.4) were collected providing high mean ratings for all items (> 4.0 /5.0). The self-assessment item mean score ranged from 3.1 to 4.3. Patient questionnaires (n = 308) were returned from 31 residents (40%; mean 9.9 ± 6.2). Three items had high percentages of "unable to assess" (> 15%) in coworker questionnaires. Factor analyses resulted in a two-factor solution: clinical management with leadership and accountability accounting for at least 75% of the total variance for the medical colleague and coworker's survey with high internal consistency reliability (Cronbach's α > 0.9). Patient's questionnaires had a low return rate, a limited exploratory analysis was performed.Conclusions
We provide a feasible and reliable Italian language MSF instrument with evidence of construct validity for the self, coworkers and medical colleague. Patient feedback was difficult to collect in our setting.
SUBMITTER: Carenzo L
PROVIDER: S-EPMC8064525 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundTerms representing chemical concepts found the Unified Medical Language System (UMLS) are used to derive an expanded semantic network with mutually exclusive semantic types. The UMLS Semantic Network (SN) is composed of a collection of broad categories called semantic types (STs) that are assigned to concepts. Within the UMLS's coverage of the chemical domain, we find a great deal of concepts being assigned more than one ST. This leads to the situation where the extent of a given ST may contain concepts elaborating variegated semantics.A methodology for expanding the chemical subhierarchy of the SN into a finer-grained categorization of mutually exclusive types with semantically uniform extents is presented. We call this network a Chemical Specialty Semantic Network (CSSN). A CSSN is derived automatically from the existing chemical STs and their assignments. The methodology incorporates a threshold value governing the minimum size of a type's extent needed for inclusion in the CSSN. Thus, different CSSNs can be created by choosing different threshold values based on varying requirements.ResultsA complete CSSN is derived using a threshold value of 300 and having 68 STs. It is used effectively to provide high-level categorizations for a random sample of compounds from the "Chemical Entities of Biological Interest" (ChEBI) ontology. The effect on the size of the CSSN using various threshold parameter values between one and 500 is shown.ConclusionsThe methodology has several potential applications, including its use to derive a pre-coordinated guide for ST assignments to new UMLS chemical concepts, as a tool for auditing existing concepts, inter-terminology mapping, and to serve as an upper-level network for ChEBI.
| S-EPMC3428652 | biostudies-literature
Project description:Burnout is one of the main chronic health problems with negative consequences on caregivers but also on the quality of care. This is a multidimensional occupational syndrome, characterized by three main criteria: emotional exhaustion (EE), depersonalization (DP), and low personal accomplishment (PA). Burnout is particularly identified in professionals working in caregiving and human services, especially the ones who are interpersonally stressed and emotionally vulnerable. Intensive care professionals seem to face a critical risk of burnout. This study aiming to evaluate the occurrence and the risk factors of burnout among Italian anesthesiologists and intensive care physicians. All members included in the mailing list of the Italian Society of Anesthesia, Analgesia, and Intensive Care were invited to participate in an online survey. An anonymous questionnaire was distributed via a specific website. Burnout was measured using the Maslach Burnout Inventory (MBI) questionnaire. All responses were evaluated through univariate and multivariable logistic regression. A total of 859 physicians out of 3,654 (23.5%) participated in this online survey. According to the MBI criteria for a high degree of burnout, 10.2% (88) of the respondents reported high EE, high DP, and low PA together; 79.9% (686) exhibited a moderate degree of burnout; and 9.9% (85) reported a low degree of burnout, with normal values in all three of the explored psychological dimensions. This study reported mostly a moderate level of burnout among Italian anesthesiologist and intensive care physicians since we found 10.2% incidence for high degree of burnout according to the MBI criteria.
| S-EPMC7383656 | biostudies-literature
Project description:ObjectivesTrauma resuscitations require competence in both clinical and nonclinical skills but these can be difficult to observe and assess. Multisource feedback (MSF) is workplace-based, involves the direct observation of learners, and can provide feedback on nonclinical skills. We sought to compare and contrast the priorities of multidisciplinary trauma team members when assessing resident trauma team captain (TTC) performance. Additionally, we aimed to describe the nature of the assessment and perceived the utility of incorporating MSF into the trauma context.MethodsA convenience sample of 10 trauma team activations were observed. Following each activation, the attending physician trauma team leader (TTL), TTC, and a registered nurse (RN) participated in a semistructured interview. MSF was not provided to the TTC for the purpose of this study because MSF was not part of the assessment process of TTCs at the time of this study and maintaining anonymity may have encouraged more honest interview responses. Transcripts from each assessor group (TTL, TTC, RN) were coded and assigned to one of the five crisis resource management skills: leadership, communication, situational awareness, resource utilization, and problem-solving. Comments were also coded as positive, negative, or neutral as interpreted by the coder.ResultsAll assessor groups mentioned communication skills most frequently. After communication, the RN and TTC groups commented on situational awareness most frequently, comprising 15 and 29% of their total responses, respectively, whereas 31% of the TTL comments focused on leadership skills. The RN and TTL groups provided positive assessments, with 51 and 42% of their respective comments coded as positive. Forty-five percent of self-assessment comments in the TTC group were negative. All (100%) of the TTC and TTL respondents felt that incorporating MSF would add to the quality of feedback, only 66% of the RN group felt that way.ConclusionsWe found that each assessor group brings a unique focus and perspective to the assessment of resident TTC performance. The future inclusion of MSF in the trauma team context has the potential to enhance the learning environment in a clinical arena that is difficult to directly observe and assess.
| S-EPMC8166304 | biostudies-literature
Project description:Background: Event related potential (ERP) components, such as P3, N2, and FRN, are potential metrics for assessing feedback response as a form of performance monitoring. Most research studies investigate these ERP components using clinical or research-grade electroencephalography (EEG) systems. Wearable EEGs, which are an affordable alternative, have the potential to assess feedback response using ERPs but have not been sufficiently evaluated. Feedback-related ERPs also have not been scientifically evaluated in interactive settings that are similar to daily computer use. In this study, a consumer-grade wearable EEG system was assessed for its feasibility to collect feedback-related ERPs through an interactive software module that provided an environment in which users were permitted to navigate freely within the program to make decisions. Methods: The recording hardware, which costs < $1,500 in total, incorporated the OpenBCI Cyton Board with Daisy chain, a consumer-grade EEG system that costs $949 USD. Seventeen participants interacted with an oddball paradigm and an interactive module designed to elicit feedback-related ERPs. The features of interests for the oddball paradigm were the P3 and N2 components. The features of interests for the interactive module were the P3, N2, and FRN components elicited in response to positive, neutral, and two types of negative feedback. The FRN was calculated by subtracting the positive feedback response from the negative feedback responses. Results: The P3 and N2 components of the oddball paradigm indicated statistically significant differences between infrequent targets and frequent targets which is in line with current literature. The P3 and N2 components elicited in the interactive module indicated statistically significant differences between positive, neutral, and negative feedback responses. There were no significant differences between the FRN types and significant interactions with channel group and FRN type. Conclusion: The OpenBCI Cyton, after some modifications, shows potential for eliciting and assessing P3, N2, and FRN components, which are important indicators for performance monitoring, in an interactive setting.
| S-EPMC6669939 | biostudies-literature
Project description:Background:Ethics education is a required component of pediatric residency training. Limited instructional time requires educators to identify and prioritize learning needs. This is the first study to identify pediatric residents' ethics learning needs using a multisource (360 degree) assessment. We hypothesized that pediatricians or allied health care professionals would identify unperceived ethics learning needs. Methods:Pediatric residents, pediatricians, respiratory therapists (RTs), and registered nurses (RNs) working at a university children's hospital rated the importance of twelve ethics themes as learning needs for trainees using a Likert-type scale. One-way ANOVA was used to determine differences between the groups, followed by post-hoc testing. Results:Response rates were 65%, 70%, 57%, and 47% for residents, pediatricians, RTs, and RNs, respectively. Themes were categorized into three priority groupings based on mean importance ratings. Where significant differences existed between residents and other respondent groups, pediatric residents rated the theme as being more important. Conclusion:This study provides an interprofessional assessment of pediatric residents' perceived ethics learning needs. High priority ethics topics were identified, allowing for targeted teaching. Pediatricians and allied HCPs did not rate any ethics themes higher than residents. Medical educators may consider using methods inspired by multisource feedback for program evaluation.
| S-EPMC5766223 | biostudies-literature
Project description:BackgroundIn medical students' workplace learning, feedback is important for effective learning regarding communication and clinical skills. The provision of multisource feedback (MSF) in clinical practice with focus on the patient's perspective is rarely addressed in the literature. The overall objective was to explore the experience of MSF in medical students' clinical learning in primary healthcare (PHC).MethodsIn the study, patients provided feedback by use of the Patient Feedback in Clinical Practice (PFCP) questionnaire. By use of adapted PFCP questionnaire versions peers and clinical supervisors provided feedback and students performed a self-evaluation. The MSF learning activity was evaluated using surveys (4-point Likert scale/open-ended questions), (students (n = 26), peers (n = 9) and clinical supervisors (n = 7)). Data were analysed using descriptive and qualitative content analysis.ResultsResults (mean 4-point Likert scale) from participants evaluation of the MSF learning activity visualises the value of feedback in terms of patient-centred communication (students 3.50, peers 2.44 and clinical supervisors 3.57), guidance for further training (students 3.14, peers 2.89 and clinical supervisors 3.00) and clarification of pedagogical assignment (students 3.14, peers 2.89 and clinical supervisors 3.00). Thematic analysis of participants' free-text answers in the evaluation surveys resulted in three themes: (1) applicability of the MSF, (2) MSF - collaborative learning process and (3) MSF as a facilitator in students' clinical skills development. The participants experienced that the written MSF provided multi-facetted perspectives, which contributed to students' and peers' clinical and communication learning. MSF experience also enhanced clinical supervisors' feedback regarding communication skills, targeting the supervisors' pedagogical assignment.ConclusionOur findings indicate that MSF provided directly after a patient encounter, using the PFCP questionnaire as feedback provider, could be an adequate learning activity for medical students' workplace learning. The MSF, provided through the PFCP questionnaire, was experienced to neutralise and operationalise the provision of concrete feedback, facilitating peers' learning and clinical supervisors' tuition. The results visualise the importance of patients in MSF, as a valuable resource in students' workplace learning. Our study implies that this learning activity could be an applicable tool to facilitate learning and pedagogic development in clinical education in PHC.
| S-EPMC9134659 | biostudies-literature
Project description:IntroductionMultisource feedback (MSF), also called 360-degree assessment, is one form of assessment used in postgraduate training. However, there is an ongoing discussion on its value, because the factors that influence the impact of MSF and the main impact of MSF are not fully understood. In this study, we investigated both the influencing factors and the impact of MSF on residency training.MethodsWe conducted a qualitative case study within the boundaries of the residency training for paediatricians and paediatric surgeons at a University Hospital. We collected data from seven focus group interviews with stakeholders of MSF (residents, raters and supervisors). By performing a reflexive thematic analysis, we extracted the influencing factors and the impact of MSF.ResultsWe found seven influencing factors: MSF is facilitated by the announcement of a clear goal of MSF, the training of raters on the MSF instrument, a longitudinal approach of observation, timing not too early and not too late during the rotation, narrative comments as part of the ratings, the residents' self-assessment and a supervisor from the same department. We found three themes on the impact of MSF: MSF supports the professional development of residents, enhances interprofessional teamwork and increases the raters' commitment to the training of residents.ConclusionThis study illuminates the influencing factors and impact of MSF on residency training. We offer novel recommendations on the continuity of observation, the timing during rotations and the role of the supervisor. Moreover, by discussing our results through the lens of identity formation theory, this work advances our conceptual understanding of MSF. We propose identity formation theory as a framework for future research on MSF to leverage the potential of MSF in residency training.
| S-EPMC9314722 | biostudies-literature
Project description:The stability of language across childhood is traditionally assessed by exploring longitudinal relations between individual language measures. However, language encompasses many domains and varies with different sources (child speech, parental report, experimenter assessment). This study evaluated individual variation in multiple age-appropriate measures of child language derived from multiple sources and stability between their latent variables in 192 young children across more than 2 years. Structural equation modeling demonstrated the loading of multiple measures of child language from different sources on single latent variables of language at ages 20 months and 48 months. A large stability coefficient (r = .84) obtained between the 2 language latent variables. This stability obtained even when accounting for family socioeconomic status, maternal verbal intelligence, education, speech, tendency to respond in a socially desirable fashion, and child social competence. Stability was also equivalent for children in diverse childcare situations and for girls and boys. Across age, from the beginning of language acquisition to just before school entry, aggregating multiple age-appropriate methods and measures at each age and multiple reporters, children show a strong stability of individual differences in general language development.
| S-EPMC3412562 | biostudies-literature
Project description:IntroductionThe Biosimilars Forum conducted a survey through an independent organization from November 20, 2015 to January 4, 2016 in order to assess current levels of awareness, knowledge, and perceptions of biosimilars among US specialty physicians who already prescribe biologics. The survey was intended to provide a baseline level of knowledge about biosimilars and will be repeated in 2-3 years in order to monitor trends over time.MethodsA 19-question survey was created by the Biosimilars Forum and was administered by an independent third party.ResultsResponses were obtained from 1201 US physicians across specialties that are high prescribers of biologics, including dermatologists, gastroenterologists, hematologist-oncologists, medical oncologists, nephrologists, and rheumatologists.ConclusionsThe results of this survey highlight a significant need for evidence-based education about biosimilars for physicians across specialties. Five major knowledge gaps were identified: defining biologics, biosimilars, and biosimilarity; understanding the approval process and the use of "totality of evidence" to evaluate biosimilars; understanding that the safety and immunogenicity of a biosimilar are comparable to the originator biologic; understanding the rationale for extrapolation of indications; and defining interchangeability and the related rules regarding pharmacy-level substitution.FundingBiosimilars Forum.
| S-EPMC5126187 | biostudies-literature
Project description:BACKGROUND:Multisource feedback (MSF) is increasingly being used to assess trainee performance, with different assessor groups fulfilling a crucial role in utility of assessment data. However, in health professions education, research on assessor behaviors in MSF is limited. When assessing trainee performance in work settings, assessors use multidimensional conceptualizations of what constitutes effective performance, also called personal performance theories, to distinguish between various behaviors and sub competencies., This may not only explain assessor variability in Multi Source Feedback, but also result in differing acceptance (and use) of assessment data for developmental purposes. The purpose of this study was to explore performance theories of various assessor groups (residents and nurses) when assessing performance of residents. METHODS:A constructivist, inductive qualitative research approach and semi-structured interviews following MSF were used to explore performance theories of 14 nurses and 15 residents in the department of internal medicine at Aga Khan University (AKU). Inductive thematic content analysis of interview transcripts was used to identify and compare key dimensions in residents' and nurses' performance theories used in evaluation of resident performance. RESULTS:Seven major themes, reflecting key dimensions of assessors' performance theories, emerged from the qualitative data, namely; communication skills, patient care, accessibility, teamwork skills, responsibility, medical knowledge and professional attitude. There were considerable overlaps, but also meaningful differences in the performance theories of residents and the nurses, especially with respect to accessibility, teamwork and medical knowledge. CONCLUSION:Residents' and nurses' performance theories for assessing resident performance overlap to some extent, yet also show meaningful differences with respect to the performance dimensions they pay attention to or consider most important. In MSF, different assessor groups may therefore hold different performance theories, depending on their role. Our results further our understanding of assessor source effects in MSF. Implications of our findings are related to implementation of MSF, design of rating scales as well as interpretation and use of MSF data for selection and performance improvement.
| S-EPMC7549199 | biostudies-literature