Development and validation of a health profession education-focused scholarly mentorship assessment tool.
Ontology highlight
ABSTRACT:
SUBMITTER: St-Onge C
PROVIDER: S-EPMC6382618 | biostudies-literature | 2019 Feb
REPOSITORIES: biostudies-literature
Publications
Development and validation of a health profession education-focused scholarly mentorship assessment tool.
St-Onge Christina C Young Meredith M Varpio Lara L
Perspectives on medical education 20190201 1
<h4>Problem</h4>PhD-trained researchers working in health professions education (HPE) regularly engage in one-on-one, or one-on-few, scholarly mentorship activities. While this work is often a formal expectation of these scientists' roles, rarely is there formal institutional acknowledgement of this mentorship. In fact, there are few official means through which a research scientist can document the frequency or quality of the scholarly mentorship they provide.<h4>Approach</h4>OUTCOMES: The STHP ...[more]
Similar Datasets
Project description:Background: Focused cardiac ultrasound (FCU) is widely used by healthcare providers to answer specific questions about cardiac structure and function at the bedside. Currently, no widely accepted FCU image acquisition checklist exists to assess learners with varying skill levels from different specialties. Objective: The primary objective of this project was to develop a consensus-based FCU image acquisition checklist using a multispecialty group of point-of-care ultrasound (POCUS) experts. Methods: The essential components of an FCU examination were identified on the basis of published recommendations from echocardiography and international ultrasound societies. A checklist of the essential components of an FCU examination was drafted. A panel of POCUS experts from different medical specialties in the United States and Canada was convened to vote on each checklist item by answering two questions: 1) Is this item important to include in a checklist of essential FCU skills applicable to any medical specialty? and 2) Should the learner be required to successfully complete this item to be considered competent? A modified Delphi approach was used to assess the level of agreement for each checklist item during four rounds of voting. Checklist items that achieved an agreement of 80% or greater were included in the final checklist. Results: Thirty-one POCUS experts from seven different medical specialties voted on sixty-five items to be included in the FCU image acquisition assessment tool. The majority of POCUS experts (61%) completed all four rounds of voting. During the first round of voting, 59 items reached consensus, and after revision and revoting, an additional 3 items achieved 80% or greater consensus. A total of 62 items were included in the final checklist, and 57 items reached consensus as a requirement for demonstration of competency. Conclusion: We have developed a multispecialty, consensus-based FCU image acquisition checklist that may be used to assess the skills of learners from different specialties. Future steps include studies to develop additional validity evidence for the use of the FCU assessment tool and to evaluate its utility for the translation of skills into clinical practice.
| S-EPMC8043312 | biostudies-literature
Project description:INTRODUCTION:Interprofessional learning (IPL) is increasingly recognized as a promising strategy in addressing the burgeoning challenges in healthcare. Its assessment remains to be perplexing and requires accurate measurements. Thus, this study intended to develop a valid and reliable reflective tool in assessing IPL as a Continuing Professional Development (CPD) outcome. METHODS:A one-group post-posttest pre-experimental design with tool development was employed to establish the validity and reliability of the "Inventory of Reflective Vignette-Interprofessional Learning" (IRV-IPL). This tool was developed from an extensive literature review and designed with three segments to assess interprofessional competencies before, after, and what if scenarios using vignettes. After it was validated by education experts (n = 5) and written consent forms were signed by the participants, the IRV-IPL was pilot tested among healthcare professionals (n = 10) for analysis and improvement. During the actual implementation, it was administered to healthcare professionals (n = 45) who participated in a university-provided CPD event. Collected data underwent validity and reliability testing. RESULTS:IRV-IPL generated excellent internal consistency (α = 0.98), and across all segments of collaboration (α = 0.96), coordination (α = 0.96), cooperation (α = 0.96), communication (α = 0.97), and commendation (α = 0.98). Items exhibited significantly positive large correlations (r > 0.35, p < 0.05) in all segments showing beneficial measures for postdictive validity in recalling prior interprofessional competencies, and predictive validity in estimating interprofessional learning as an outcome of CPD and alternative interventions. CONCLUSION:This study provided a piece of groundwork evidence on the use of IRV-IPL as a reflective assessment tool for interprofessional learning in CPD contexts. Further studies are essential to explore the educational utility of IRV framework in crafting relevant assessments and to establish construct validity of IRV-IPL using exploratory and confirmatory factor analyses.
| S-EPMC6347297 | biostudies-literature
Project description:To adapt the consumer version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity.A quantitative cross sectional study.56 communes in 3 representative provinces of central Vietnam.Total of 3289 people who used health care services at health facility at least once over the past two years.The Vietnamese adult expanded consumer version of the PCAT (VN PCAT-AE) is an instrument for evaluation of primary care in Vietnam with 70 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. Sixteen other items from the original tool were not included in the final instrument, due to problems with missing values, floor or ceiling effects, and item-total correlations. All the retained scales have a Cronbach's alpha above 0.70 except for the subscale of Family Centeredness.The VN PCAT-AE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the consumer perspective. Additional work in the future to optimize valid measurement in all domains consistent with the original version of the tool may be helpful as the primary care system in Vietnam further develops.
| S-EPMC5764365 | biostudies-other
Project description:BackgroundSchool health programs need to target all aspects of physical, psychological, and social well-being. Using a slightly modified version of the COSMIN Risk of Bias checklist, we developed and conducted the first validation of the School Health Assessment Tool for Primary Schools (SHAT-PS).MethodThe exploratory sequential mixed method was used in this study. In the first phase, scientific databases were systematically searched to find school health models and instruments and 65 interviews were conducted with school stakeholders. The Colaizzi's method was used to code the qualitative data into themes. Then, a pool of items was created for each theme, rechecked by psychometric experts and then validated for content (i.e., relevance, clarity, and comprehensiveness) by psychometric experts and individuals of the target population (i.e., school personnel). In the second phase, classical test theory was utilized to analyze the validity and reliability of the resulting items from phase 1 among 400 individuals working at primary schools.ResultsThe coding of the interviews resulted in ten themes that we labeled based on the theoretical literature: school health policies, community connections, health education, physical activity, health services, nutrition, psychological services, physical environment, equipment and facilities, and school staff's health. The items created for each theme ended up in an initial pool of 76 items. In the final stage of phase 1, 69 items remained after the content validity assessment by experts and school personnel. In phase 2, the SHAT-PS items were tested using maximum likelihood exploratory factor analysis and confirmatory factor analysis. Of the 69 items from phase 1, 22 items were removed due to low factor loadings. The results showed that the 8-factor model was the best solution (chi-square/df = 2.41, CFI = .98, TLI = .97, RMSEA = .06). The discriminant and convergent validity of the SHAT-PS were evaluated as satisfactory and the scale had high internal consistency (Cronbach's alpha for all subscales > .93). The test-retest reliability was satisfactory-the intraclass correlation coefficient pooled was .95 (99% CI [.91-.98]). Moreover, the standard error of measurement resulted in an SEM pooled equal to 4.4. No discrepancy was found between subgroups of gender and subgroups of staffs' positions at schools.ConclusionThe SHAT-PS is a valid and reliable tool that may facilitate school staff, stakeholders and researchers to evaluate the presence of the factors that promote health at primary schools. Nevertheless, in the process of validation, many of the items related to staff's health were eliminated due to poor factor loadings. Obviously, staff health is an important factor in the measurement of school health. Hence, we recommend that the validity and reliability of the SHAT-PS in other cultures should be done using the original 76-item version.
| S-EPMC8675247 | biostudies-literature
Project description:BACKGROUND:People living with chronic illnesses are an increasingly large group. Research indicates that care and self-management should not only focus on the illness and problem-oriented aspects of these individuals' lives but also support them in recognizing and leveraging their personal strengths in daily life. OBJECTIVE:This paper presents the design and developmental process of MyStrengths, a mobile health (mHealth) app designed to help its users (people with chronic conditions) both find and make use of their personal strengths in their daily lives. Through 4 consecutive phases, this paper presents participant- and researcher-driven activities, discussions regarding design, and development of both the MyStrengths app and its content. METHODS:During the 4 phases, we used a range of methods and activities, including (1) an idea-generating workshop aimed at creating ideas for strengths-supporting features with different stakeholders, including patients, caregivers, relatives, and designers (N=35); (2) research seminars with an international group of experts (N=6), in which the concept, theoretical background, and design ideas for the app were discussed; (3) a series of co-design workshops with people in the user group (N=22) aiming to create ideas for how to, in an engaging manner, design the app; and (4) in 4 developmental iterations, the app was evaluated by people in the user group (N=13). Content and strengths exercises were worked on and honed by the research team, the expert groups, and our internal editorial team during the entire developmental process. RESULTS:The first phase found a wide range of stakeholder requirements to, and ideas for, strengths-focused mHealth apps. From reviewing literature during the second phase, we found a dearth of research on personal strengths with respect to people living with chronic illnesses. Activities during the third phase creatively provided numerous ideas and suggestions for engaging and gameful ways to develop and design the MyStrengths app. The final phase saw the output from all the earlier phases come together. Through multiple increasingly complete iterations of user evaluations testing and developing, the final prototype of the MyStrengths app was created. CONCLUSIONS:Although research supports the use of strengths-focused mHealth tools to support people living with chronic illnesses, there is little guidance as to how these tools and their content should be designed. Through all activities, we found great support among participating users for strengths-focused apps, and we can consider such apps to be both appropriate and valuable. This paper illustrates how combining a range of user-, researcher-, literature-, and designer-based methods can contribute to creating mHealth tools to support people with chronic illnesses to find and use more of their own personal strengths.
| S-EPMC7414410 | biostudies-literature
Project description: Not available
| S-EPMC6919218 | biostudies-literature
Project description:Remote health has been differentiated from rural health in Australia and defined as isolated, with poor service access and a relatively high proportion of Indigenous residents, necessitating different models of care. Educational strategies for remote health practice are often needs driven and the characteristics of remote health may be used to categorise remote health professional education. This scoping review aims to identify the purpose of health professional education for remote settings, the type of educational strategies implemented and the reported outcomes. A broad search of published literature available in online bibliographic databases was conducted. A total of 33 articles met the review inclusion criteria. A further 7 articles were identified for inclusion in the review through citation searches and the authors' networks giving a total of 40 articles. Six primary themes were established based on the educational purpose: (1) cultural competency; (2) social accountability; (3) rural and remote skill development for the general workforce; (4) remote specialisation; (5) specialist skills required for a remote workforce; and (6) remote teaching. These themes also reflect the philosophical change over time recognising remote health as a separate discipline and its value as a distinctive and efficacious learning environment. The concept of education for remote practice is proposed to describe this unique leaning environment which encompasses critical pedagogy to develop a sense of agency and social accountability, embedding the delivery of primary health care through service learning and developing relationships in a context which is transformative.
| S-EPMC7378721 | biostudies-literature
Project description:PurposeSocial determinants of health (SDoH) have been linked to a variety of health conditions, but there are no multivariate measures of these determinants to estimate the risk of morbidity or mortality in a community. We developed a score derived from multivariate measures of SDoH that predicts county-level cardiovascular disease (CVD) mortality.MethodsUsing county-level data from 3,026 US counties, we developed a score considering variables of neighborhood socioeconomic status, food/lifestyle environment, and health care resource availability and accessibility to predict the 3-year average (2015-2017) age-adjusted county-level mortality rate for all CVD. We used one 50% random sample to develop the score and the other to validate the score. A Poisson regression model was developed to estimate parameters of variables while accounting for intrastate correlation.ResultsThe index score was based on 7 SDoH factors: percentage of the population of minority (nonwhite) race, poverty rate, percentage of the population without a high school diploma, grocery store ratio, fast-food restaurant ratio, after-tax soda price, and primary care physician supply. The area under the curve for the development and validation groups was similar, 0.851 (95% CI, 0.829-0.872) and 0.840 (95% CI, 0.817-0.863), respectively, indicating excellent discriminative ability. The index had better predictive performance for CVD burden than other area-level indexes: poverty only (area under the curve= 0.808, P <.001); the Centers for Disease Control and Prevention's Social Vulnerability Index (CDC-SVI) (area under the curve =0.786, P <.001); and the Agency for Healthcare Research and Quality's Socioeconomic Status (AHRQ-SES) index (area under the curve =0.835, P = .03).ConclusionsOur validated multivariate SDoH index score accurately classifies counties with high CVD burden and therefore has the potential to improve CVD risk prediction for vulnerable populations and interventions for CVD at the county level.
| S-EPMC7358032 | biostudies-literature
Project description:ObjectiveWhile the role of health literacy in chronic disease management is well documented, few intervention studies have been reported. A major barrier to designing and implementing such interventions is the lack of valid health literacy tools. This study developed and tested a novel health literacy scale for individuals with high blood pressure (HBP).MethodsA two-step design process was used: In the construction phase, focus group studies and a literature review were conducted to generate a pool of items. The testing phase involved a psychometric evaluation and pilot-testing of the scale on hypertensive Korean Americans (n=386). The end product was a HBP-health literacy scale (HBP-HLS) with two essential domains, print literacy and functional health literacy.ResultsPsychometric testing indicated that the scale was reliable (Kuder-Richardson-20 coefficient=0.98), valid (content validity index ?0.8), and significantly correlated with theoretically selected variables (education, r=0.67, p<0.01; HBP knowledge, r=0.33, p<0.01).ConclusionThe HBP-HLS demonstrated its utility for evaluating HBP management interventions in the community setting.Practice implicationsUtilizing the HBP-HLS should be considered as a potential tool for improving health literacy and evaluating intervention studies in the context of HBP management.
| S-EPMC3288330 | biostudies-literature
Project description:BACKGROUND: The Accreditation Council for Graduate Medical Education requires programs to educate and evaluate residents in 6 competencies, including systems-based practice. We designed a survey and assessment tool to address the competency as it pertains to anesthetic drug costs in an academic center. METHODS: Residents, certified registered nurse anesthetists, and faculty were asked to complete an anesthetic drug-cost survey without relying on reference materials. After a combination of compulsory in-class didactic sessions and web-based education, the participants were asked to design an anesthetic, give example cases, and determine costs. The initial task was repeated 1 year later. RESULTS: Our preintervention survey revealed that most practitioners knew very little about anesthetic drug costs, regardless of level of training or degree. All residents completed the mandatory online education tool, more than 80% attended the departmental grand rounds program, and 100% met the goal of designing an anesthetic for all cases within the preset price limit. A repeat of the cost estimate produced an improvement in cost estimates with reduction in variability (P < .05, Student unpaired t test), although estimates of volatile anesthetic and reversal agent costs did not achieve significance at the .05 level for any of the 3 cases. CONCLUSION: Introducing a formalized teaching and assessment tool has improved our residents' understanding of anesthetic drug costs, and improved our ability to teach and assess the systems-based practice competency.
| S-EPMC2930315 | biostudies-other