Development and validation of a health profession education-focused scholarly mentorship assessment tool.
Ontology highlight
ABSTRACT:
SUBMITTER: St-Onge C
PROVIDER: S-EPMC6382618 | biostudies-literature | 2019 Feb
REPOSITORIES: biostudies-literature
Publications
Development and validation of a health profession education-focused scholarly mentorship assessment tool.
St-Onge Christina C Young Meredith M Varpio Lara L
Perspectives on medical education 20190201 1
<h4>Problem</h4>PhD-trained researchers working in health professions education (HPE) regularly engage in one-on-one, or one-on-few, scholarly mentorship activities. While this work is often a formal expectation of these scientists' roles, rarely is there formal institutional acknowledgement of this mentorship. In fact, there are few official means through which a research scientist can document the frequency or quality of the scholarly mentorship they provide.<h4>Approach</h4>OUTCOMES: The STHP ...[more]
Similar Datasets
Project description:Background: Focused cardiac ultrasound (FCU) is widely used by healthcare providers to answer specific questions about cardiac structure and function at the bedside. Currently, no widely accepted FCU image acquisition checklist exists to assess learners with varying skill levels from different specialties. Objective: The primary objective of this project was to develop a consensus-based FCU image acquisition checklist using a multispecialty group of point-of-care ultrasound (POCUS) experts. Methods: The essential components of an FCU examination were identified on the basis of published recommendations from echocardiography and international ultrasound societies. A checklist of the essential components of an FCU examination was drafted. A panel of POCUS experts from different medical specialties in the United States and Canada was convened to vote on each checklist item by answering two questions: 1) Is this item important to include in a checklist of essential FCU skills applicable to any medical specialty? and 2) Should the learner be required to successfully complete this item to be considered competent? A modified Delphi approach was used to assess the level of agreement for each checklist item during four rounds of voting. Checklist items that achieved an agreement of 80% or greater were included in the final checklist. Results: Thirty-one POCUS experts from seven different medical specialties voted on sixty-five items to be included in the FCU image acquisition assessment tool. The majority of POCUS experts (61%) completed all four rounds of voting. During the first round of voting, 59 items reached consensus, and after revision and revoting, an additional 3 items achieved 80% or greater consensus. A total of 62 items were included in the final checklist, and 57 items reached consensus as a requirement for demonstration of competency. Conclusion: We have developed a multispecialty, consensus-based FCU image acquisition checklist that may be used to assess the skills of learners from different specialties. Future steps include studies to develop additional validity evidence for the use of the FCU assessment tool and to evaluate its utility for the translation of skills into clinical practice.
| S-EPMC8043312 | biostudies-literature
Project description:INTRODUCTION:Interprofessional learning (IPL) is increasingly recognized as a promising strategy in addressing the burgeoning challenges in healthcare. Its assessment remains to be perplexing and requires accurate measurements. Thus, this study intended to develop a valid and reliable reflective tool in assessing IPL as a Continuing Professional Development (CPD) outcome. METHODS:A one-group post-posttest pre-experimental design with tool development was employed to establish the validity and reliability of the "Inventory of Reflective Vignette-Interprofessional Learning" (IRV-IPL). This tool was developed from an extensive literature review and designed with three segments to assess interprofessional competencies before, after, and what if scenarios using vignettes. After it was validated by education experts (n = 5) and written consent forms were signed by the participants, the IRV-IPL was pilot tested among healthcare professionals (n = 10) for analysis and improvement. During the actual implementation, it was administered to healthcare professionals (n = 45) who participated in a university-provided CPD event. Collected data underwent validity and reliability testing. RESULTS:IRV-IPL generated excellent internal consistency (? = 0.98), and across all segments of collaboration (? = 0.96), coordination (? = 0.96), cooperation (? = 0.96), communication (? = 0.97), and commendation (? = 0.98). Items exhibited significantly positive large correlations (r > 0.35, p < 0.05) in all segments showing beneficial measures for postdictive validity in recalling prior interprofessional competencies, and predictive validity in estimating interprofessional learning as an outcome of CPD and alternative interventions. CONCLUSION:This study provided a piece of groundwork evidence on the use of IRV-IPL as a reflective assessment tool for interprofessional learning in CPD contexts. Further studies are essential to explore the educational utility of IRV framework in crafting relevant assessments and to establish construct validity of IRV-IPL using exploratory and confirmatory factor analyses.
| S-EPMC6347297 | biostudies-literature
Project description:To adapt the consumer version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity.A quantitative cross sectional study.56 communes in 3 representative provinces of central Vietnam.Total of 3289 people who used health care services at health facility at least once over the past two years.The Vietnamese adult expanded consumer version of the PCAT (VN PCAT-AE) is an instrument for evaluation of primary care in Vietnam with 70 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. Sixteen other items from the original tool were not included in the final instrument, due to problems with missing values, floor or ceiling effects, and item-total correlations. All the retained scales have a Cronbach's alpha above 0.70 except for the subscale of Family Centeredness.The VN PCAT-AE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the consumer perspective. Additional work in the future to optimize valid measurement in all domains consistent with the original version of the tool may be helpful as the primary care system in Vietnam further develops.
| S-EPMC5764365 | biostudies-other
Project description:BackgroundSchool health programs need to target all aspects of physical, psychological, and social well-being. Using a slightly modified version of the COSMIN Risk of Bias checklist, we developed and conducted the first validation of the School Health Assessment Tool for Primary Schools (SHAT-PS).MethodThe exploratory sequential mixed method was used in this study. In the first phase, scientific databases were systematically searched to find school health models and instruments and 65 interviews were conducted with school stakeholders. The Colaizzi's method was used to code the qualitative data into themes. Then, a pool of items was created for each theme, rechecked by psychometric experts and then validated for content (i.e., relevance, clarity, and comprehensiveness) by psychometric experts and individuals of the target population (i.e., school personnel). In the second phase, classical test theory was utilized to analyze the validity and reliability of the resulting items from phase 1 among 400 individuals working at primary schools.ResultsThe coding of the interviews resulted in ten themes that we labeled based on the theoretical literature: school health policies, community connections, health education, physical activity, health services, nutrition, psychological services, physical environment, equipment and facilities, and school staff's health. The items created for each theme ended up in an initial pool of 76 items. In the final stage of phase 1, 69 items remained after the content validity assessment by experts and school personnel. In phase 2, the SHAT-PS items were tested using maximum likelihood exploratory factor analysis and confirmatory factor analysis. Of the 69 items from phase 1, 22 items were removed due to low factor loadings. The results showed that the 8-factor model was the best solution (chi-square/df = 2.41, CFI = .98, TLI = .97, RMSEA = .06). The discriminant and convergent validity of the SHAT-PS were evaluated as satisfactory and the scale had high internal consistency (Cronbach's alpha for all subscales > .93). The test-retest reliability was satisfactory-the intraclass correlation coefficient pooled was .95 (99% CI [.91-.98]). Moreover, the standard error of measurement resulted in an SEM pooled equal to 4.4. No discrepancy was found between subgroups of gender and subgroups of staffs' positions at schools.ConclusionThe SHAT-PS is a valid and reliable tool that may facilitate school staff, stakeholders and researchers to evaluate the presence of the factors that promote health at primary schools. Nevertheless, in the process of validation, many of the items related to staff's health were eliminated due to poor factor loadings. Obviously, staff health is an important factor in the measurement of school health. Hence, we recommend that the validity and reliability of the SHAT-PS in other cultures should be done using the original 76-item version.
| S-EPMC8675247 | biostudies-literature
Project description:BACKGROUND:People living with chronic illnesses are an increasingly large group. Research indicates that care and self-management should not only focus on the illness and problem-oriented aspects of these individuals' lives but also support them in recognizing and leveraging their personal strengths in daily life. OBJECTIVE:This paper presents the design and developmental process of MyStrengths, a mobile health (mHealth) app designed to help its users (people with chronic conditions) both find and make use of their personal strengths in their daily lives. Through 4 consecutive phases, this paper presents participant- and researcher-driven activities, discussions regarding design, and development of both the MyStrengths app and its content. METHODS:During the 4 phases, we used a range of methods and activities, including (1) an idea-generating workshop aimed at creating ideas for strengths-supporting features with different stakeholders, including patients, caregivers, relatives, and designers (N=35); (2) research seminars with an international group of experts (N=6), in which the concept, theoretical background, and design ideas for the app were discussed; (3) a series of co-design workshops with people in the user group (N=22) aiming to create ideas for how to, in an engaging manner, design the app; and (4) in 4 developmental iterations, the app was evaluated by people in the user group (N=13). Content and strengths exercises were worked on and honed by the research team, the expert groups, and our internal editorial team during the entire developmental process. RESULTS:The first phase found a wide range of stakeholder requirements to, and ideas for, strengths-focused mHealth apps. From reviewing literature during the second phase, we found a dearth of research on personal strengths with respect to people living with chronic illnesses. Activities during the third phase creatively provided numerous ideas and suggestions for engaging and gameful ways to develop and design the MyStrengths app. The final phase saw the output from all the earlier phases come together. Through multiple increasingly complete iterations of user evaluations testing and developing, the final prototype of the MyStrengths app was created. CONCLUSIONS:Although research supports the use of strengths-focused mHealth tools to support people living with chronic illnesses, there is little guidance as to how these tools and their content should be designed. Through all activities, we found great support among participating users for strengths-focused apps, and we can consider such apps to be both appropriate and valuable. This paper illustrates how combining a range of user-, researcher-, literature-, and designer-based methods can contribute to creating mHealth tools to support people with chronic illnesses to find and use more of their own personal strengths.
| S-EPMC7414410 | biostudies-literature
Project description:Remote health has been differentiated from rural health in Australia and defined as isolated, with poor service access and a relatively high proportion of Indigenous residents, necessitating different models of care. Educational strategies for remote health practice are often needs driven and the characteristics of remote health may be used to categorise remote health professional education. This scoping review aims to identify the purpose of health professional education for remote settings, the type of educational strategies implemented and the reported outcomes. A broad search of published literature available in online bibliographic databases was conducted. A total of 33 articles met the review inclusion criteria. A further 7 articles were identified for inclusion in the review through citation searches and the authors' networks giving a total of 40 articles. Six primary themes were established based on the educational purpose: (1) cultural competency; (2) social accountability; (3) rural and remote skill development for the general workforce; (4) remote specialisation; (5) specialist skills required for a remote workforce; and (6) remote teaching. These themes also reflect the philosophical change over time recognising remote health as a separate discipline and its value as a distinctive and efficacious learning environment. The concept of education for remote practice is proposed to describe this unique leaning environment which encompasses critical pedagogy to develop a sense of agency and social accountability, embedding the delivery of primary health care through service learning and developing relationships in a context which is transformative.
| S-EPMC7378721 | biostudies-literature
Project description:ObjectiveWhile the role of health literacy in chronic disease management is well documented, few intervention studies have been reported. A major barrier to designing and implementing such interventions is the lack of valid health literacy tools. This study developed and tested a novel health literacy scale for individuals with high blood pressure (HBP).MethodsA two-step design process was used: In the construction phase, focus group studies and a literature review were conducted to generate a pool of items. The testing phase involved a psychometric evaluation and pilot-testing of the scale on hypertensive Korean Americans (n=386). The end product was a HBP-health literacy scale (HBP-HLS) with two essential domains, print literacy and functional health literacy.ResultsPsychometric testing indicated that the scale was reliable (Kuder-Richardson-20 coefficient=0.98), valid (content validity index ?0.8), and significantly correlated with theoretically selected variables (education, r=0.67, p<0.01; HBP knowledge, r=0.33, p<0.01).ConclusionThe HBP-HLS demonstrated its utility for evaluating HBP management interventions in the community setting.Practice implicationsUtilizing the HBP-HLS should be considered as a potential tool for improving health literacy and evaluating intervention studies in the context of HBP management.
| S-EPMC3288330 | biostudies-literature
Project description:BACKGROUND:Technological advances in healthcare have enabled patients to participate in digital self-assessment, with reported benefits of enhanced healthcare efficiency and self-efficacy. This report describes the design and validation of a patient-administered preanaesthesia health assessment digital application for gathering medical history relevant to preanaesthesia assessment. Effective preoperative evaluation allows for timely optimization of medical conditions and reduces case cancellations on day of surgery. METHODS:Using an iterative mixed-methods approach of literature review, surveys and panel consensus, the study sought to develop and validate a digitized preanaesthesia health assessment questionnaire in terms of face and criterion validity. A total of 228 patients were enrolled at the preoperative evaluation clinic of a tertiary women's hospital. Inclusion criteria include: age ?? 21?years, scheduled for same-day-admission surgery, literacy in English and willingness to use a digital device. Patient perception of the digitized application was also evaluated using the QQ10 questionnaire. Reliability of health assessment questionnaire was evaluated by comparing the percentage agreement of patient responses with nurse assessment. RESULTS:Moderate to good criterion validity was obtained in 81.1 and 83.8% of questions for the paper and digital questionnaires respectively. Of total 3626 response-pairs obtained, there were 3405 (93.4%) concordant and 221 (6.1%) discrepant response-pairs for the digital questionnaire. Discrepant response-pairs, such as ""no/yes" and "unsure/yes", constitute only 3.7% of total response-pairs. Patient acceptability of the digitized assessment was high, with QQ10 value and burden scores of 76 and 30%, respectively. CONCLUSIONS:Self-administration of digitized preanaesthesia health assessment is acceptable to patients and reliable in eliciting medical history. Further iteration should focus on improving reliability of the digital tool, adapting it for use in other languages and incorporating clinical decision tools.
| S-EPMC7666442 | biostudies-literature
Project description:Assessing and improving public knowledge of atrial fibrillation (AF) could increase its detection rate and the subsequent use of stroke prevention therapies. However, there is no validated AF knowledge assessment tool applicable to the general population, including those at risk of AF. Therefore, we aimed to develop and validate such a tool. The tool was developed from a literature review and discussion with subject matter experts. Content validity was ensured by a ten-member panel of experts comprising cardiologists and pharmacists. An online validation survey was conducted and reported based on the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). The survey evaluated the tool performance by construct validity, internal consistency reliability, item discrimination, difficulty index and ease of readability. The survey participants included 14 general medical specialists, 20 fourth-year and 33 second-year undergraduate pharmacy students, and 122 members of the general public. The tool had satisfactory content validity, with a scale content validity index of 0.8. The mean percentage knowledge scores for general medical specialists and fourth-year pharmacy students were higher than second-year pharmacy students, followed by the general public (92.9%, 87.6%, 68.5% and 53.4%, respectively; p-value < 0.001), supporting construct validity. The tool had good internal consistency reliability (Cronbach's alpha = 0.91). The item-total correlation was in the preferred range of 0.23 to 0.71. The Atrial Fibrillation Knowledge Assessment Tool is a valid instrument and can be used to investigate AF knowledge of the general population.
| S-EPMC7084596 | biostudies-literature
Project description:BACKGROUND:Albinism comprises a group of autosomal recessive diseases that are characterized by poor vision and a variable hypopigmentation phenotype. A comprehensive literature review showed that no tool can assess the burden experienced by individuals who present with albinism, although such a tool is needed and would be beneficial for clinicians and patients alike. METHOD:The questionnaire was devised using standardized methodology for developing and validating questionnaires on the quality of life of subjects according to the following chronological structure: conceptual phase, development phase, and then validation phase. A multidisciplinary working group was assembled, including experts on questionnaire design and development, dermatologists specializing in care for patients with albinism, and representatives of the Genespoir association. RESULTS:Based on an initial verbatim report, the workgroup compiled a list of items that were transcribed and reformulated into questions. During the validation phase, principal component analysis (PCA) was conducted on the 24 items, which allowed the questionnaire to be reduced to 20 questions [Q]. The standardized regression coefficients were all greater than 0.5 for their corresponding factors. Based on their normalized regression coefficients, each group of questions was linked to one of the following four dimensions, with each dimension consisting of at least three questions: "Live with" (8 Q), "Daily life" (3 Q), "Resignation" (3 Q), and "Fear of the future" (6 Q). All dimensions correlated well with the overall BoA score. Cronbach's ? was 0.92 for the entire BoA scale, confirming excellent internal coherence. Intradimensional coherences all demonstrated excellent reliability (??>?0.65). The BoA questionnaire was highly correlated with the SF12, RSES and DLQI validated questionnaires. This outcome confirmed the external validity. CONCLUSION:This questionnaire represents the first specific assessment tool for evaluating the burden of albinism. It is easy to use and relatively quick to complete, which will allow the burden to be evaluated over time with a reproducible questionnaire. To ensure that this questionnaire can be used by as many people as possible, cultural and linguistic validation in US English was conducted with the original French version.
| S-EPMC6145119 | biostudies-literature