Proposal of a linear rather than hierarchical evaluation of educational initiatives: the 7Is framework.
Ontology highlight
ABSTRACT:
SUBMITTER: Roland D
PROVIDER: S-EPMC4536351 | biostudies-literature | 2015
REPOSITORIES: biostudies-literature
Publications
Proposal of a linear rather than hierarchical evaluation of educational initiatives: the 7Is framework.
Journal of educational evaluation for health professions 20150624
Extensive resources are expended attempting to change clinical practice; however, determining the effects of these interventions can be challenging. Traditionally, frameworks to examine the impact of educational interventions have been hierarchical in their approach. In this article, existing frameworks to examine medical education initiatives are reviewed and a novel '7Is framework' discussed. This framework contains seven linearly sequenced domains: interaction, interface, instruction, ideatio ...[more]
Similar Datasets
Project description:BackgroundThe existing frameworks for the evaluation of genetic and genomic applications clearly address the technical and clinical value of a test, but are less concerned with the way genetic services are delivered and organized. We therefore aimed to develop a comprehensive new framework that includes an assessment of service delivery.MethodsA new framework was built on the evaluation dimensions identified through a systematic review of the existing frameworks and a Delphi survey of Italian experts in public health genomics.ResultsOur framework has four sections. The first two sections, respectively, guide the evidence collection process for the genetic test (analytic validity; clinical validity; clinical utility; personal utility) and its delivery models (organizational aspects; economic evaluation; ethical, legal and social implications; patient perspective). The third section guides the formulation of the research priorities to be addressed in future research. Finally, the fourth section suggests three criteria to summarize the collected evidence (net benefit, cost-effectiveness, feasibility).ConclusionWe have successfully developed an evaluation framework for the evaluation of genetic tests that includes an assessment of service delivery. It also introduces some neglected evaluation dimensions such as personal utility and patient perspective.
| S-EPMC6681956 | biostudies-literature
Project description:An estimated two billion people worldwide lack adequate access to surgical care. To address this humanitarian emergency, an increasing number of international surgical partnerships are emerging between developed and low- and middle-income countries (LMICs). At present, there are no clear indicators that may be used to assess the effectiveness of such initiatives.We conducted an international qualitative study of 31 surgeons from developed and LMICs involved in international partnerships across a variety of subspecialties. Thematic analysis and grounded theory were applied in order to develop a practical framework that may be applied to monitor and evaluate global surgical initiatives.Several themes emerged from the study: (i) there is a large unmet need to establish and maintain prospective databases in LMICs to inform the monitoring and evaluation of international surgical partnerships; (ii) assessment of initiatives must occur longitudinally over the span of several years; (ii) the domains of assessment are contextual and encompass cultural, institutional and regional factors; and (iv) evaluation strategies should explore broader impact within the community and country. Based on thematic analysis within the domains of inputs, outputs and outcomes, a framework for the monitoring and evaluation of international surgical initiatives, the Framework for the Assessment of InteRNational Surgical Success (FAIRNeSS) is proposed.In response to the increasing number of surgical partnerships between developed and LMICs, we propose a framework to monitor and evaluate international surgical initiatives.
| S-EPMC4379101 | biostudies-literature
Project description:ObjectivesTo illustrate key contextual factors that may have effects on clinical decision support (CDS) adoption and, ultimately, success.Materials and methodsWe conducted a qualitative evaluation of 2 similar radiology CDS innovations for near-term endpoints affecting adoption and present the findings using an evaluation framework. We identified key contextual factors between these 2 innovations and determined important adoption differences between them.ResultsDegree of electronic health record integration, approach to education and training, key drivers of adoption, and tailoring of the CDS to the clinical context were handled differently between the 2 innovations, contributing to variation in their relative degrees of adoption and use. Attention to these factors had impacts on both near and later-term measures of success (eg, patient outcomes).DiscussionCDS adoption is a well-studied early-term measure of CDS success that directly impacts outcomes. Adoption requires attention throughout the design phases of an intervention especially to key factors directly affecting it, including how implementation across multiple sites and systems complicates adoption, which prior experience with CDS matters, and that practice guidelines invariably require tailoring to the clinical context.ConclusionWith better planning for the capture of early-term measures of successful CDS implementation, especially adoption, critical adjustments may be made to ensure that the CDS is effectively implemented to be successful.
| S-EPMC6952024 | biostudies-literature
Project description:BACKGROUND:The potential of blockchain technology to achieve strategic goals, such as value-based care, is increasingly being recognized by both researchers and practitioners. However, current research and practices lack comprehensive approaches for evaluating the benefits of blockchain applications. OBJECTIVE:The goal of this study was to develop a framework for holistically assessing the performance of blockchain initiatives in providing value-based care by extending the existing balanced scorecard (BSC) evaluation framework. METHODS:Based on a review of the literature on value-based health care, blockchain technology, and methods for evaluating initiatives in disruptive technologies, we propose an extended BSC method for holistically evaluating blockchain applications in the provision of value-based health care. The proposed method extends the BSC framework, which has been extensively used to measure both financial and nonfinancial performance of organizations. The usefulness of our proposed framework is further demonstrated via a case study. RESULTS:We describe the extended BSC framework, which includes five perspectives (both financial and nonfinancial) from which to assess the appropriateness and performance of blockchain initiatives in the health care domain. CONCLUSIONS:The proposed framework moves us toward a holistic evaluation of both the financial and nonfinancial benefits of blockchain initiatives in the context of value-based care and its provision.
| S-EPMC6789420 | biostudies-literature
Project description:IntroductionPopulation awareness and empowerment in omics sciences represent a fundamental driver to increase the adoption of evidence-based approaches in personalized medicine. In this context, a pivotal role is played by citizens' literacy, and educational initiatives carried out in this context are key assets to drive future effective interventions. With the present study, we summarized the educational initiatives conducted worldwide aimed at increasing citizens' literacy in omics sciences.Materials and methodsWe conducted a web search of the educational initiatives aimed at improving citizens' literacy in omics sciences undertaken worldwide, by using three search engines (Google, Bing, and Yahoo Search), in English and in Italian languages.ResultsWe identified five initiatives in Europe, 22 in non-European countries, and 13 in Italy. Overall, the majority (69%) were web-based initiatives, while 31% required in-person attendance. The online initiatives included web pages for reading, online lessons/courses, web portals, videos/short movies, animations, and apps for mobile devices. The residential initiatives, on the other hand, included exhibitions, seminars, courses, symposia, information stands in public places, guided visits to research laboratories, and interactive laboratories. All the initiatives were highly heterogeneous in terms of methodologies and the topics addressed.Discussion and conclusionOverall, we identified a variety of initiatives aimed at improving citizens' literacy in omics sciences, with the largest majority carried out in the United States and being web-based. Our results showed heterogeneity among the initiatives as to the dealt topics and the adopted methods. Further research is needed, however, to quantitatively assess the effectiveness of educational initiatives to improve citizens' literacy in omics sciences.
| S-EPMC8292827 | biostudies-literature
Project description:BackgroundEmerging technologies have demonstrated outstanding potential in improving healthcare, yet their full integration remains a challenge for all medical specialties, including pediatrics. To support the swift implementation of technologies, we identified the current trends through a bibliometric review, and we conducted a survey on Italian pediatricians to gauge educational needs and willingness to integrate technologies into clinical practice.MethodsA working group of pediatricians representing various backgrounds designed and coordinated the study. To identify relevant topics for educational strategy development, we focused on virtual reality, telehealth, natural language processing, smartphone applications, robotics, genomics, and artificial intelligence. A bibliometric analysis limited to 2018-2023 was performed to identify trends and emerging applications within each topic. Based on the results, a questionnaire was developed and made available online to all Italian pediatricians. The results were analyzed through descriptive analysis and a multivariable logistic regression to explore associations between technology adoption and sociodemographic characteristics.ResultsA total of 3,253 publications were found, with Telehealth and Telemedicine having the highest number of publications and Natural Language Processing the lowest. The number of respondents to the online questionnaire was 1,540, predominantly medical doctors with over 20 years of experience working as family pediatricians. Telehealth had the highest level of knowledge (95.2%), followed by smartphone applications (89.1%) and genomics (63.2%). The greatest potential for increased use through education programs was projected for natural language processing (+ 43.1%), artificial intelligence (+ 39.6%), and virtual and mixed reality (+ 38.1%). Female respondents and older individuals were less likely to use emerging technologies. Hospital pediatricians and residents were more likely to use AI.ConclusionsWe developed a replicable strategy to identify emerging themes in medical technologies relevant to pediatrics and assess the educational needs of pediatricians. A significant gap still exists between current and potential usage of emerging technologies among Italian pediatricians although they showed a positive attitude towards implementing these technologies following specific education programs. The study highlights the need for comprehensive education programs on emerging technologies in pediatrics and recommends addressing gender and age disparities in technology adoption.
| S-EPMC10478260 | biostudies-literature
Project description:Rationale, Aims, and Objectives. The Intermediate Care Unit (IMCU) is a hospital unit which is logistically situated between the hospital ward and the Intensive Care Unit (ICU). There is debate regarding the value of the IMCU. Understanding its value is compromised by the lack of adequate quality indicators. Therefore, this study identifies currently used IMCU indicators and evaluates their usefulness. Methods. Through a systematic literature search, currently used quality indicators were identified and evaluated for their importance using a proposed IMCU-specific quality measurement framework. Results. From 4034 titles and abstracts, 168 articles were selected for full-text review. Of these, 22 articles were included, which reported IMCU quality at the level of the IMCU (n = 12), the ICU (n = 5), both IMCU and ICU (n = 3) or hospital level (n = 2). At the IMCU, the IMCU mortality (n = 16), discharge-to-ICU rate (n = 7), in-hospital IMCU mortality (n = 7), and length of stay (n = 6) were most frequently reported. Three studies compared the effect of different structures of the IMCU on its utilization or hospital outcome. Conclusions. Current focus in IMCU quality research is towards measuring quality at the IMCU itself. Since the influence of the structure of IMCUs on its utilization and its effects on hospital outcome are only rarely investigated, attention should shift towards these important issues in further research. The proposed IMCU quality measurement framework can thereby serve as a helpful tool.
| S-EPMC6087599 | biostudies-literature
Project description:The International League Against Epilepsy (ILAE) seizure classification scheme has been periodically updated to improve its reliability and applicability to clinicians and researchers alike. Here, members of the Epilepsy Study Consortium propose a pragmatic seizure classification, based on the ILAE scheme, designed for use in clinical trials with a focus on outcome measures that have high reliability, broad interpretability across stakeholders, and clinical relevance in the context of the development of novel antiseizure medications. Controversies around the current ILAE classification scheme are discussed in the context of clinical trials, and pragmatic simplifications to the existing scheme are proposed, for intended use by investigators, industry sponsors, and regulatory agencies.
| S-EPMC9302660 | biostudies-literature
Project description:PurposeWe systematically reviewed existing critical care electroencephalography (EEG) educational programs for non-neurologists, with the primary goal of reporting the content covered, methods of instruction, overall duration, and participant experience. Our secondary goals were to assess the impact of EEG programs on participants' core knowledge, and the agreement between non-experts and experts for seizure identification.SourceMajor databases were searched from inception to 30 August 2020. Randomized controlled trials, cohort studies, and descriptive studies were all considered if they reported an EEG curriculum for non-neurologists in a critical care setting. Data were presented thematically for the qualitative primary outcome and a meta-analysis using a random effects model was performed for the quantitative secondary outcomes.Principal findingsTwenty-nine studies were included after reviewing 7,486 citations. Twenty-two studies were single centre, 17 were from North America, and 16 were published after 2016. Most EEG studies were targeted to critical care nurses (17 studies), focused on processed forms of EEG with amplitude-integrated EEG being the most common (15 studies), and were shorter than one day in duration (24 studies). In pre-post studies, EEG programs significantly improved participants' knowledge of tested material (standardized mean change, 1.79; 95% confidence interval [CI], 0.86 to 2.73). Agreement for seizure identification between non-experts and experts was moderate (Cohen's kappa = 0.44; 95% CI, 0.27 to 0.60).ConclusionsIt is feasible to teach basic EEG to participants in critical care settings from different clinical backgrounds, including physicians and nurses. Brief training programs can enable bedside providers to recognize high-yield abnormalities such as non-convulsive seizures.
| S-EPMC7952081 | biostudies-literature
Project description:BackgroundAlzheimer disease (AD) and AD-related dementia are prevalent concerns for aging populations. With a growing older adult population living in the United States, the number of people living with dementia is expected to grow, posing significant challenges for informal caregivers. The mental and physical burdens associated with caregiving highlight the importance of developing novel and effective resources to support caregivers. However, technology solutions designed to address their needs often face low adoption rates due to usability issues and a lack of contextual relevance. This study focuses on developing a web-based platform providing financial and legal planning information and education for dementia caregivers and evaluating the platform's usability and adoptability.ObjectiveThe goal of this project is to create a web-based platform that connects caregivers with personalized and easily accessible resources. This project involves industrial, academic, and community partners and focuses on two primary aims: (1) developing a digital platform using a Dementia Care Personalization Algorithm and assessing feasibility in a pilot group of caregivers, and (2) evaluating the acceptability and usability of the digital platform across different racial or ethnic populations. This work will aid in the development of technology-based interventions to reduce caregiver burden.MethodsThe phase I study follows an iterative Design Thinking approach, involving at least 25 dementia caregivers as a user feedback panel to assess the platform's functionality, aesthetics, information, and overall quality using the adapted Mobile Application Rating Scale. Phase II is a usability study with 300 dementia caregivers in Texas (100 African American, 100 Hispanic or Latinx, and 100 non-Hispanic White). Participants will use the digital platform for about 4 weeks and evaluate its usefulness and ease of use through the Technology Acceptance Survey.ResultsThe study received funding from the National Institute on Aging on September 3, 2021. Ethical approval for phase I was obtained from the Texas A&M University Institutional Review Board on December 8, 2021, with data collection starting on January 1, 2022, and concluding on May 31, 2022. Phase I results were published on September 5, 2023, and April 17, 2024, respectively. On June 21, 2023, ethical approval for human subjects for phase II was granted, and participant recruitment began on July 1, 2023.ConclusionsUpon completing these aims, we expect to deliver a widely accessible digital platform tailored to assist dementia caregivers with financial and legal challenges by connecting them to personalized, contextually relevant information and resources in Texas. If successful, we plan to work with caregiving organizations to scale and sustain the platform, addressing the needs of the growing population living with dementia.International registered report identifier (irrid)DERR1-10.2196/64127.
| S-EPMC11339571 | biostudies-literature