Dataset Information

A framework to assess the quality and impact of bioinformatics training across ELIXIR.

ABSTRACT: ELIXIR is a pan-European intergovernmental organisation for life science that aims to coordinate bioinformatics resources in a single infrastructure across Europe; bioinformatics training is central to its strategy, which aims to develop a training community that spans all ELIXIR member states. In an evidence-based approach for strengthening bioinformatics training programmes across Europe, the ELIXIR Training Platform, led by the ELIXIR EXCELERATE Quality and Impact Assessment Subtask in collaboration with the ELIXIR Training Coordinators Group, has implemented an assessment strategy to measure quality and impact of its entire training portfolio. Here, we present ELIXIR's framework for assessing training quality and impact, which includes the following: specifying assessment aims, determining what data to collect in order to address these aims, and our strategy for centralised data collection to allow for ELIXIR-wide analyses. In addition, we present an overview of the ELIXIR training data collected over the past 4 years. We highlight the importance of a coordinated and consistent data collection approach and the relevance of defining specific metrics and answer scales for consortium-wide analyses as well as for comparison of data across iterations of the same course.

SUBMITTER: Gurwitz KT

PROVIDER: S-EPMC7377377 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A framework to assess the quality and impact of bioinformatics training across ELIXIR.

Gurwitz Kim T KT Singh Gaur Prakash P Bellis Louisa J LJ Larcombe Lee L Alloza Eva E Balint Balint Laszlo BL Botzki Alexander A Dimec Jure J Dominguez Del Angel Victoria V Fernandes Pedro L PL Korpelainen Eija E Krause Roland R Kuzak Mateusz M Le Pera Loredana L Leskošek Brane B Lindvall Jessica M JM Marek Diana D Martinez Paula A PA Muyldermans Tuur T Nygård Ståle S Palagi Patricia M PM Peterson Hedi H Psomopoulos Fotis F Spiwok Vojtech V van Gelder Celia W G CWG Via Allegra A Vidak Marko M Wibberg Daniel D Morgan Sarah L SL Rustici Gabriella G

PLoS computational biology 20200723 7

ELIXIR is a pan-European intergovernmental organisation for life science that aims to coordinate bioinformatics resources in a single infrastructure across Europe; bioinformatics training is central to its strategy, which aims to develop a training community that spans all ELIXIR member states. In an evidence-based approach for strengthening bioinformatics training programmes across Europe, the ELIXIR Training Platform, led by the ELIXIR EXCELERATE Quality and Impact Assessment Subtask in collab ...[more]

PMID: 32702016

Similar Datasets

Project description:BackgroundIn this research paper we report on the quality of feedback provided in the logbooks of pre-clinical undergraduate students based on a model of 'actionable feedback'. Feedback to clinical learners about their performance is crucial to their learning, which ultimately impacts on their development into competent clinicians. Due to students' concerns regarding the inconsistency and quality of feedback provided by clinicians, a structured feedback improvement strategy to move feedback forward was added to the clinical skills logbook. The instrument was also extended for peer assessment. This study aims to assess the quality of feedback using the deliberate practice framework.MethodsA feedback scoring system was used to retrospectively assess the quality of tutor and peer logbook feedback provided to second and third year medical students to identify deliberate practice components i.e. task, performance gap and action plan. The sample consisted of 425 second year and 600 third year feedback responses over a year.ResultsAll three deliberate practice components were observed in the majority of the written feedback for both classes. The frequency was higher in peer (83%, 89%) than tutor logbook assessments (51%, 67%) in both classes respectively. Average tutor and peer task, gap and action feedback scores ranged from 1.84-2.07 and 1.93-2.21 respectively. The overall quality of feedback provided by the tutor and peer was moderate and less specific (average score < or = 2). The absence of the three components was noted in only 1% of the feedback responses in both 2nd and 3rd year.ConclusionThis study found that adding in a feed-forward strategy to the logbooks increased the overall quality of tutor and peer feedback as the task, gap and action plans were described. Deliberate practice framework provides an objective assessment of tutor and peer feedback quality and can be used for faculty development and training. The findings from our study suggest that the ratings from the tool can also be used as guidelines to provide feedback providers with feedback on the quality of feedback they provided. This includes specifically describing a task, performance gap and providing a learning plan as feed-forward to enhance feedback given.

Project description:BACKGROUND:The advent of Next Generation Sequencing (NGS) technologies and the concomitant reduction in sequencing costs allows unprecedented high throughput profiling of biological systems in a cost-efficient manner. Modern biological experiments are increasingly becoming both data and computationally intensive and the wealth of publicly available biological data is introducing bioinformatics into the "Big Data" era. For these reasons, the effective application of High Performance Computing (HPC) architectures is becoming progressively more recognized also by bioinformaticians. Here we describe HPC resources provisioning pilot programs dedicated to bioinformaticians, run by the Italian Node of ELIXIR (ELIXIR-IT) in collaboration with CINECA, the main Italian supercomputing center. RESULTS:Starting from April 2016, CINECA and ELIXIR-IT launched the pilot Call "ELIXIR-IT HPC@CINECA", offering streamlined access to HPC resources for bioinformatics. Resources are made available either through web front-ends to dedicated workflows developed at CINECA or by providing direct access to the High Performance Computing systems through a standard command-line interface tailored for bioinformatics data analysis. This allows to offer to the biomedical research community a production scale environment, continuously updated with the latest available versions of publicly available reference datasets and bioinformatic tools. Currently, 63 research projects have gained access to the HPC@CINECA program, for a total handout of ~?8 Millions of CPU/hours and, for data storage, ~?100?TB of permanent and?~?300?TB of temporary space. CONCLUSIONS:Three years after the beginning of the ELIXIR-IT HPC@CINECA program, we can appreciate its impact over the Italian bioinformatics community and draw some considerations. Several Italian researchers who applied to the program have gained access to one of the top-ranking public scientific supercomputing facilities in Europe. Those investigators had the opportunity to sensibly reduce computational turnaround times in their research projects and to process massive amounts of data, pursuing research approaches that would have been otherwise difficult or impossible to undertake. Moreover, by taking advantage of the wealth of documentation and training material provided by CINECA, participants had the opportunity to improve their skills in the usage of HPC systems and be better positioned to apply to similar EU programs of greater scale, such as PRACE. To illustrate the effective usage and impact of the resources awarded by the program - in different research applications - we report five successful use cases, which have already published their findings in peer-reviewed journals.

Project description:BackgroundHealth and medical research funding agencies are increasingly interested in measuring the impact of funded research. We present a research impact case study for the first four years of an Australian National Health and Medical Research Council funded Centre of Research Excellence in Cardiovascular Outcomes Improvement (2016-2020). The primary aim of this paper was to explore the application of a research impact matrix to assess the impact of cardiovascular outcomes improvement research.MethodsWe applied a research impact matrix developed from a systematic review of existing methodological frameworks used to measure research impact. This impact matrix was used as a bespoke tool to identify and understand various research impacts over different time frames. Data sources included a review of existing internal documentation from the research centre and publicly available information sources, informal iterative discussions with 10 centre investigators, and confirmation of information from centre grant and scholarship recipients.ResultsBy July 2019, the impact on the short-term research domain category included over 41 direct publications, which were cited over 87 times (median journal impact factor of 2.84). There were over 61 conference presentations, seven PhD candidacies, five new academic collaborations, and six new database linkages conducted. The impact on the mid-term research domain category involved contributions towards the development of a national cardiac registry, cardiovascular guidelines, application for a Medicare Benefits Schedule reimbursement item number, introduction of patient-reported outcome measures into several databases, and the establishment of nine new industry collaborations. Evidence of long-term impacts were described as the development and use of contemporary management for aortic stenosis, a cardiovascular risk prediction model and prevention targets in several data registries, and the establishment of cost-effectiveness for stenting compared to surgery.ConclusionsWe considered the research impact matrix a feasible tool to identify evidence of academic and policy impact in the short- to midterm; however, we experienced challenges in capturing long-term impacts. Cost containment and broader economic impacts represented another difficult area of impact to measure.

Project description:PURPOSE: Preparing residents for future practice, knowledge, and skills in quality improvement and safety (QI/S) is a requisite element of graduate medical education. Despite many challenges, residency programs must consider new curricular innovations to meet the requirements. We report the effectiveness of a primary care QI/S curriculum and the role of the chief resident in quality and patient safety in facilitating it. METHOD: Through the Veterans Administration Graduate Medical Education Enhancement Program, we added a position for a chief resident in quality and patient safety, and 4 full-time equivalent internal medicine residents, to develop the Primary Care Interprofessional Patient-Centered Quality Care Training Curriculum. The curriculum includes a first-or second-year, 1-month block rotation that serves as a foundational experience in QI/S and interprofessional care. The responsibilities of the chief resident in quality and patient safety included organizing and teaching the QI/S curriculum and mentoring resident projects. Evaluation included prerotation and postrotation surveys of self-assessed QI/S knowledge, abilities, skills, beliefs, and commitment (KASBC); an end-of-the-year KASBC; prerotation and postrotation knowledge test; and postrotation and faculty surveys. RESULTS: Comparisons of prerotation and postrotation KASBC indicated significant self-assessed improvements in 4 of 5 KASBC domains: knowledge (P < .001), ability (P < .001), skills (P < .001), and belief (P < .03), which were sustained on the end-of-the-year survey. The knowledge test demonstrated increased QI/S knowledge (P = .002). Results of the postrotation survey indicate strong satisfaction with the curriculum, with 76% (25 of 33) and 70% (23 of 33) of the residents rating the quality and safety curricula as always or usually educational. Most faculty members acknowledged that the chief resident in quality and patient safety enhanced both faculty and resident QI/S interest and participation in projects. CONCLUSIONS: Our primary care QI/S curriculum was associated with improved and persistent resident self-perceived knowledge, abilities, and skills and increased knowledge-based scores of QI/S. The chief resident in quality and patient safety played an important role in overseeing the curriculum, teaching, and providing leadership.

Dataset Information

A framework to assess the quality and impact of bioinformatics training across ELIXIR.

Publications

A framework to assess the quality and impact of bioinformatics training across ELIXIR.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets