Dataset Information

A multi-disciplinary perspective on emergent and future innovations in peer review.

ABSTRACT: Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.

SUBMITTER: Tennant JP

PROVIDER: S-EPMC5686505 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A multi-disciplinary perspective on emergent and future innovations in peer review.

Tennant Jonathan P JP Dugan Jonathan M JM Graziotin Daniel D Jacques Damien C DC Waldner François F Mietchen Daniel D Elkhatib Yehia Y B Collister Lauren L Pikas Christina K CK Crick Tom T Masuzzo Paola P Caravaggi Anthony A Berg Devin R DR Niemeyer Kyle E KE Ross-Hellauer Tony T Mannheimer Sara S Rigling Lillian L Katz Daniel S DS Greshake Tzovaras Bastian B Pacheco-Mendoza Josmel J Fatima Nazeefa N Poblet Marta M Isaakidis Marios M Irawan Dasapta Erwin DE Renaut Sébastien S Madan Christopher R CR Matthias Lisa L Nørgaard Kjær Jesper J O'Donnell Daniel Paul DP Neylon Cameron C Kearns Sarah S Selvaraju Manojkumar M Colomb Julien J

F1000Research 20170720

Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With ...[more]

PMID: 29188015

Similar Datasets

Project description:BackgroundThere have been growing recommendations to include education in multi-disciplinary interventions targeting chronic pain management. However, effects of this strategy on short- and long-term self-management of chronic pain, remain largely unexplored.Objectives1. To provide an updated overview of studies that report on the impact of patient education in multi-disciplinary interventions, on self-management of chronic pain; 2. To explore associations between education and chronic pain self-management techniques; and 3. To identify the format and duration of suitable chronic pain interventions targeted at patient self-management.MethodsDesign: Narrative systematic literature review of randomised or controlled study designs. Data Sources: PubMed, CINAHL, EMBASE, PsycINFO. Participants: Adult patients with chronic pain of any aetiology participating in multi-disciplinary programs that included education. Main outcome measures: Assessments of level of pain, function, quality of life, self-efficacy, self-management, and any other relevant assessments. Study Appraisal and Synthesis Methods: PRISMA guidelines, Cochrane Risk of Bias tool, and TIDieR model.ResultsDatabase searching identified 485 potential papers. After removal of duplicates, and irrelevant articles by title and abstract, 120 full-text articles were reviewed and 27 studies were included in this systematic review. Studies were predominantly from the United States (n = 8; 29.6%). Over one hundred outcome measures were identified across all studies, with significant variation also observed in terms of how chronic pain duration was defined, and how education was delivered to participants. Overall, positive benefits of education were reported.ConclusionsEducation, as part of multi-disciplinary programs, is likely to improve self-management and self-efficacy in people with chronic pain of any aetiology. Heterogeneity in terms of: chronic pain duration; educational resources; healthcare professionals; and outcome measures, were identified as limitations. Further research, in the form of Randomised Controlled Trials addressing these limitations, is recommended.

Project description:To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health.A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis.A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed.There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

Dataset Information

A multi-disciplinary perspective on emergent and future innovations in peer review.

Publications

A multi-disciplinary perspective on emergent and future innovations in peer review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets