Framework for advancing rigorous research.
Ontology highlight
ABSTRACT:
SUBMITTER: Koroshetz WJ
PROVIDER: S-EPMC7056268 | biostudies-literature | 2020 Mar
REPOSITORIES: biostudies-literature
Publications
Framework for advancing rigorous research.
Koroshetz Walter J WJ Behrman Shannon S Brame Cynthia J CJ Branchaw Janet L JL Brown Emery N EN Clark Erin A EA Dockterman David D Elm Jordan J JJ Gay Pamela L PL Green Katelyn M KM Hsi Sherry S Kaplitt Michael G MG Kolber Benedict J BJ Kolodkin Alex L AL Lipscombe Diane D MacLeod Malcolm R MR McKinney Caleb C CC Munafò Marcus R MR Oakley Barbara B Olimpo Jeffrey T JT Percie du Sert Nathalie N Raman Indira M IM Riley Ceri C Shelton Amy L AL Uzzo Stephen Miles SM Crawford Devon C DC Silberberg Shai D SD
eLife 20200304
There is a pressing need to increase the rigor of research in the life and biomedical sciences. To address this issue, we propose that communities of 'rigor champions' be established to campaign for reforms of the research culture that has led to shortcomings in rigor. These communities of rigor champions would also assist in the development and adoption of a comprehensive educational platform that would teach the principles of rigorous science to researchers at all career stages. ...[more]
Similar Datasets
Project description:Suicide is a leading cause of death worldwide and perhaps the most puzzling and devastating of all human behaviors. Suicide research has primarily been guided by verbal theories containing vague constructs and poorly specified relationships. We propose two fundamental changes required to move toward a mechanistic understanding of suicide. First, we must formalize theories of suicide, expressing them as mathematical or computational models. Second, we must conduct rigorous descriptive research, prioritizing direct observation and precise measurement of suicidal thoughts and behaviors and of the factors posited to cause them. Together, theory formalization and rigorous descriptive research will facilitate abductive theory construction and strong theory testing, thereby improving the understanding and prevention of suicide and related behaviors.
| S-EPMC7429350 | biostudies-literature
Project description:Over the past 50 years, we have seen dramatic changes in cardiovascular science and clinical care, accompanied by marked declines in the morbidity and mortality. Nonetheless, cardiovascular disease remains the leading cause of death and disability in the world, and its nature is changing as Americans become older, fatter, and ethnically more diverse. Instead of young or middle-aged men with ST-segment elevation myocardial infarction, the "typical" cardiac patient now presents with acute coronary syndrome or with complications related to chronic hypertension or ischemic heart disease, including heart failure, sudden death, and atrial fibrillation. Analogously, structural heart disease is now dominated by degenerative valve or congenital disease, far more common than rheumatic disease. The changing clinical scene presents cardiovascular scientists with a number of opportunities and challenges, including taking advantage of high-throughput technologies to elucidate complex disease mechanisms, accelerating development and implementation of evidence-based strategies, assessing evolving technologies of unclear value, addressing a global epidemic of cardiovascular disease, and maintaining high levels of innovation in a time of budgetary constraint and economic turmoil.
| S-EPMC3277295 | biostudies-other
Project description:BackgroundMany interventions found to be effective in health services research studies fail to translate into meaningful patient care outcomes across multiple contexts. Health services researchers recognize the need to evaluate not only summative outcomes but also formative outcomes to assess the extent to which implementation is effective in a specific setting, prolongs sustainability, and promotes dissemination into other settings. Many implementation theories have been published to help promote effective implementation. However, they overlap considerably in the constructs included in individual theories, and a comparison of theories reveals that each is missing important constructs included in other theories. In addition, terminology and definitions are not consistent across theories. We describe the Consolidated Framework For Implementation Research (CFIR) that offers an overarching typology to promote implementation theory development and verification about what works where and why across multiple contexts.MethodsWe used a snowball sampling approach to identify published theories that were evaluated to identify constructs based on strength of conceptual or empirical support for influence on implementation, consistency in definitions, alignment with our own findings, and potential for measurement. We combined constructs across published theories that had different labels but were redundant or overlapping in definition, and we parsed apart constructs that conflated underlying concepts.ResultsThe CFIR is composed of five major domains: intervention characteristics, outer setting, inner setting, characteristics of the individuals involved, and the process of implementation. Eight constructs were identified related to the intervention (e.g., evidence strength and quality), four constructs were identified related to outer setting (e.g., patient needs and resources), 12 constructs were identified related to inner setting (e.g., culture, leadership engagement), five constructs were identified related to individual characteristics, and eight constructs were identified related to process (e.g., plan, evaluate, and reflect). We present explicit definitions for each construct.ConclusionThe CFIR provides a pragmatic structure for approaching complex, interacting, multi-level, and transient states of constructs in the real world by embracing, consolidating, and unifying key constructs from published implementation theories. It can be used to guide formative evaluations and build the implementation knowledge base across multiple studies and settings.
| S-EPMC2736161 | biostudies-literature
Project description:BackgroundIt is widely accepted and acknowledged that data harmonization is crucial: in its absence, the co-analysis of major tranches of high quality extant data is liable to inefficiency or error. However, despite its widespread practice, no formalized/systematic guidelines exist to ensure high quality retrospective data harmonization.MethodsTo better understand real-world harmonization practices and facilitate development of formal guidelines, three interrelated initiatives were undertaken between 2006 and 2015. They included a phone survey with 34 major international research initiatives, a series of workshops with experts, and case studies applying the proposed guidelines.ResultsA wide range of projects use retrospective harmonization to support their research activities but even when appropriate approaches are used, the terminologies, procedures, technologies and methods adopted vary markedly. The generic guidelines outlined in this article delineate the essentials required and describe an interdependent step-by-step approach to harmonization: 0) define the research question, objectives and protocol; 1) assemble pre-existing knowledge and select studies; 2) define targeted variables and evaluate harmonization potential; 3) process data; 4) estimate quality of the harmonized dataset(s) generated; and 5) disseminate and preserve final harmonization products.ConclusionsThis manuscript provides guidelines aiming to encourage rigorous and effective approaches to harmonization which are comprehensively and transparently documented and straightforward to interpret and implement. This can be seen as a key step towards implementing guiding principles analogous to those that are well recognised as being essential in securing the foundational underpinning of systematic reviews and the meta-analysis of clinical trials.
| S-EPMC5407152 | biostudies-literature
Project description:Cancer epidemiologists have a long history of combining data sets in pooled analyses, often harmonizing heterogeneous data from multiple studies into 1 large data set. Although there are useful websites on data harmonization with recommendations and support, there is little research on best practices in data harmonization; each project conducts harmonization according to its own internal standards. The field would be greatly served by charting the process of data harmonization to enhance the quality of the harmonized data. Here, we describe the data harmonization process utilized at the Fred Hutchinson Cancer Research Center (Seattle, Washington) by the coordinating centers of several research projects. We describe a 6-step harmonization process, including: 1) identification of questions the harmonized data set is required to answer; 2) identification of high-level data concepts to answer those questions; 3) assessment of data availability for data concepts; 4) development of common data elements for each data concept; 5) mapping and transformation of individual data points to common data elements; and 6) quality-control procedures. Our aim here is not to claim a "correct" way of doing data harmonization but to encourage others to describe their processes in order that we can begin to create rigorous approaches. We also propose a research agenda around this issue.
| S-EPMC4675662 | biostudies-literature
Project description:Rising global population and climate change realities dictate that agricultural productivity must be accelerated. Results from current traditional research approaches are difficult to extrapolate to all possible fields because they are dependent on specific soil types, weather conditions, and background management combinations that are not applicable nor translatable to all farms. A method that accurately evaluates the effectiveness of infinite cropping system interactions (involving multiple management practices) to increase maize and soybean yield across the US does not exist. Here, we utilize extensive databases and artificial intelligence algorithms and show that complex interactions, which cannot be evaluated in replicated trials, are associated with large crop yield variability and thus, potential for substantial yield increases. Our approach can accelerate agricultural research, identify sustainable practices, and help overcome future food demands.
| S-EPMC8429560 | biostudies-literature
Project description:Membrane proteins are critical functional molecules in the human body, constituting more than 30% of open reading frames in the human genome. Unfortunately, a myriad of difficulties in overexpression and reconstitution into membrane mimetics severely limit our ability to determine their structures. Computational tools are therefore instrumental to membrane protein structure prediction, consequently increasing our understanding of membrane protein function and their role in disease. Here, we describe a general framework facilitating membrane protein modeling and design that combines the scientific principles for membrane protein modeling with the flexible software architecture of Rosetta3. This new framework, called RosettaMP, provides a general membrane representation that interfaces with scoring, conformational sampling, and mutation routines that can be easily combined to create new protocols. To demonstrate the capabilities of this implementation, we developed four proof-of-concept applications for (1) prediction of free energy changes upon mutation; (2) high-resolution structural refinement; (3) protein-protein docking; and (4) assembly of symmetric protein complexes, all in the membrane environment. Preliminary data show that these algorithms can produce meaningful scores and structures. The data also suggest needed improvements to both sampling routines and score functions. Importantly, the applications collectively demonstrate the potential of combining the flexible nature of RosettaMP with the power of Rosetta algorithms to facilitate membrane protein modeling and design.
| S-EPMC4556676 | biostudies-literature
Project description:Although dispersal is generally viewed as a crucial determinant for the fitness of any organism, our understanding of its role in the persistence and spread of plant populations remains incomplete. Generalizing and predicting dispersal processes are challenging due to context dependence of seed dispersal, environmental heterogeneity and interdependent processes occurring over multiple spatial and temporal scales. Current population models often use simple phenomenological descriptions of dispersal processes, limiting their ability to examine the role of population persistence and spread, especially under global change. To move seed dispersal ecology forward, we need to evaluate the impact of any single seed dispersal event within the full spatial and temporal context of a plant's life history and environmental variability that ultimately influences a population's ability to persist and spread. In this perspective, we provide guidance on integrating empirical and theoretical approaches that account for the context dependency of seed dispersal to improve our ability to generalize and predict the consequences of dispersal, and its anthropogenic alteration, across systems. We synthesize suitable theoretical frameworks for this work and discuss concepts, approaches and available data from diverse subdisciplines to help operationalize concepts, highlight recent breakthroughs across research areas and discuss ongoing challenges and open questions. We address knowledge gaps in the movement ecology of seeds and the integration of dispersal and demography that could benefit from such a synthesis. With an interdisciplinary perspective, we will be able to better understand how global change will impact seed dispersal processes, and potential cascading effects on plant population persistence, spread and biodiversity.
| S-EPMC7179845 | biostudies-literature
Project description:Cognition and behavior emerge from brain network interactions, such that investigating causal interactions should be central to the study of brain function. Approaches that characterize statistical associations among neural time series-functional connectivity (FC) methods-are likely a good starting point for estimating brain network interactions. Yet only a subset of FC methods ('effective connectivity') is explicitly designed to infer causal interactions from statistical associations. Here we incorporate best practices from diverse areas of FC research to illustrate how FC methods can be refined to improve inferences about neural mechanisms, with properties of causal neural interactions as a common ontology to facilitate cumulative progress across FC approaches. We further demonstrate how the most common FC measures (correlation and coherence) reduce the set of likely causal models, facilitating causal inferences despite major limitations. Alternative FC measures are suggested to immediately start improving causal inferences beyond these common FC measures.
| S-EPMC7289187 | biostudies-literature
Project description:Skin cancers require a multidisciplinary approach. The updated guidelines introduce new insights into the management of these diseases. Melanoma (MM), the third most common skin cancer, a malignant melanocytic tumor, which is classified into four major histological subtypes, continues to have the potential to be a lethal disease. The mortality-incidence ratio is higher in Eastern European countries compared to Western European countries, which shows the need for better prevention and early detection in Eastern European countries. Basal cell carcinoma (BCC) and squamous cell carcinoma (cSCC) remain the top two skin cancers, and their incidence continues to grow. The gold standard in establishing the diagnosis and establishing the histopathological subtype in BCC and SCC is a skin biopsy. Sebaceous carcinoma (SeC) is an uncommon and potentially aggressive cutaneous malignancy showing sebaceous differentiation. It accounts for 0.7% of skin cancers and 3-6.7% of cancer-related deaths. Due to the rapid extension to the regional lymph nodes, SeC requires early treatment. The main treatment for sebaceous carcinoma is surgical treatment, including Mohs micrographic surgery, which has the advantage of complete margin evaluation and low recurrence rates. Primary cutaneous lymphomas (PCLs) are a heterogeneous group of lymphoproliferative diseases, with no evidence of extracutaneous determination at the moment of the diagnosis. PCLs have usually a very different evolution, prognosis, and treatment compared to the lymphomas that may secondarily involve the skin. The aim of our review is to summarize the important changes in the approach to treating melanoma, non-melanoma skin, cutaneous T and B cell lymphomas, and other types of skin cancers. For all skin cancers, optimal patient management requires a multidisciplinary approach including dermatology, medical oncology, and radiation oncology.
| S-EPMC10342314 | biostudies-literature