Dataset Information

Circularity in fisheries data weakens real world prediction.

ABSTRACT: The systematic substitution of direct observational data with synthesized data derived from models during the stock assessment process has emerged as a low-cost alternative to direct data collection efforts. What is not widely appreciated, however, is how the use of such synthesized data can overestimate predictive skill when forecasting recruitment is part of the assessment process. Using a global database of stock assessments, we show that Standard Fisheries Models (SFMs) can successfully predict synthesized data based on presumed stock-recruitment relationships, however, they are generally less skillful at predicting observational data that are either raw or minimally filtered (denoised without using explicit stock-recruitment models). Additionally, we find that an equation-free approach that does not presume a specific stock-recruitment relationship is better than SFMs at predicting synthesized data, and moreover it can also predict observational recruitment data very well. Thus, while synthesized datasets are cheaper in the short term, they carry costs that can limit their utility in predicting real world recruitment.

SUBMITTER: Giron-Nava A

PROVIDER: S-EPMC7181812 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Circularity in fisheries data weakens real world prediction.

Giron-Nava Alfredo A Munch Stephan B SB Johnson Andrew F AF Deyle Ethan E James Chase C CC Saberski Erik E Pao Gerald M GM Aburto-Oropeza Octavio O Sugihara George G

Scientific reports 20200424 1

The systematic substitution of direct observational data with synthesized data derived from models during the stock assessment process has emerged as a low-cost alternative to direct data collection efforts. What is not widely appreciated, however, is how the use of such synthesized data can overestimate predictive skill when forecasting recruitment is part of the assessment process. Using a global database of stock assessments, we show that Standard Fisheries Models (SFMs) can successfully pred ...[more]

PMID: 32332835

Similar Datasets

Project description:BackgroundTraditionally, dengue surveillance is based on case reporting to a central health agency. However, the delay between a case and its notification can limit the system responsiveness. Machine learning methods have been developed to reduce the reporting delays and to predict outbreaks, based on non-traditional and non-clinical data sources. The aim of this systematic review was to identify studies that used real-world data, Big Data and/or machine learning methods to monitor and predict dengue-related outcomes.Methodology/principal findingsWe performed a search in PubMed, Scopus, Web of Science and grey literature between January 1, 2000 and August 31, 2020. The review (ID: CRD42020172472) focused on data-driven studies. Reviews, randomized control trials and descriptive studies were not included. Among the 119 studies included, 67% were published between 2016 and 2020, and 39% used at least one novel data stream. The aim of the included studies was to predict a dengue-related outcome (55%), assess the validity of data sources for dengue surveillance (23%), or both (22%). Most studies (60%) used a machine learning approach. Studies on dengue prediction compared different prediction models, or identified significant predictors among several covariates in a model. The most significant predictors were rainfall (43%), temperature (41%), and humidity (25%). The two models with the highest performances were Neural Networks and Decision Trees (52%), followed by Support Vector Machine (17%). We cannot rule out a selection bias in our study because of our two main limitations: we did not include preprints and could not obtain the opinion of other international experts.Conclusions/significanceCombining real-world data and Big Data with machine learning methods is a promising approach to improve dengue prediction and monitoring. Future studies should focus on how to better integrate all available data sources and methods to improve the response and dengue management by stakeholders.

Project description:PurposeUsing real-world data (RWD)-based trial simulation approach, we aim to simulate colorectal cancer (CRC) trials and examine both effectiveness and safety end points in different simulation scenarios.MethodsWe identified five phase III trials comparing new treatment regimens with an US Food and Drug Administration-approved first-line treatment in patients with metastatic CRC (ie, fluorouracil, leucovorin, and irinotecan) as the standard-of-care (SOC) control arm. Using Electronic Health Record-derived data from the OneFlorida network, we defined the study populations and outcome measures using the protocols from the original trials. Our design scenarios were (1) simulation of the SOC fluorouracil, leucovorin, and irinotecan arm and (2) comparative effectiveness research (CER) simulation of the control and experimental arms. For each scenario, we adjusted for random assignment, sampling, and dropout. We used overall survival (OS) and severe adverse events (SAEs) to measure effectiveness and safety.ResultsWe conducted CER simulations for two trials, and SOC simulations for three trials. The effect sizes of our simulated trials were stable across all simulation runs. Compared with the original trials, we observed longer OS and higher mean number of SAEs in both CER and SOC simulation. In the two CER simulations, hazard ratios associated with death from simulations were similar to that reported in the original trials. Consistent with the original trials, we found higher risk ratios of SAEs in the experiment arm, suggesting potentially higher toxicities from the new treatment regimen. We also observed similar SAE rates across all simulations compared with the original trials.ConclusionIn this study, we simulated five CRC trials, and tested two simulation scenarios with several different configurations demonstrated that our simulations can robustly generate effectiveness and safety outcomes comparable with the original trials using real-world data.

Dataset Information

Circularity in fisheries data weakens real world prediction.

Publications

Circularity in fisheries data weakens real world prediction.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets