Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

A strategy to improve expert technology forecasts.

ABSTRACT: Forecasts of the future cost and performance of technologies are often used to support decision-making. However, retrospective reviews find that many forecasts made by experts are not very accurate and are often seriously overconfident, with realized values too frequently falling outside of forecasted ranges. Here, we outline a hybrid approach to expert elicitation that we believe might improve forecasts of future technologies. The proposed approach iteratively combines the judgments of technical domain experts with those of experts who are knowledgeable about broader issues of technology adoption and public policy. We motivate the approach with results from a pilot study designed to help forecasters think systematically about factors beyond the technology itself that may shape its future, such as policy, economic, and social factors. Forecasters who received briefings on these topics provided wider forecast intervals than those receiving no assistance.

SUBMITTER: Savage T

PROVIDER: S-EPMC8166153 | biostudies-literature | 2021 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

A strategy to improve expert technology forecasts.

Savage Tamara T Davis Alex A Fischhoff Baruch B Morgan M Granger MG

Proceedings of the National Academy of Sciences of the United States of America 20210501 21

Forecasts of the future cost and performance of technologies are often used to support decision-making. However, retrospective reviews find that many forecasts made by experts are not very accurate and are often seriously overconfident, with realized values too frequently falling outside of forecasted ranges. Here, we outline a hybrid approach to expert elicitation that we believe might improve forecasts of future technologies. The proposed approach iteratively combines the judgments of technica ...[more]

PMID: 33990418

Similar Datasets

Comparing expert elicitation and model-based probabilistic technology cost forecasts for the energy transition.

Project description:We conduct a systematic comparison of technology cost forecasts produced by expert elicitation methods and model-based methods. Our focus is on energy technologies due to their importance for energy and climate policy. We assess the performance of several forecasting methods by generating probabilistic technology cost forecasts rooted at various years in the past and then comparing these with observed costs in 2019. We do this for six technologies for which both observed and elicited data are available. The model-based methods use either deployment (Wright's law) or time (Moore's law) to forecast costs. We show that, overall, model-based forecasting methods outperformed elicitation methods. Their 2019 cost forecast ranges contained the observed values much more often than elicitations, and their forecast medians were closer to observed costs. However, all methods underestimated technological progress in almost all technologies, likely as a result of structural change across the energy sector due to widespread policies and social and market forces. We also produce forecasts of 2030 costs using the two types of methods for 10 energy technologies. We find that elicitations generally yield narrower uncertainty ranges than model-based methods. Model-based 2030 forecasts are lower for more modular technologies and higher for less modular ones. Future research should focus on further method development and validation to better reflect structural changes in the market and correlations across technologies.

| S-EPMC8271727 | biostudies-literature

Probabilistic Forecasts Using Expert Judgment: The Road to Recovery From COVID-19.

Project description:The COVID-19 pandemic has had a devastating effect on many industries around the world including tourism and policy makers are interested in mapping out what the recovery path will look like. We propose a novel statistical methodology for generating scenario-based probabilistic forecasts based on a large survey of 443 tourism experts and stakeholders. The scenarios map out pessimistic, most-likely and optimistic paths to recovery. Taking advantage of the natural aggregation structure of tourism data due to geographic locations and purposes of travel, we propose combining forecast reconciliation and forecast combinations implemented to historical data to generate robust COVID-free counterfactual forecasts, to contrast against. Our empirical application focuses on Australia, analyzing international arrivals and domestic flows. Both sectors have been severely affected by travel restrictions in the form of international and interstate border closures and regional lockdowns. The two sets of forecasts, allow policy makers to map out the road to recovery and also estimate the expected effect of the pandemic.

| S-EPMC9669511 | biostudies-literature

Liquisolid pellets: A pharmaceutical technology strategy to improve the dissolution rate of ritonavir.

Project description:Liquisolid pellets (LPs) prepared by extrusion-spheronization are promising delivery systems to improve the dissolution rate of poorly water-soluble drugs. However, developing LPs for high dose drugs (e.g. antiretroviral ritonavir, RTV) is a major challenge due to technical and quality constraints. In this study, formulations LP1 and LP2 were obtained (RTV 100 mg/unit dose) using microcrystalline cellulose (carrier), Kollidon® CL-SF (coating and disintegrating material) and high load (30%, w/w) of Kolliphor® EL or PEG 400 (non-volatile solvent). LP1 and LP2 had narrow size distribution, good morphological properties, and excellent flowability. The partial conversion of RTV polymorph I to the less soluble form II occurred during the preparation of the liquid medications. LP1 (containing Kolliphor® EL) achieved 82.64 ± 2.17% of drug dissolved in 30 min (Q30min), compared with 53.14 ± 0.6% and 42.42 ± 2.09% for LP2 (containing PEG 400) and Norvir® tablets, respectively. Also, LP1 promoted 1.9-fold/1.7-fold and 8.19-fold/8.29-fold increases in Q30min/DE60min (dissolution efficiency) as compared to neat RTV polymorphs I and II, respectively.

| S-EPMC6598603 | biostudies-literature

Use of temperature to improve West Nile virus forecasts.

Project description:Ecological and laboratory studies have demonstrated that temperature modulates West Nile virus (WNV) transmission dynamics and spillover infection to humans. Here we explore whether inclusion of temperature forcing in a model depicting WNV transmission improves WNV forecast accuracy relative to a baseline model depicting WNV transmission without temperature forcing. Both models are optimized using a data assimilation method and two observed data streams: mosquito infection rates and reported human WNV cases. Each coupled model-inference framework is then used to generate retrospective ensemble forecasts of WNV for 110 outbreak years from among 12 geographically diverse United States counties. The temperature-forced model improves forecast accuracy for much of the outbreak season. From the end of July until the beginning of October, a timespan during which 70% of human cases are reported, the temperature-forced model generated forecasts of the total number of human cases over the next 3 weeks, total number of human cases over the season, the week with the highest percentage of infectious mosquitoes, and the peak percentage of infectious mosquitoes that on average increased absolute forecast accuracy 5%, 10%, 12%, and 6%, respectively, over the non-temperature forced baseline model. These results indicate that use of temperature forcing improves WNV forecast accuracy and provide further evidence that temperature influences rates of WNV transmission. The findings provide a foundation for implementation of a statistically rigorous system for real-time forecast of seasonal WNV outbreaks and their use as a quantitative decision support tool for public health officials and mosquito control programs.

| S-EPMC5862506 | biostudies-literature

Sistema Expert

Project description:Study on the microbial community of a bioleaching column test

| PRJEB9810 | ENA

Assessing public forecasts to encourage accountability: The case of MIT's Technology Review.

Project description:Although high degrees of reliability have been found for many types of forecasts purportedly due to the existence of accountability, public forecasts of technology are rarely assessed and continue to have a poor reputation. This paper's analysis of forecasts made by MIT's Technology Review provides a rare assessment and thus a means to encourage accountability. It first shows that few of the predicted "breakthrough technologies" currently have large markets. Only four have sales greater than $10 billion while eight technologies not predicted by Technology Review have sales greater than $10 billion including three with greater than $100 billion and one other with greater than $50 billion. Second, possible reasons for these poor forecasts are then discussed including an over emphasis on the science-based process of technology change, sometimes called the linear model of innovation. Third, this paper describes a different model of technology change, one that is widely used by private companies and that explains the emergence of those technologies that have greater than $10 billion in sales. Fourth, technology change and forecasts are discussed in terms of cognitive biases and mental models.

| S-EPMC5552300 | biostudies-literature

Does Expert Advice Improve Educational Choice?

Project description:This paper reports evidence that an individual meeting with a study counselor at high school significantly improves the quality of choice of tertiary educational field, as self-assessed 18 months after graduation from college. To address endogeneity, we explore the variation in study counseling practices between schools as an instrumental variable (IV). Following careful scrutiny of the validity of the IV, our results indicate a significant and positive influence of study counseling on the quality of educational choice, foremost among males and those with low educated parents. The overall result is stable across a number of robustness checks.

| S-EPMC4686924 | biostudies-literature

Talent cultivation in health technology assessment: an expert survey.

Project description:BackgroundHealth technology assessment (HTA) has become essential in many countries over the past few years, and the demand for HTA professionals has increased in academia, governments, and industries. This study aimed to examine which courses are most important and which training activities are most helpful for the development of HTA proficiency as perceived by HTA experts.MethodsThe survey questionnaire was developed by literature review and expert opinion. Convenience sampling was used to survey HTA experts from the industrial sector, academic/research units, and government/independent assessment organizations using an online survey tool, SurveyCake. We collected respondents' demographic information and asked them to assess the importance of each course included in an HTA program on a 5-point Likert Scale (1 = least important; 5 = highly important). In addition, respondents were asked to assess the extent to which various activities are helpful for HTA proficiency development.ResultsA total of 158 domestic and overseas experts in HTA-related fields were invited to participate in the survey and 68 completed the questionnaire. Among the respondents, the majority were female (57.4%) and working in academia (44.1%). The mean ± standard deviation of respondents' age and number of years spent in HTA-related fields were 43.2 ± 11.0 years and 11.3 ± 9.9 years, respectively. The course that was rated the most important was "Pharmacoeconomics/Cost-effectiveness analysis" with a score of 4.8 ± 0.4 points, followed by "Health economics" at 4.7 ± 0.7 points. Moreover, internships at HTA-related institutions were perceived to be the most helpful training activity for HTA proficiency development.ConclusionsOur study findings provide a better understanding of the requirements for developing HTA proficiency and can serve as a reference for the modification of current HTA education and training programs.

| S-EPMC8903637 | biostudies-literature

Treatment strategy for insomnia disorder: Japanese expert consensus.

Project description:PurposeThere is a lack of evidence regarding answers for clinical questions about treating insomnia disorder. This study aimed to answer the following clinical questions: (1) how to use each hypnotic and non-pharmacological treatment differently depending on clinical situations and (2) how to reduce or stop benzodiazepine hypnotics using alternative pharmacological and non-pharmacological treatments.MethodsExperts were asked to evaluate treatment choices based on 10 clinical questions about insomnia disorder using a nine-point Likert scale (1 = "disagree" to 9 = "agree"). The responses of 196 experts were collected, and the answers were categorized into first-, second-, and third-line recommendations.ResultsThe primary pharmacological treatment, lemborexant (7.3 ± 2.0), was categorized as a first-line recommendation for sleep initiation insomnia, and lemborexant (7.3 ± 1.8) and suvorexant (6.8 ± 1.8) were categorized as the first-line recommendations for sleep maintenance insomnia. Regarding non-pharmacological treatments for primary treatment, sleep hygiene education was categorized as the first-line recommendation for both sleep initiation (8.4 ± 1.1) and maintenance insomnia (8.1 ± 1.5), while multicomponent cognitive behavioral therapy for insomnia was categorized as the second-line treatment for both sleep initiation (5.6 ± 2.3) and maintenance insomnia (5.7 ± 2.4). When reducing or discontinuing benzodiazepine hypnotics by switching to other medications, lemborexant (7.5 ± 1.8) and suvorexant (6.9 ± 1.9) were categorized as first-line recommendations.ConclusionExpert consensus indicates that orexin receptor antagonists and sleep hygiene education are recommended as first-line treatments in most clinical situations to treat insomnia disorder.

| S-EPMC10203548 | biostudies-literature

Parsing 20 Years of Public Data by AI Maps Trends in Proteomics and Forecasts Technology.

Project description:The trends of the last 20 years in biotechnology were revealed using artificial intelligence and natural language processing (NLP) of publicly available data. Implementing this "science-of-science" approach, we capture convergent trends in the field of proteomics in both technology development and application across the phylogenetic tree of life. With major gaps in our knowledge about protein composition, structure, and location over time, we report trends in persistent, popular approaches and emerging technologies across 94 ideas from a corpus of 29 journals in PubMed over two decades. New metrics for clusters of these ideas reveal the progression and popularity of emerging approaches like single-cell, spatial, compositional, and chemical proteomics designed to better capture protein-level chemistry and biology. This analysis of the proteomics literature with advanced analytic tools quantifies the Rate of Rise for a next generation of technologies to better define, quantify, and visualize the multiple dimensions of the proteome that will transform our ability to measure and understand proteins in the coming decade.

| S-EPMC10874502 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data