Datasets of skills-rating questionnaires for advanced service design through expert knowledge elicitation
Ontology highlight
ABSTRACT:
SUBMITTER: Nguyen H
PROVIDER: S-EPMC9203804 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Precision medicine requires the ability to predict the efficacies of different treatments for a given individual using high-dimensional genomic measurements. However, identifying predictive features remains a challenge when the sample size is small. Incorporating expert knowledge offers a promising approach to improve predictions, but collecting such knowledge is laborious if the number of candidate features is very large.We introduce a probabilistic framework to incorporate expert feedback about the impact of genomic measurements on the outcome of interest and present a novel approach to collect the feedback efficiently, based on Bayesian experimental design. The new approach outperformed other recent alternatives in two medical applications: prediction of metabolic traits and prediction of sensitivity of cancer cells to different drugs, both using genomic features as predictors. Furthermore, the intelligent approach to collect feedback reduced the workload of the expert to approximately 11%, compared to a baseline approach.Source code implementing the introduced computational methods is freely available at https://github.com/AaltoPML/knowledge-elicitation-for-precision-medicine.Supplementary data are available at Bioinformatics online.
| S-EPMC6022689 | biostudies-other
Project description:Introduction:Many electronic health records fail to support information uptake because they impose low-level information organization tasks on users. Clinical concept-oriented views have shown information processing improvements, but the specifics of this organization for critical care are unclear. Objective:To determine high-level cognitive processes and patient information organization schema in critical care. Methods:We conducted an open card sort of 29 patient data elements and a modified Delphi card sort of 65 patient data elements. Study participants were 39 clinicians with varied critical care training and experience. We analyzed the open sort with a hierarchical cluster analysis (HCA) and factor analysis (FA). The Delphi sort was split into three initiating groups that resulted in three unique solutions. We compared results between open sort analyses (HCA and FA), between card sorting exercises (open and Delphi), and across the Delphi solutions. Results:Between the HCA and FA, we observed common constructs including cardiovascular and hemodynamics, infectious disease, medications, neurology, patient overview, respiratory, and vital signs. The more comprehensive Delphi sort solutions also included gastrointestinal, renal, and imaging constructs. Conclusions:We identified primarily system-based groupings (e.g., cardiovascular, respiratory). Source-based (e.g., medications, laboratory) groups became apparent when participants were asked to sort a longer list of concepts. These results suggest a hybrid approach to information organization, which may combine systems, source, or problem-based groupings, best supports clinicians' mental models. These results can contribute to the design of information displays to better support clinicians' access and interpretation of information for critical care decisions.
| S-EPMC6077790 | biostudies-literature
Project description:Infection with the Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) induces the coronavirus infectious disease 19 (COVID-19). Its pandemic form in human population and its probable animal origin, along with recent case reports in pets, make drivers of emergence crucial in domestic carnivore pets, especially cats, dogs and ferrets. Few data are available in these species; we first listed forty-six possible drivers of emergence of COVID-19 in pets, regrouped in eight domains (i.e. pathogen/disease characteristics, spatial-temporal distance of outbreaks, ability to monitor, disease treatment and control, characteristics of pets, changes in climate conditions, wildlife interface, human activity, and economic and trade activities). Secondly, we developed a scoring system per driver, then elicited scientific experts (N = 33) to: (a) allocate a score to each driver, (b) weight the drivers scores within each domain and (c) weight the different domains between them. Thirdly, an overall weighted score per driver was calculated; drivers were ranked in decreasing order. Fourthly, a regression tree analysis was used to group drivers with comparable likelihood to play a role in the emergence of COVID-19 in pets. Finally, the robustness of the expert elicitation was verified. Five drivers were ranked with the highest probability to play a key role in the emergence of COVID-19 in pets: availability and quality of diagnostic tools, human density close to pets, ability of preventive/control measures to avoid the disease introduction or spread in a country (except treatment, vaccination and reservoir(s) control), current species specificity of the disease-causing agent and current knowledge on the pathogen. As scientific knowledge on the topic is scarce and still uncertain, expert elicitation of knowledge, in addition with clustering and sensitivity analyses, is of prime importance to prioritize future studies, starting from the top five drivers. The present methodology is applicable to other emerging pet diseases.
| S-EPMC7405184 | biostudies-literature
Project description:BackgroundThe FP6 EU HENVINET project aimed at synthesizing the scientific information available on a number of topics of high relevance to policy makers in environment and health. The goal of the current paper is to reflect on the methodology that was used in the project, in view of exploring the usefulness of this and similar methodologies to the policy process. The topics investigated included health impacts of the brominated flame retardants decabrominated diphenylether (decaBDE) and hexabromocyclododecane (HBCD), phthalates highlighting di(2-ethylhexyl)phthalate (DEHP), the pesticide chlorpyrifos (CPF), nanoparticles, the impacts of climate change on asthma and other respiratory disorders, and the influence of environment health stressors on cancer induction.MethodsInitially the focus was on identifying knowledge gaps in the state of the art in scientific knowledge. Literature reviews covered all elements that compose the causal chain of the different environmental health issues from emissions to exposures, to effects and to health impacts. Through expert elicitation, knowledge gaps were highlighted by assessing expert confidence using calibrated confidence scales. During this work a complementary focus to that on knowledge gaps was developed through interdisciplinary reflections. By extending the scope of the endeavour from only a scientific perspective, to also include the more problem solving oriented policy perspective, the question of which kind of policy action experts consider justifiable was addressed. This was addressed by means of a questionnaire. In an expert workshop the results of both questionnaires were discussed as a basis for policy briefs.ResultsThe expert elicitation, the application of the calibrated confidence levels and the problem solving approach were all experienced as being quite challenging for the experts involved, as these approaches did not easily relate to mainstream environment and health scientific practices. Even so, most experts were quite positive about it. In particular, the opportunity to widen one's own horizon and to interactively exchange knowledge and debate with a diversity of experts seemed to be well appreciated in this approach. Different parts of the approach also helped in focussing on specific relevant aspects of scientific knowledge, and as such can be considered of reflective value.ConclusionsThe approach developed by HENVINET was part of a practice of learning by doing and of interdisciplinary cooperation and negotiation. Ambitions were challenged by unforeseen complexities and difference of opinion and as no Holy Grail approach was at hand to copy or follow, it was quite an interesting but also complicated endeavour. Perfection, if this could be defined, seemed out of reach all the time. Nevertheless, many involved were quite positive about it. It seems that many felt that it fitted some important needs in current science when addressing the needs of policy making on such important issues, without anyone really having a clue on how to actually do this. Challenging questions remain on the quality of such approach and its product. Practice tells us that there probably is no best method and that the best we can do is dependent on contextual negotiation and learning from experiences that we think are relevant.
| S-EPMC3388440 | biostudies-literature
Project description:IntroductionAn estimated 2-4% of Western populations are thought to have psoriasis, with a regional incidence ranging from 0.09% to 11.43%. Variance in estimates is a result of differences in study populations, methodology, regional differences, and definitions of disease. Reliable prevalence estimates of plaque psoriasis are challenging to establish. Further, the distribution of psoriasis severity in the population is unknown. This study aims to establish the utility of expert elicitation (EE) as a method for estimating unknown parameters in dermatology by (1) estimating the prevalence of psoriasis in the adult population, and (2) estimating previously unknown disease severity distribution.MethodsAn expert panel of 11 Canadian dermatologists with demonstrated expertise in psoriasis was formed. A proof-of-concept EE exercise estimated psoriasis prevalence in the general population in Canada, followed by estimation of psoriasis disease severity distribution by body surface area (BSA). Expert estimates were consolidated using Bayesian methods to statistically model the data and represent uncertainty.ResultsThe median prevalence of psoriasis in the adult population using the Bayesian estimate was 3.0% (95% credibility interval, 2.7-3.3%), compared with the estimated mean prevalence of 3.4% (95% confidence interval, 2.2-4.9%). By EE, the estimated cumulative distribution of disease severity assessed by BSA suggests that approximately 50% of patients have a BSA of < 3% and 78% of patients have a BSA of < 10%, with only 2% having a BSA of > 50%.ConclusionThe EE approach resulted in prevalence estimates that had a narrow distribution and were consistent with published literature, supporting its value in dermatology as a complementary method to help guide decision-making in areas where evidence is scarce or uncertain.
| S-EPMC8163919 | biostudies-literature
Project description:This SuperSeries is composed of the SubSeries listed below.
2016-11-08 | GSE73638 | GEO
Project description:The purpose of the current study was to apply and evaluate a procedure to elicit expert judgments about correlations, and to update this information with empirical data. The result is a face-to-face group elicitation procedure with as its central element a trial roulette question that elicits experts' judgments expressed as distributions. During the elicitation procedure, a concordance probability question was used to provide feedback to the experts on their judgments. We evaluated the elicitation procedure in terms of validity and reliability by means of an application with a small sample of experts. Validity means that the elicited distributions accurately represent the experts' judgments. Reliability concerns the consistency of the elicited judgments over time. Four behavioral scientists provided their judgments with respect to the correlation between cognitive potential and academic performance for two separate populations enrolled at a specific school in the Netherlands that provides special education to youth with severe behavioral problems: youth with autism spectrum disorder (ASD), and youth with diagnoses other than ASD. Measures of face-validity, feasibility, convergent validity, coherence, and intra-rater reliability showed promising results. Furthermore, the current study illustrates the use of the elicitation procedure and elicited distributions in a social science application. The elicited distributions were used as a prior for the correlation, and updated with data for both populations collected at the school of interest. The current study shows that the newly developed elicitation procedure combining the trial roulette method with the elicitation of correlations is a promising tool, and that the results of the procedure are useful as prior information in a Bayesian analysis.
| S-EPMC5282462 | biostudies-literature
Project description:BackgroundThe evidence used to inform health care decision making (HCDM) is typically uncertain. In these situations, the experience of experts is essential to help decision makers reach a decision. Structured expert elicitation (referred to as elicitation) is a quantitative process to capture experts' beliefs. There is heterogeneity in the existing elicitation methodology used in HCDM, and it is not clear if existing guidelines are appropriate for use in this context. In this article, we seek to establish reference case methods for elicitation to inform HCDM.MethodsWe collated the methods available for elicitation using reviews and critique. In addition, we conducted controlled experiments to test the accuracy of alternative methods. We determined the suitability of the methods choices for use in HCDM according to a predefined set of principles for elicitation in HCDM, which we have also generated. We determined reference case methods for elicitation in HCDM for health technology assessment (HTA).ResultsIn almost all methods choices available for elicitation, we found a lack of empirical evidence supporting recommendations. Despite this, it is possible to define reference case methods for HTA. The reference methods include a focus on gathering experts with substantive knowledge of the quantities being elicited as opposed to those trained in probability and statistics, eliciting quantities that the expert might observe directly, and individual elicitation of beliefs, rather than solely consensus methods. It is likely that there are additional considerations for decision makers in health care outside of HTA.ConclusionsThe reference case developed here allows the use of different methods, depending on the decision-making setting. Further applied examples of elicitation methods would be useful. Experimental evidence comparing methods should be generated.
| S-EPMC8777312 | biostudies-literature
Project description:How to design experiments that accelerate knowledge discovery on complex biological landscapes remains a tantalizing question. Here, we present OPEX, an optimal experimental design method to identify informative omics experiments for both experimental space exploration and model training. OPEX-guided exploration of Escherichia coli's cross-behavior potential, when exposed to novel biocide and antibiotic combinations, led to accelerated knowledge discovery with predictive models that are more accurate while needing 44% fewer data to train. Selecting experiments favoring broader exploration followed by fine-tuning emerged as the optimal strategy. This led to the discovery of 29 cross-protection and 4 cross-vulnerability conditions, with further validation revealing the central role of chaperones, stress response proteins and transport pumps in cross-stress exposure. This work demonstrates how active learning can be used to automate omics data collection for training accurate predictive models, evidence-driven decision making and accelerated knowledge discovery in life sciences.
2020-07-09 | GSE144604 | GEO
Project description:An expert-pathologist-reviewed epithelial ovarian cancer reference library (n = 50) used to assign the histopathology of epithelial ovarian cell lines using compositional statistics and random gene-sets
2016-11-08 | GSE73551 | GEO