Improving the plausibility of success with inefficient metrics.
Ontology highlight
ABSTRACT:
SUBMITTER: Shultz MD
PROVIDER: S-EPMC4027587 | biostudies-other | 2014 Jan
REPOSITORIES: biostudies-other
Similar Datasets
Project description:To overcome the frequently debated crisis of confidence, replicating studies is becoming increasingly more common. Multiple frequentist and Bayesian measures have been proposed to evaluate whether a replication is successful, but little is known about which method best captures replication success. This study is one of the first attempts to compare a number of quantitative measures of replication success with respect to their ability to draw the correct inference when the underlying truth is known, while taking publication bias into account. Our results show that Bayesian metrics seem to slightly outperform frequentist metrics across the board. Generally, meta-analytic approaches seem to slightly outperform metrics that evaluate single studies, except in the scenario of extreme publication bias, where this pattern reverses.
| S-EPMC8131945 | biostudies-literature
Project description:Objective: The Patient Health Questionnaire-9 (PHQ-9) is commonly used to assess depression symptoms, but its associated treatment success criteria (i.e., metrics) are inconsistently defined. The authors aimed to analyze the impact of metric choice on outcomes and discuss implications for clinical practice and research. Methods: Analyses included three overlapping and nonexclusive time cohorts of adult patients with depression treated in 33 organizations between 2008 and 2018. Average depression improvement rates were calculated according to eight metrics. Organization-level rank orders defined by these metrics were calculated and correlated. Results: The 12-month cohort had higher rates of metrics indicating treatment success than did the 3- and 6-month cohorts; the degree of improvement varied by metric, although all organization-level rank orders were highly correlated. Conclusions: Different PHQ-9 treatment metrics are associated with disparate improvement rates. Organization-level rankings defined by different metrics are highly correlated. Consistency of metric use may be more important than specific metric choice.
| S-EPMC8249313 | biostudies-literature
Project description:Our study was undertaken to better understand how to increase the success rates of recovery plantings of a rare hemiparasite, golden paintbrush (Castilleja levisecta-Orobanchaceae). This species is endemic to western Washington and Oregon, USA, and southwestern British Columbia, Canada. Over 5000 golden paintbrush plants were outplanted as plugs in 2007 at six different native prairie sites that were considered to be suitable habitat, based on general evaluations of vegetation and soil conditions. Outplantings were installed at regular intervals along transects up to 1 km long to include a range of conditions occurring at each site. All plantings were re-examined five years later. The patchy distribution of surviving plugs and new recruits within each reintroduction site suggested success is strongly influenced by microsite characteristics. Indicator species analysis of taxa growing in microsites around outplanted golden paintbrush identified species that were positively or negatively associated with paintbrush survival. Species such as Festuca roemeri, Eriophyllum lanatum, and Viola adunca were strong indicators at some sites; non-natives such as Hypochaeris radicata and Teesdalia nudicaulis tended to be frequent negative indicators. Overall, higher richness of native perennial forbs was strongly correlated with both survival and flowering of golden paintbrush, a pattern that may reflect interactions of this hemiparasite with the immediately surrounding plant community. Topographic position also influenced outcomes, with greater survival occurring on mounds and in swales, where soils generally were deeper. Our findings suggest that assessments of site suitability based on vegetation alone, and coarser, site-level assessments that do not characterize heterogeneity at the microsite scale, may not be strong predictors of restoration success over the longer term and in sites with variability in vegetation and soils. By identifying suitable microsites to focus rare species plantings, survival and efficiency may be significantly enhanced.
| S-EPMC4773064 | biostudies-literature
Project description:Since the introduction of the Atraumatic Restorative Treatment (ART) approach over twenty years ago, more than 190 research publications have appeared. The last research agenda defining research priorities for ART was published in 1999. The objective of the present work was to review existing research in the context of future research priorities for ART.An internet survey was conducted amongst those who had published on ART or were known to be working on the ART approach, to solicit their views as to areas of future ART research. Three broad categories were defined, namely: 1. Basic and laboratory research; 2. Clinical research, and, 3. Community, Public Health, Health Services Research.A 31% response rate was achieved. The study identified a number of new areas of research as well as areas where additional research is required. These are expressed as recommendations for future ART research.The ART approach is based on a robust, reliable and ever-growing evidence base concerning its clinical applications which indicates that it is a reliable and quality treatment approach. In common with all other oral health care procedures, targeted applied research is required to improve the oral health care offered.
| S-EPMC5467363 | biostudies-other
Project description:1. Multiplex PCR is a valuable tool in many biological studies but it is a multifaceted procedure that has to be planned and optimised thoroughly to achieve robust and meaningful results. In particular, primer concentrations have to be adjusted to assure an even amplification of all targeted DNA fragments. Until now, total DNA extracts were used for balancing primer efficiencies; however, the applicability for comparisons between taxa or different multiple-copy genes was limited owing to the unknown number of template molecules present per total DNA. 2. Based on a multiplex system developed to track trophic interactions in high Alpine arthropods, we demonstrate a fast and easy way of generating standardised DNA templates. These were then used to balance the amplification success for the different targets and to subsequently determine the sensitivity of each primer pair in the multiplex PCR. 3. In the current multiplex assay, this approach led to an even amplification success for all seven targeted DNA fragments. Using this balanced multiplex PCR, methodological bias owing to variation in primer efficiency will be avoided when analysing field-derived samples. 4. The approach outlined here allows comparing multiplex PCR sensitivity, independent of the investigated species, genome size or the targeted genes. The application of standardised DNA templates not only makes it possible to optimise primer efficiency within a given multiplex PCR, but it also offers to adjust and/or to compare the sensitivity between different assays. Along with other factors that influence the success of multiplex reactions, and which we discuss here in relation to the presented detection system, the adoption of this approach will allow for direct comparison of multiplex PCR data between systems and studies, enhancing the utility of this assay type.
| S-EPMC3573865 | biostudies-literature
Project description:BackgroundSkin abscesses are a common emergency presentation often requiring incision and drainage; however, issues with theatre access lead to delays in management and high costs. The long-term impact in a tertiary centre of a standardised day-only protocol is unknown. The aim was to evaluate the impact of day-only skin abscess protocol (DOSAP) for emergency surgery of skin abscesses in a tertiary institution in Australia and to provide a blueprint for other institutions.MethodsA retrospective cohort study analysed several time periods: Period A (July 2014 to 2015, n = 201) pre-DOSAP implementation, Period B (July 2016 to 2017, n = 259) post-DOSAP, and Period C (July 2018 to 2022, n = 1,625) prospectively analysed four 12-month periods to assess long-term utilisation of DOSAP. Primary outcomes were length of stay and delay to theatre. Secondary outcome measures included theatre start time, representation rates and total costs. Statistical analysis using nonparametric methods was used to analyse the data.ResultsThere was a significant decrease in ward length of stay (1.25 days vs. 0.65 days, P < 0.0001), delay to theatre (0.81 days vs. 0.44 days, P < 0.0001) and theatre start time before 10AM (44 cases vs. 96 cases, P < 0.0001) after implementation of DOSAP. There was a significant decrease in median cost of admission of $711.74 after accounting for inflation. Period C reported 1,006 abscess presentations successfully managed by DOSAP over the four-year period.ConclusionOur study demonstrates the successful implementation of DOSAP in an Australian tertiary centre. The ongoing utilisation of the protocol demonstrates the ease of applicability.
| S-EPMC9946283 | biostudies-literature
Project description:Lack of efficacy in the intended disease indication is the major cause of clinical phase drug development failure. Explanations could include the poor external validity of pre-clinical (cell, tissue, and animal) models of human disease and the high false discovery rate (FDR) in preclinical science. FDR is related to the proportion of true relationships available for discovery (γ), and the type 1 (false-positive) and type 2 (false negative) error rates of the experiments designed to uncover them. We estimated the FDR in preclinical science, its effect on drug development success rates, and improvements expected from use of human genomics rather than preclinical studies as the primary source of evidence for drug target identification. Calculations were based on a sample space defined by all human diseases - the 'disease-ome' - represented as columns; and all protein coding genes - 'the protein-coding genome'- represented as rows, producing a matrix of unique gene- (or protein-) disease pairings. We parameterised the space based on 10,000 diseases, 20,000 protein-coding genes, 100 causal genes per disease and 4000 genes encoding druggable targets, examining the effect of varying the parameters and a range of underlying assumptions, on the inferences drawn. We estimated γ, defined mathematical relationships between preclinical FDR and drug development success rates, and estimated improvements in success rates based on human genomics (rather than orthodox preclinical studies). Around one in every 200 protein-disease pairings was estimated to be causal (γ = 0.005) giving an FDR in preclinical research of 92.6%, which likely makes a major contribution to the reported drug development failure rate of 96%. Observed success rate was only slightly greater than expected for a random pick from the sample space. Values for γ back-calculated from reported preclinical and clinical drug development success rates were also close to the a priori estimates. Substituting genome wide (or druggable genome wide) association studies for preclinical studies as the major information source for drug target identification was estimated to reverse the probability of late stage failure because of the more stringent type 1 error rate employed and the ability to interrogate every potential druggable target in the same experiment. Genetic studies conducted at much larger scale, with greater resolution of disease end-points, e.g. by connecting genomics and electronic health record data within healthcare systems has the potential to produce radical improvement in drug development success rate.
| S-EPMC6906499 | biostudies-literature
Project description:BackgroundAdolescent and young adult (AYA) childhood cancer survivors (CCS) should be empowered to continue their survivor-focused care as they transition into adult medicine. However, the majority of AYA-aged survivors become lost to follow up around the age of typical transition to adulthood. The purpose of this study was to identify, from the patient's perspective, key factors that facilitate successful transitions to adult-centered survivorship care.MethodsA qualitative study was conducted with AYA CCS (n = 29) from the survivorship clinic of a single institution as key informants. Data were collected through a series of structured phone interviews and subjected to thematic content analysis.ResultsFour major themes with multiple subthemes were identified: (1) transition practices need to be flexible and individually tailored; (2) effective communication is critical to a successful transition; (3) continuity in providers is needed during the transition; and (4) comprehensive care means care that also addresses psycho-social well-being.ConclusionsFrom the perspective of AYA CCS, the ideal model of transitional survivorship care could include a patient navigator who promotes provider flexibility, consistent communication, and pro-active comprehensive care that encompasses both medical and psycho-social well-being. Models of care for CCS should be built to provide, or seamlessly facilitate, continuous survivor-focused care across the age continuum. A longitudinal relationship with a survivor-focused provider can help promote the values that CCS' report as important in transitioning care from pediatric- to adult-centered care.
| S-EPMC7507711 | biostudies-literature
Project description:Long-term survival in childhood cancer is excellent. Most survivors will have a therapy-related chronic condition, yet very few receive survivor-focused care as they transition from adolescence to young adulthood. The purpose of this study is to identify indicators of success in current transitional care practices for young adult survivors of childhood cancer as defined by all members of survivorship care teams. An exploratory, phenomenologic qualitative study was conducted with key informants from medical teams involved in transitional care of childhood cancer survivors. Data were collected through phone interviews with providers from both pediatric and adult care settings. A multidisciplinary study sample of 29 participants from three institutions identified two major themes with multiple subthemes. The first major theme was that providers must be good communicators, and it emphasized the importance of having good relationships throughout the transition of care to optimize effective communication. The second major theme was that models of care must include well-established partners throughout the healthcare system that promote accessible subspecialty care with streamlined referrals and patient navigation services. From the perspective of experienced pediatric- and adult-centered providers at three different institutions delivering life-long transitional care for childhood cancer survivors, the optimal model of care must be built around facilitating communication among all key stakeholders and emphasizing patient-friendly services that minimize patient stressors.
| S-EPMC7514882 | biostudies-literature
Project description:I plan to investigate the value of video-based feedback in endoscopic training - specifically, the role of terminal video feedback as compared to usual concurrent feedback on cold snare polypectomy technique in trainees, using Direct Observation of Polypectomy Skills (DOPyS) competency score. I have focused the study on the competency of cold snare polypectomy for subcentimeter polyps. The majority (>75%) of colon polyps are smaller than one centimeter. Cold snare polypectomy has been shown, and recommended by the American Society for Gastrointestinal Endoscopy (ASGE), to be an effective removal technique. However, its widespread use and moreover, its teaching to trainees is lacking. It takes time and resources to learn and teach endoscopic techniques. Our study will hope to identify a mechanism through video-based feedback that could help to improve the translation of the training of polypectomy skills to its actual performance, and to accelerate the learning curve.
| 2241449 | ecrin-mdr-crc