Validity of predictions in health impact assessment.
Ontology highlight
ABSTRACT: Background
An essential characteristic of health impact assessment (HIA) is that it seeks to predict the future consequences of possible decisions for health. These predictions have to be valid, but as yet it is unclear how validity should be defined in HIA.Aims
To examine the philosophical basis for predictions and the relevance of different forms of validity to HIA.Conclusions
HIA is valid if formal validity, plausibility and predictive validity are in order. Both formal validity and plausibility can usually be established, but establishing predictive validity implies outcome evaluation of HIA. This is seldom feasible owing to long time lags, migration, measurement problems, a lack of data and sensitive indicators, and the fact that predictions may influence subsequent events. Predictive validity most often is not attainable in HIA and we have to make do with formal validity and plausibility. However, in political science, this is by no means exceptional.
SUBMITTER: Veerman JL
PROVIDER: S-EPMC2652952 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundSurrogate endpoints (i.e., intermediate endpoints intended to predict for patient-centered outcomes) are increasingly common. However, little is known about how surrogate evidence is handled in the context of health technology assessment (HTA).Objectives1) To map methodologies for the validation of surrogate endpoints and 2) to determine their impact on acceptability of surrogates and coverage decisions made by HTA agencies.MethodsWe sought HTA reports where evaluation relied on a surrogate from 8 HTA agencies. We extracted data on the methods applied for surrogate validation. We assessed the level of agreement between agencies and fitted mixed-effects logistic regression models to test the impact of validation approaches on the agency's acceptability of the surrogate endpoint and their coverage recommendation.ResultsOf the 124 included reports, 61 (49%) discussed the level of evidence to support the relationship between the surrogate and the patient-centered endpoint, 27 (22%) reported a correlation coefficient/association measure, and 40 (32%) quantified the expected effect on the patient-centered outcome. Overall, the surrogate endpoint was deemed acceptable in 49 (40%) reports (k-coefficient 0.10, P = 0.004). Any consideration of the level of evidence was associated with accepting the surrogate endpoint as valid (odds ratio [OR], 4.60; 95% confidence interval [CI], 1.60-13.18, P = 0.005). However, we did not find strong evidence of an association between accepting the surrogate endpoint and agency coverage recommendation (OR, 0.71; 95% CI, 0.23-2.20; P = 0.55).ConclusionsHandling of surrogate endpoint evidence in reports varied greatly across HTA agencies, with inconsistent consideration of the level of evidence and statistical validation. Our findings call for careful reconsideration of the issue of surrogacy and the need for harmonization of practices across international HTA agencies.
| S-EPMC8108112 | biostudies-literature
Project description:Validation and reproducibility of results is a central and pressing issue in genomics. Several recent embarrassing incidents involving the irreproducibility of high-profile studies have illustrated the importance of this issue and the need for rigorous methods for the assessment of reproducibility.Here, we describe an existing statistical model that is very well suited to this problem. We explain its utility for assessing the reproducibility of validation experiments, and apply it to a genome-scale study of adenosine deaminase acting on RNA (ADAR)-mediated RNA editing in Drosophila. We also introduce a statistical method for planning validation experiments that will obtain the tightest reproducibility confidence limits, which, for a fixed total number of experiments, returns the optimal number of replicates for the study.Downloadable software and a web service for both the analysis of data from a reproducibility study and for the optimal design of these studies is provided at http://ccmbweb.ccv.brown.edu/reproducibility.html .
| S-EPMC3810853 | biostudies-other
Project description:BackgroundFollowing approximately 10 years from the beginning of Iran's national Health Technology Assessment (HTA) programme, the present study aims to evaluate its success by examining the impact of HTA and identifying the determinant factors leading to the implementation of HTA report results.MethodsThe triangulation method was employed herein. HTA reports were initially identified and their impact and determinant factors were then examined from the perspectives of both researchers (by preparing a questionnaire according to the Payback model and sending it to HTA principle investigators) and stakeholders (semi-structured interviews held with each HTA stakeholder). Simultaneously, the quality of the HTA reports was examined with relevant critical appraisal checklists.ResultsThe impact of 19 equipment technologies and four pharmaceutical technologies were assessed in this study. Twenty researchers replied (response rate, 86.96%) to the questionnaire on the impact of HTA reports from the researcher's perspective. To assess the impact of HTA reports from the stakeholder's perspective, seven policy-makers were chosen and interviewed as the main target audience. The most common step taken to disseminate the results of the HTA projects was publication. Conducting the HTA had taught researchers and their colleagues' new skills and had facilitated the securing of research grants from other organisations. Most reports had used the systematic review method but the relevant details had been scarcely presented regarding outcomes, costs and analysis. The greatest impact of HTA reports on decision-making had been on policy-makers providing and allocating finances. Barriers in stewardship, identification and prioritisation of topics, performance and dissemination of HTA results were the main barriers of implementing HTAs.ConclusionsIn most aspects, the status of HTA impact reports need improvement. Thus far, the barriers and facilitators of the HTA programme in Iran have been investigated in other studies. These findings should be pooled to reach a solution that can be actively applied to the health system to improve the status quo of HTA in Iran.
| S-EPMC5824575 | biostudies-literature
Project description:Health impact assessment has been identified internationally as a mechanism to ensure potential health impacts and health equity impacts of proposals are considered before implementation. This paper looks at the impact of three equity focused health impact assessments (EFHIAs) of health service plans on subsequent decision-making and implementation, and then utilises these findings to test and refine an existing conceptual framework for evaluating the impact and effectiveness of health impact assessments for use in relation to EFHIAs.Case study analysis of three EFHIAs conducted on health sector plans in New South Wales, Australia. Data was drawn from 14 semi-structured interviews and the analysis of seven related documents (draft plans and EFHIA reports).The case studies showed that the EFHIAs all had some impact on the decision-making about the plans and their implementation, most clearly in relation to participants' understandings of equity and in the development of options for modifying service plans to ensure this was addressed. The timing of the EFHIA and individual responses to the EFHIA process and its recommendations were identified as critical factors influencing the impact of the EFHIAs. Several modifications to the conceptual framework are identified, principally adding factors to recognise the role individuals play in influencing the impact and effectiveness of EFHIAs.EFHIA has the potential to improve the consideration of health equity in health service planning processes, though a number of contextual and individual factors affect this. Current approaches can be strengthened by taking into account personal and organisational responses to the EFHIA process.
| S-EPMC4161889 | biostudies-other
Project description:Health Impact Assessment (HIA) courses are teaching public health and urban planning students how to assess the likely health effects of proposed policies, plans, and projects. We suggest that public health and urban planning have complimentary frameworks for training practitioners to address the living conditions that affect health. Planning perspectives emphasize practical skills for impacting community change, while public health stresses professional purpose and ethics. Frameworks from both disciplines can enhance the HIA learning experience by helping students tackle questions related to community impact, engagement, social justice, and ethics. We also propose that HIA community engagement processes can be enriched through an empathetic practice that focuses on greater personal introspection.
| S-EPMC5551182 | biostudies-other
Project description:Models are useful to inform policy decisions on typhoid conjugate vaccine (TCV) deployment in endemic settings. However, methodological choices can influence model-predicted outcomes. To provide robust estimates for the potential public health impact of TCVs that account for structural model differences, we compared four dynamic and one static mathematical model of typhoid transmission and vaccine impact. All models were fitted to a common dataset of age-specific typhoid fever cases in Kolkata, India. We evaluated three TCV strategies: no vaccination, routine vaccination at 9 months of age, and routine vaccination at 9 months with a one-time catch-up campaign (ages 9 months to 15 years). The primary outcome was the predicted percent reduction in symptomatic typhoid cases over 10 years after vaccine introduction. For three models with economic analyses (Models A-C), we also compared the incremental cost-effectiveness ratios (ICERs), calculated as the incremental cost (US$) per disability-adjusted life-year (DALY) averted. Routine vaccination was predicted to reduce symptomatic cases by 10-46 % over a 10-year time horizon under an optimistic scenario (95 % initial vaccine efficacy and 19-year mean duration of protection), and by 2-16 % under a pessimistic scenario (82 % initial efficacy and 6-year mean protection). Adding a catch-up campaign predicted a reduction in incidence of 36-90 % and 6-35 % in the optimistic and pessimistic scenarios, respectively. Vaccine impact was predicted to decrease as the relative contribution of chronic carriers to transmission increased. Models A-C all predicted routine vaccination with or without a catch-up campaign to be cost-effective compared to no vaccination, with ICERs varying from $95-789 per DALY averted; two models predicted the ICER of routine vaccination alone to be greater than with the addition of catch-up campaign. Despite differences in model-predicted vaccine impact and cost-effectiveness, routine vaccination plus a catch-up campaign is likely to be impactful and cost-effective in high incidence settings such as Kolkata.
| S-EPMC9880559 | biostudies-literature
Project description:In CASP10, for the first time, contact-assisted structure predictions have been assessed. Sets of pairs of contacting residues from target structures were provided to predictors for a second round of prediction after the initial round in which they were given only sequences. The objective of the experiment was to measure model quality improvement resulting from the added contact information and thereby assess and help develop so-called hybrid prediction methods--methods where some experimentally determined distance constraints are used to augment de novo computational prediction methods. The results of the experiment were, overall, quite promising.
| S-EPMC6961783 | biostudies-literature
Project description:Comprehensive analysis of remote sensing data used to select the Interior Exploration using Seismic Investigations, Geodesy and Heat Transport (InSight) landing site correctly predicted the atmospheric temperature and pressure profile during entry and descent, the safe landing surface, and the geologic setting of the site. The smooth plains upon which the InSight landing site is located were accurately predicted to be generally similar to the Mars Exploration Rover Spirit landing site with relatively low rock abundance, low slopes, and a moderately dusty surface with a 3-10 m impact fragmented regolith over Hesperian to Early Amazonian basaltic lava flows. The deceleration profile and surface pressure encountered by the spacecraft during entry, descent, and landing compared well (within 1σ) of the envelope of modeled temperature profiles and the expected surface pressure. Orbital estimates of thermal inertia are similar to surface radiometer measurements, and materials at the surface are dominated by poorly consolidated sand as expected. Thin coatings of bright atmospheric dust on the surface were as indicated by orbital albedo and dust cover index measurements. Orbital estimates of rock abundance from shadow measurements in high-resolution images and thermal differencing indicated very low rock abundance and surface counts show 1-4% area covered by rocks. Slopes at 100 to 5 m length scale measured from orbital topographic and radar data correctly indicated a surface comparably smooth and flat as the two smoothest landing sites (Opportunity and Phoenix). Thermal inertia and radar data indicated the surface would be load bearing as found.
| S-EPMC7507760 | biostudies-literature
Project description:In CASP14, 39 research groups submitted more than 2500 3D models on 22 protein complexes. In general, the community performed well in predicting the fold of the assemblies (for 80% of the targets), although it faced significant challenges in reproducing the native contacts. This is especially the case for the complexes without whole-assembly templates. The leading predictor, BAKER-experimental, used a methodology combining classical techniques (template-based modeling, protein docking) with deep learning-based contact predictions and a fold-and-dock approach. The Venclovas team achieved the runner-up position with template-based modeling and docking. By analyzing the target interfaces, we showed that the complexes with depleted charged contacts or dominating hydrophobic interactions were the most challenging ones to predict. We also demonstrated that if AlphaFold2 predictions were at hand, the interface prediction challenge could be alleviated for most of the targets. All in all, it is evident that new approaches are needed for the accurate prediction of assemblies, which undoubtedly will expand on the significant improvements in the tertiary structure prediction field.
| S-EPMC9109697 | biostudies-literature