Dataset Information

How can we evaluate the potential of innovative vaccine products and technologies in resource constrained settings? A total systems effectiveness (TSE) approach to decision-making.

ABSTRACT: Innovations in vaccine product attributes could play an important role in addressing coverage and equity (C&E) gaps, but there is currently a poor understanding of the full system impact and trade-offs associated with investing in such technologies, both from the perspective of national immunisation programmes (NIPs) and vaccine developers. Total Systems Effectiveness (TSE) was developed as an approach to evaluate vaccines with different product attributes from a systems perspective, in order to analyse and compare the value of innovative vaccine products in different settings. The TSE approach has been advanced over the years by various stakeholders including the Bill and Melinda Gates Foundation (BMGF), Gavi, PATH, UNICEF and WHO. WHO further developed the TSE approach to incorporate the country perspective into immunisation decision-making, in order for countries to evaluate innovative products for introduction and product switch decisions, and for vaccine development stakeholders to conduct their assessments of product value in line with country preferences. This paper describes the original TSE approach, development of the tool and processes for NIPs to apply the WHO TSE approach, and results from piloting in 12 countries across Africa, Asia and the Americas. The WHO TSE framework emerged from this piloting effort. The WHO TSE approach has been welcomed by NIP and vaccine development stakeholders as a useful tool to evaluate trade-offs between different products. It was emphasised that the concept of "total systems effectiveness" is likely to be context-specific and that TSE is valuable in facilitating a deliberative process to articulate NIP priorities, for decisions around product choice, and for prioritising the development of future vaccine innovations.

SUBMITTER: Botwright S

PROVIDER: S-EPMC7644745 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

How can we evaluate the potential of innovative vaccine products and technologies in resource constrained settings? A total systems effectiveness (TSE) approach to decision-making.

Botwright Siobhan S Kahn Anna-Lea AL Hutubessy Raymond R Lydon Patrick P Biey Joseph J Karim Sidibe Abdoul A Diarra Ibrahima I Nadjib Mardiati M Suwantika Auliya A AA Setiawan Ery E Archer Rachel R Kristensen Debra D Menozzi-Arnaud Marion M Mpia Bwaka Ado A Mwenda Jason M JM Giersing Birgitte K BK

Vaccine: X 20201006

Innovations in vaccine product attributes could play an important role in addressing coverage and equity (C&E) gaps, but there is currently a poor understanding of the full system impact and trade-offs associated with investing in such technologies, both from the perspective of national immunisation programmes (NIPs) and vaccine developers. Total Systems Effectiveness (TSE) was developed as an approach to evaluate vaccines with different product attributes from a systems perspective, in order to ...[more]

PMID: 33196036

Similar Datasets

Project description:There is no decision-making framework in the early-adoption stage of novel surgical technologies, putting the quality of health care and resource allocation of the health care system at risk. To investigate relevant weighted criteria that decision-makers may use to make an informed decision for the early adoption of innovative surgical technologies. This multi-institutional decision analytical modeling study used a mixed-methods multicriteria decision analysis (MCDA) and had 2 phases. First, a panel of 12 experts validated decision criteria in the literature and identified additional criteria. Second, 33 Canadian experts prioritized the main criteria (domains) using the composition pairwise-comparison weight-elicitation method (analytical hierarchy process model) and ranked their subcriteria using the direct-ranking elicitation method (Likert scale). Data were analyzed, and response consistency was estimated using the consistency ratio. Analysis of variance was used to assess for significant differences between expert responses. The MCDA was conducted at McGill University between 2021 and 2023. Data were collected nationally by inviting experts in Canada. Criteria domain weights and subcriteria rankings. Priority vectors, which are priority scores analyzed and prioritized from expert responses, were used to rank criteria domains and subcriteria for decision-making on adopting new innovative surgical technologies. A total of 45 experts (33 male [73.3%] and 12 female [26.7%]) were invited with different levels of education (22 experts with MD or equivalent, 13 experts with master's degree, and 12 experts with PhD degree) and years of experience (4 experts with <10, 12 experts with 11-20, 18 experts with 21-30, and 11 experts with >30 years). Surgeon experts (23 individuals) were from all surgical disciplines, and nonsurgeon experts (22 individuals) were administrative officers in surgical device procurement, health technology assessment experts, and hospital directors. A total of 7 domains and 44 subcriteria were identified. The MCDA model found that clinical outcomes had the highest priority vector, at 0.429, followed by patients and public relevance (0.135). Hospital-specific criteria (priority vector, 0.099), technology-specific criteria (priority vector, 0.092), and physician-specific criteria (priority vector, 0.087) were the next most highly ranked. The lowest priority vectors were for economic criteria, at 0.083, and finally policies and procedures, at 0.075. There was consensus in the responses (consistency ratio = 0.006), and there were no statistically significant differences between expert responses. This study weighted priority criteria domains in importance and established ranked subcriteria for decision-making of early adoption of surgical technologies. Putting these criteria into a framework may help surgeons and decision-makers make informed decisions for the early adoption of new surgical technologies.

Project description:Innovative game-based training methods that leverage the ubiquity of cellphones and familiarity with phone-based interfaces have the potential to transform the training of public health practitioners in low-income countries such as Liberia. This article describes the design, development, and testing of a prototype of the Figure It Out mobile game. The prototype game uses a disease outbreak scenario to promote evidence-based decision-making in determining the causative agent and prescribing intervention measures to minimize epidemiological and logistical burdens in resource-limited settings. An initial prototype of the game developed by the US team was playtested and evaluated by focus groups with 20 University of Liberia Masters of Public Health (UL MPH) students. Results demonstrate that the learning objectives-improving search skills for identifying scientific evidence and considering evidence before decision-making during a public health emergency-were considered relevant and important in a setting that has repeatedly and recently experienced severe threats to public health. However, some of the game mechanics that were thought to enhance engagement such as trial-and-error and choose-your-own-path gameplay, were perceived by the target audience as distracting or too time-consuming, particularly in the context of a realistic emergency scenario. Gameplay metrics that mimicked real-world situations around lives lost, money spent, and time constraints during public health outbreaks were identified as relatable and necessary considerations. Our findings reflect cultural differences between the game development team and end users that have emphasized the need for end users to have an integral part of the design team; this formative evaluation has critically informed next steps in the iterative development process. Our multidisciplinary, cross-cultural and cross-national design team will be guided by Liberia-based public health students and faculty, as well as community members who represent our end user population in terms of experience and needs. These stakeholders will make key decisions regarding game objectives and mechanics, to be vetted and implemented by game design experts, epidemiologists, and software developers.

Project description:IntroductionSexually transmitted infections (STIs) remain prevalent and are increasing in several populations. Appropriate STI diagnosis is crucial to prevent the transmission and sequelae of untreated infection. We reviewed the diagnostic accuracy of syndromic case management and existing point-of-care tests (POCTs), including those in the pipeline, to diagnose STIs in resource-constrained settings.MethodsWe prioritized updating the systematic review and meta-analysis of the diagnostic accuracy of vaginal discharge from 2001 to 2015 to include studies until 2018. We calculated the absolute effects of different vaginal flowcharts and the diagnostic performance of POCTs on important outcomes. We searched the peer-reviewed literature for previously conducted systematic reviews and articles from 1990 to 2018 on the diagnostic accuracy of syndromic management of vaginal and urethral discharge, genital ulcer and anorectal infections. We conducted literature reviews from 2000 to 2018 on the existing POCTs and those in the pipeline.Results and discussionsThe diagnostic accuracy of urethral discharge and genital ulcer disease syndromes is relatively adequate. Asymptomatic Chlamydia trachomatis (CT) and Neisseria gonorrhoeae (NG) infections limit the use of vaginal discharge and anorectal syndromes. The pooled diagnostic accuracy of vaginal syndromic case management for CT/NG is low, resulting in high numbers of overtreatment and missed treatment. The absolute effect of POCTs was reduced overtreatment and missed treatment. Findings of the reviews on syndromic case management underscored the need for low-cost and accurate POCTs for the identification, first, of CT/NG, and, second, of Mycoplasma genitalium (MG) and Trichomonas vaginalis (TV) and NG and MG resistance/susceptibility testing. Near-patient POCT molecular assays for CT/NG/TV are commercially available. The prices of these POCTs remain the barrier for uptake in resource-constrained settings. This is driving the development of lower cost solutions.ConclusionsThe WHO syndromic case management guidelines should be updated to raise the quality of STI management through the integration of laboratory tests. STI screening strategies are needed to address asymptomatic STIs. POCTs that are accurate, rapid, simple and affordable are urgently needed in resource-constrained settings to support the uptake of aetiological diagnosis and treatment.

Project description:As national HIV programs across the world mature and continue to scale up towards UNAIDS' 90-90-90 targets, it is increasingly important to accurately estimate HIV treatment needs in pediatric patient populations to prepare for anticipated increases in demand. This is particularly vital in sub-Saharan Africa, where the bulk of the global pediatric HIV burden remains concentrated, and for treatment-experienced populations, for which data are severely limited. This article discusses the conceptual framework behind and application of a five-year country-level quantification and decision-making tool aimed at providing national HIV programs and their partners with a better understanding of their evolving national HIV treatment and programming needs for second-and third-line pediatric populations. The conceptual framework of the algorithm which undergirds the tool is the patient pathway, along which key influencing factors that determine whether pediatric HIV patients are linked to care, remain in treatment, and are appropriately switched to later lines of treatment are accounted for quantitatively. Excel-based and arithmetic, the algorithm is designed to use available national, regional, and global data for factors impacting patient estimates including treatment coverage; routine viral load testing; viral load non-suppression; confirmed treatment failure; and patient loss to follow up-outcomes for which data are generally very limited in this patient population. The ultimate output of the tool is an estimate of the aggregate annual number of patients by treatment line. Given the limitations in available data for pediatric HIV, particularly for patients on second- and third-line treatments, this tool may help fill a data gap by providing a mechanism for policymakers to scenario plan, thus aiding resource allocation decisions for pediatric HIV program scale-up. The tool may be used to streamline national antiretroviral procurement of later lines of treatment, especially in resource-limited settings, and may also be used to add value to broader HIV policy and planning processes at the national level.

Project description:Adaptive management involves learning-oriented decision making in the presence of uncertainty about the responses of a resource system to management. It is implemented through an iterative sequence of decision making, monitoring and assessment of system responses, and incorporating what is learned into future decision making. Decision making at each point is informed by a value or objective function, for example total harvest anticipated over some time frame. The value function expresses the value associated with decisions, and it is influenced by system status as updated through monitoring. Often, decision making follows shortly after a monitoring event. However, it is certainly possible for the cadence of decision making to differ from that of monitoring. In this paper we consider different combinations of annual and biennial decision making, along with annual and biennial monitoring. With biennial decision making decisions are changed only every other year; with biennial monitoring field data are collected only every other year. Different cadences of decision making combine with annual and biennial monitoring to define 4 scenarios. Under each scenario we describe optimal valuations for active and passive adaptive decision making. We highlight patterns in valuation among scenarios, depending on the occurrence of monitoring and decision making events. Differences between years are tied to the fact that every other year a new decision can be made no matter what the scenario, and state information is available to inform that decision. In the subsequent year, however, in 3 of the 4 scenarios either a decision is repeated or monitoring does not occur (or both). There are substantive differences in optimal values among the scenarios, as well as the optimal policies producing those values. Especially noteworthy is the influence of monitoring cadence on valuation in some years. We highlight patterns in policy and valuation among the scenarios, and discuss management implications and extensions.

Dataset Information

How can we evaluate the potential of innovative vaccine products and technologies in resource constrained settings? A total systems effectiveness (TSE) approach to decision-making.

Publications

How can we evaluate the potential of innovative vaccine products and technologies in resource constrained settings? A total systems effectiveness (TSE) approach to decision-making.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets