Dataset Information

Individual-based simulation models of HIV transmission: reporting quality and recommendations.

ABSTRACT:

Background

Individual-based modeling is a growing technique in the HIV transmission and prevention literature, but insufficient attention has been paid to formally evaluate the quality of reporting in this field. We present reporting recommendations for individual-based models for HIV treatment and prevention, assess the quality of reporting in the existing literature, and comment on the contribution of this model type to HIV policy and prediction.

Methods

We developed reporting recommendations for individual-based HIV transmission mathematical models, and through a systematic search, used them to evaluate the reporting in the existing literature. We identified papers that employed individual-based simulation models and were published in English prior to December 31, 2012. Articles were included if the models they employed simulated and tracked individuals, simulated HIV transmission between individuals in a particular population, and considered a particular treatment or prevention intervention. The papers were assessed with the reporting recommendations.

Findings

Of 214 full text articles examined, 32 were included in the evaluation, representing 20 independent individual-based HIV treatment and prevention mathematical models. Manuscripts universally reported the objectives, context, and modeling conclusions in the context of the modeling assumptions and the model's predictive capabilities, but the reporting of individual-based modeling methods, parameterization and calibration was variable. Six papers discussed the time step used and one discussed efforts to maintain internal validity in coding.

Conclusion

Individual-based models represent detailed HIV transmission processes with the potential to contribute to inference and policy making for many different regions and populations. The rigor in reporting of assumptions, methods, and calibration of individual-based models focused on HIV transmission and prevention varies greatly. Higher standards for reporting of statistically rigorous calibration and model assumption testing need to be implemented to increase confidence in existing and future modeling results.

SUBMITTER: Abuelezam NN

PROVIDER: S-EPMC3787035 | biostudies-literature | 2013

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Individual-based simulation models of HIV transmission: reporting quality and recommendations.

Abuelezam Nadia N NN Rough Kathryn K Seage George R GR

PloS one 20130930 9

<h4>Background</h4>Individual-based modeling is a growing technique in the HIV transmission and prevention literature, but insufficient attention has been paid to formally evaluate the quality of reporting in this field. We present reporting recommendations for individual-based models for HIV treatment and prevention, assess the quality of reporting in the existing literature, and comment on the contribution of this model type to HIV policy and prediction.<h4>Methods</h4>We developed reporting r ...[more]

PMID: 24098707

Similar Datasets

Project description:BACKGROUND:Electrochemotherapy is becoming a well-established treatment for malignancies of skin and non-skin origin and its use is widening across Europe. The technique was developed and optimized from solid experimental and clinical evidence. A consensus document is now warranted to formalize reporting results, which should strengthen evidence-based practice recommendations. This consensus should be derived from high quality clinical data collection, clinical expertise and summarizing patient feedback. The first step, which is addressed in this paper, aims to critically analyze the quality of published studies and to provide the recommendations for reporting clinical trials on electrochemotherapy. METHODS:The quality of reporting in published studies on electrochemotherapy was analyzed in order to produce procedure specific reporting recommendations. A comprehensive literature search of studies published from 2006 to 2015 was performed followed by qualitative analysis of manuscripts assessing for 47 quality criteria grouped into four major clusters: (1) trial design, (2) description of patient population, (3) description of treatment delivery and patient outcome, (4) analysis of results and their interpretation. The summary measure during literature assessment was the proportion of studies fulfilling each manuscript quality criteria. RESULTS:A total of 56 studies were screened, from the period 2006 to 2015, of which 33 were included in the qualitative analysis, with a total of 1215 patients. Overall, the quality of reporting was highly variable. Twenty-four reports (73%) were single-center, non-comparative studies, and only 15 (45%) were prospective in nature (only 2 of them were entered into a clinical trials registry). Electrochemotherapy technique was consistently reported, with most studies (31/33) adhering closely to published standard operating procedures. The quality of reporting the patient population was variable among the analyzed studies, with only between 45% and 100% achieving dedicated quality criteria. Reporting of treatment delivery and patient outcome was also highly variable with studies only fulfilling between 3% and 100%. Finally, reporting study results critically varied, fulfilling from 27% to 100% of the quality criteria. Based on the critical issues emerging from this analysis, recommendations and minimal requirements for reporting clinical data on electrochemotherapy were prepared and summarized into a checklist. CONCLUSIONS:There is an increasing body of published clinical data on electrochemotherapy, but more high quality clinical data are needed. Published papers often lack accurate description of study population, treatment delivery as well as patient outcome. Our recommendations, provided in the form of a summary checklist, are intended to ameliorate data reporting in future studies on electrochemotherapy and help researchers to provide a solid evidence basis for clinical practice.

Project description:We present the Progression and Transmission of HIV (PATH 4.0), a simulation tool for analyses of cluster detection and intervention strategies. Molecular clusters are groups of HIV infections that are genetically similar, indicating rapid HIV transmission where HIV prevention resources are needed to improve health outcomes and prevent new infections. PATH 4.0 was constructed using a newly developed agent-based evolving network modeling (ABENM) technique and evolving contact network algorithm (ECNA) for generating scale-free networks. ABENM and ECNA were developed to facilitate simulation of transmission networks for low-prevalence diseases, such as HIV, which creates computational challenges for current network simulation techniques. Simulating transmission networks is essential for studying network dynamics, including clusters. We validated PATH 4.0 by comparing simulated projections of HIV diagnoses with estimates from the National HIV Surveillance System (NHSS) for 2010-2017. We also applied a cluster generation algorithm to PATH 4.0 to estimate cluster features, including the distribution of persons with diagnosed HIV infection by cluster status and size and the size distribution of clusters. Simulated features matched well with NHSS estimates, which used molecular methods to detect clusters among HIV nucleotide sequences of persons with HIV diagnosed during 2015-2017. Cluster detection and response is a component of the U.S. Ending the HIV Epidemic strategy. While surveillance is critical for detecting clusters, a model in conjunction with surveillance can allow us to refine cluster detection methods, understand factors associated with cluster growth, and assess interventions to inform effective response strategies. As surveillance data are only available for cases that are diagnosed and reported, a model is a critical tool to understand the true size of clusters and assess key questions, such as the relative contributions of clusters to onward transmissions. We believe PATH 4.0 is the first modeling tool available to assess cluster detection and response at the national-level and could help inform the national strategic plan.

Project description:Increasingly, computer simulation models are used for economic and policy evaluation in cancer prevention and control. A model's predictions of key outcomes, such as screening effectiveness, depend on the values of unobservable natural history parameters. Calibration is the process of determining the values of unobservable parameters by constraining model output to replicate observed data. Because there are many approaches for model calibration and little consensus on best practices, we surveyed the literature to catalogue the use and reporting of these methods in cancer simulation models. We conducted a MEDLINE search (1980 through 2006) for articles on cancer-screening models and supplemented search results with articles from our personal reference databases. For each article, two authors independently abstracted pre-determined items using a standard form. Data items included cancer site, model type, methods used for determination of unobservable parameter values and description of any calibration protocol. All authors reached consensus on items of disagreement. Reviews and non-cancer models were excluded. Articles describing analytical models, which estimate parameters with statistical approaches (e.g. maximum likelihood) were catalogued separately. Models that included unobservable parameters were analysed and classified by whether calibration methods were reported and if so, the methods used. The review process yielded 154 articles that met our inclusion criteria and, of these, we concluded that 131 may have used calibration methods to determine model parameters. Although the term 'calibration' was not always used, descriptions of calibration or 'model fitting' were found in 50% (n = 66) of the articles, with an additional 16% (n = 21) providing a reference to methods. Calibration target data were identified in nearly all of these articles. Other methodological details, such as the goodness-of-fit metric, were discussed in 54% (n = 47 of 87) of the articles reporting calibration methods, while few details were provided on the algorithms used to search the parameter space. Our review shows that the use of cancer simulation modelling is increasing, although thorough descriptions of calibration procedures are rare in the published literature for these models. Calibration is a key component of model development and is central to the validity and credibility of subsequent analyses and inferences drawn from model predictions. To aid peer-review and facilitate discussion of modelling methods, we propose a standardized Calibration Reporting Checklist for model documentation.

Project description:IntroductionThe basis of pharmacovigilance is provided by the exchange of Individual Case Safety Reports (ICSRs) between the recipient of the original report and other interested parties, which include Marketing Authorization Holders (MAHs) and Health Authorities (HAs). Different regulators have different reporting requirements for report transmission. This results in replication of each ICSR that will exist in multiple locations. Adding in the fact that each case will go through multiple versions, different recipients may receive different case versions at different times, potentially influencing patient safety decisions and potentially amplifying or obscuring safety signals inappropriately.ObjectiveThe present study aimed to investigate the magnitude of replication, the variability among recipients, and the subsequent divergence across recipients of ICSRs.MethodsSeven participating TransCelerate Member Companies (MCs) queried their respective safety databases covering a 3-year period and provided aggregate ICSR submission statistics for expedited safety reports to an independent project manager. As measured in the US Food and Drug Administration (FDA)'s Adverse Event Reporting System (FAERS), ICSR volume for these seven MCs makes up approximately 20% of the total case volume. Aggregate metrics were calculated from the company data, specifically: (i) number of ICSR transmissions, (ii) average number of recipients (ANR) per case version transmitted, (iii) a submission selectivity metric, which measures the percentage of recipients not having received all sequential case version numbers, and (iv) percent of common ISCRs residing in two or more MAH databases.ResultsThe analysis reflects 2,539,802 case versions, distributed through 7,602,678 submissions. The overall mean replication rate is 3.0 submissions per case version. The distribution of the ANR replication measure was observed to be very long-tailed, with a significant fraction of case versions (~ 12.4% of all transmissions) being sent to ten or more HA recipients. Replication is higher than average for serious, unlisted, and literature cases, ranging from 3.5 to 6.1 submissions per version. Within the subset of ICSR versions sent to three recipients, a significant degree of variability in the actual recipients (i.e., HAs) was observed, indicating that there is not one single combination of the same three HAs predominantly receiving an ICSR. Submission selectivity increases with the case version. For case version 6, the range of the submission selectivity for the MAHs ranges from ~ 10% to over 50%, with a median of 30.2%. Within the participating MAHs, the percentage of cases that reside within at least two safety databases is approximately 2% across five databases. Further analysis of the data from three MAHs showed percentages of 13.4%, 15.6%, and 27.9% of ICSRs originating from HAs and any other partners such as other MAHs and other institutions.ConclusionReplication of ICSRs and the variation of available safety information in recipient databases were quantified and shown to be substantial. Our work shows that multiple processors and medical reviewers will likely handle the same original ICSR as a result of replication. Aside from the obvious duplicate work, this phenomenon could conceivably lead to differing clinical assessments and decisions. If replication could be reduced or even eliminated, this would enable more focus on activities with a benefit for patient safety.

Dataset Information

Individual-based simulation models of HIV transmission: reporting quality and recommendations.

Background

Methods

Findings

Conclusion

Publications

Individual-based simulation models of HIV transmission: reporting quality and recommendations.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets