Dataset Information

All that glisters is not gold: sampling-process uncertainty in disease-vector surveys with false-negative and false-positive detections.

ABSTRACT:

Background

Vector-borne diseases are major public health concerns worldwide. For many of them, vector control is still key to primary prevention, with control actions planned and evaluated using vector occurrence records. Yet vectors can be difficult to detect, and vector occurrence indices will be biased whenever spurious detection/non-detection records arise during surveys. Here, we investigate the process of Chagas disease vector detection, assessing the performance of the surveillance method used in most control programs--active triatomine-bug searches by trained health agents.

Methodology/principal findings

Control agents conducted triplicate vector searches in 414 man-made ecotopes of two rural localities. Ecotope-specific 'detection histories' (vectors or their traces detected or not in each individual search) were analyzed using ordinary methods that disregard detection failures and multiple detection-state site-occupancy models that accommodate false-negative and false-positive detections. Mean (± SE) vector-search sensitivity was ? 0.283 ± 0.057. Vector-detection odds increased as bug colonies grew denser, and were lower in houses than in most peridomestic structures, particularly woodpiles. False-positive detections (non-vector fecal streaks misidentified as signs of vector presence) occurred with probability ? 0.011 ± 0.008. The model-averaged estimate of infestation (44.5 ± 6.4%) was ? 2.4-3.9 times higher than naïve indices computed assuming perfect detection after single vector searches (11.4-18.8%); about 106-137 infestation foci went undetected during such standard searches.

Conclusions/significance

We illustrate a relatively straightforward approach to addressing vector detection uncertainty under realistic field survey conditions. Standard vector searches had low sensitivity except in certain singular circumstances. Our findings suggest that many infestation foci may go undetected during routine surveys, especially when vector density is low. Undetected foci can cause control failures and induce bias in entomological indices; this may confound disease risk assessment and mislead program managers into flawed decision making. By helping correct bias in naïve indices, the approach we illustrate has potential to critically strengthen vector-borne disease control-surveillance systems.

SUBMITTER: Abad-Franch F

PROVIDER: S-EPMC4169387 | biostudies-literature | 2014 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

All that glisters is not gold: sampling-process uncertainty in disease-vector surveys with false-negative and false-positive detections.

Abad-Franch Fernando F Valença-Barbosa Carolina C Sarquis Otília O Lima Marli M MM

PLoS neglected tropical diseases 20140918 9

<h4>Background</h4>Vector-borne diseases are major public health concerns worldwide. For many of them, vector control is still key to primary prevention, with control actions planned and evaluated using vector occurrence records. Yet vectors can be difficult to detect, and vector occurrence indices will be biased whenever spurious detection/non-detection records arise during surveys. Here, we investigate the process of Chagas disease vector detection, assessing the performance of the surveillanc ...[more]

PMID: 25233352

Similar Datasets

Project description:Errors in botanical surveying are a common problem. The presence of a species is easily overlooked, leading to false-absences; while misidentifications and other mistakes lead to false-positive observations. While it is common knowledge that these errors occur, there are few data that can be used to quantify and describe these errors. Here we characterise false-positive errors for a controlled set of surveys conducted as part of a field identification test of botanical skill. Surveys were conducted at sites with a verified list of vascular plant species. The candidates were asked to list all the species they could identify in a defined botanically rich area. They were told beforehand that their final score would be the sum of the correct species they listed, but false-positive errors counted against their overall grade. The number of errors varied considerably between people, some people create a high proportion of false-positive errors, but these are scattered across all skill levels. Therefore, a person's ability to correctly identify a large number of species is not a safeguard against the generation of false-positive errors. There was no phylogenetic pattern to falsely observed species; however, rare species are more likely to be false-positive as are species from species rich genera. Raising the threshold for the acceptance of an observation reduced false-positive observations dramatically, but at the expense of more false negative errors. False-positive errors are higher in field surveying of plants than many people may appreciate. Greater stringency is required before accepting species as present at a site, particularly for rare species. Combining multiple surveys resolves the problem, but requires a considerable increase in effort to achieve the same sensitivity as a single survey. Therefore, other methods should be used to raise the threshold for the acceptance of a species. For example, digital data input systems that can verify, feedback and inform the user are likely to reduce false-positive errors significantly.

Project description:Objectives: With the worldwide spread of coronavirus disease 2019 (COVID-19) caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), various antibody detection kits have been developed to test for SARS-CoV-2- specific IgG, IgM, and total antibody. However, the use of different testing methods under various heat-inactivation conditions might affect the COVID-19 detection results. Methods: Seven different antibody detection kits produced by four manufacturers for detection of SARS-CoV-2 IgG, IgM, and total antibody were tested at Wuhan Huoshenshan Hospital, China. Most of the kits used the indirect immunity, capture, and double-antigen sandwich methods. The effects of various heat-inactivation conditions on SARS-CoV-2-specific IgG, IgM, and total antibody detection were analyzed for the different test methods. Results: Using the indirect immunity method, values for SARS-CoV-2 IgG antibody significantly increased and those for IgM antibody decreased with increasing temperature of heat-inactivation using indirect immunity method. However, values for SARS-CoV-2 IgM and total antibody showed no change when the capture and double-antigen sandwich methods were used. The changes in IgG and IgM antibody values with the indirect immunity method indicated that heat-inactivation could affect COVID-19 detection results obtained using this method. In particular, 18 (22.2%) SARS-CoV-2 IgM positive samples were detected as negative with heat-inactivation at 65°C for 30 min, and one (25%) IgG negative sample was detected as positive after heat-inactivation at 56°C for 60 min and 60°C for 30 min. Conclusions: Heat-inactivation could increase SARS-CoV-2 IgG antibody values, and decrease IgM antibody values, causing potential false-positive or false-negative results for COVID-19 antibody detection using the indirect immunity method. Thus, before conducting antibody testing, the testing platforms should be evaluated in accordance with the relevant requirements to ensure accurate COVID-19 detection results.

Project description:BackgroundExact preoperative localization is desirable to perform minimally invasive parathyroidectomy for hyperparathyroidism (HPT). This study aimed to evaluate the diagnostic values of 99mTc-methoxyisobutylisonitrile (99mTc-MIBI) single photon emission computed tomography/computed tomography (SPECT/CT) of parathyroid glands by analyzing the relationship between lesion weight and false-negative (FN) results, as well as to explain the possible reason.MethodsThe data from 314 patients with suspected HPT who underwent 99mTc-MIBI SPECT/CT parathyroid imaging between 2011 and 2022 were retrospectively evaluated. The sensitivity, positive predictive value (PPV), negative predictive value (NPV), and accuracy of parathyroid 99mTc-MIBI SPECT/CT were calculated, and the false-positive (FP) and FN findings were analyzed.ResultsAccurate localization by 99mTc-MIBI SPECT/CT was significantly associated with the parathyroid hormone (PTH) level. The 99mTc-MIBI SPECT/CT for diagnosis/lesion location reached a sensitivity of 84.6%/56.8%, a PPV of 97.3%/98.4%, an NPV of only 23.7%/4.18%, and an accuracy of 83.4%/57.1%, respectively. The largest diameter, shortest diameter, and lesion volume were lower in the FN group than in the TP group. A total of 7 FP cases were found, including 2 cases of thyroid nodules, 4 cases of thyroid tissue, and 1 case of hibernoma. A total of 45 FN patients, including 321 FN lesions, were confirmed, of which parathyroid hyperplasia accounted for 97.8%. Lesion weights greater than 20 µg were able to be detected, but lightweight lesions less than 100 mg were the principal source of FN results, accounting for approximately 39.3%. With lesion weights 0-100, 101-300, 301-1,000, and >1,000 mg, the FN rate was 70.8% (126/178), 51.8% (103/199), 34.6% (81/234), and 8.33% (11/132), respectively.Conclusions99mTc-MIBI SPECT/CT parathyroid imaging provides good sensitivity and high specificity in HPT location. Correct localization by 99mTc-MIBI SPECT/CT correlates positively with lesion weight and PTH levels. The smaller the lesion, the higher the FN rate in 99mTc-MIBI SPECT/CT parathyroid imaging, and lesions weighing less than 100 mg are the main source of FN results in 99mTc-MIBI SPECT/CT parathyroid imaging.

Project description:The massive sequencing of transposon insertion mutant libraries (Tn-Seq) represents a commonly used method to determine essential genes in bacteria. Using a hypersaturated transposon mutant library consisting of 400,096 unique Tn insertions, 523 genes were classified as essential in Escherichia coli K-12 MG1655. This provided a useful genome-wide gene essentiality landscape for rapidly identifying 233 of 301 essential genes previously validated by a knockout study. However, there was a discrepancy in essential gene sets determined by conventional gene deletion methods and Tn-Seq, although different Tn-Seq studies reported different extents of discrepancy. We have elucidated two causes of this discrepancy. First, 68 essential genes not detected by Tn-Seq contain nonessential subgenic domains that are tolerant to transposon insertion, which leads to the false assignment of an essential gene as a nonessential or dispensable gene. These genes exhibited a high level of transposon insertion in their subgenic nonessential domains. In contrast, 290 genes were additionally categorized as essential by Tn-Seq, although their knockout mutants were available. The comparative analysis of Tn-Seq and high-resolution footprinting of nucleoid-associated proteins (NAPs) revealed that a protein-DNA interaction hinders transposon insertion. We identified 213 false-positive genes caused by NAP-genome interactions. These two limitations have to be considered when addressing essential bacterial genes using Tn-Seq. Furthermore, a comparative analysis of high-resolution Tn-Seq with other data sets is required for a more accurate determination of essential genes in bacteria. IMPORTANCE Transposon mutagenesis is an efficient way to explore gene essentiality of a bacterial genome. However, there was a discrepancy between the essential gene set determined by transposon mutagenesis and that determined using single-gene knockout strains. In this study, we generated a hypersaturated Escherichia coli transposon mutant library comprising approximately 400,000 different mutants. Determination of transposon insertion sites using next-generation sequencing provided a high-resolution essentiality landscape of the E. coli genome. We identified false negatives of essential gene discovery due to the permissive insertion of transposons in the C-terminal region. Comparisons between the transposon insertion landscape with binding profiles of DNA-binding proteins revealed interference of nucleoid-associated proteins to transposon insertion, generating false positives of essential gene discovery. Consideration of these findings is required to avoid the misinterpretation of transposon mutagenesis results.

Project description:Sound wildlife conservation decisions require sound information, and scientists increasingly rely on remotely collected data over large spatial scales, such as noninvasive genetic tagging (NGT). Grizzly bears (Ursus arctos), for example, are difficult to study at population scales except with noninvasive data, and NGT via hair trapping informs management over much of grizzly bears' range. Considerable statistical effort has gone into estimating sources of heterogeneity, but detection error-arising when a visiting bear fails to leave a hair sample-has not been independently estimated. We used camera traps to survey grizzly bear occurrence at fixed hair traps and multi-method hierarchical occupancy models to estimate the probability that a visiting bear actually leaves a hair sample with viable DNA. We surveyed grizzly bears via hair trapping and camera trapping for 8 monthly surveys at 50 (2012) and 76 (2013) sites in the Rocky Mountains of Alberta, Canada. We used multi-method occupancy models to estimate site occupancy, probability of detection, and conditional occupancy at a hair trap. We tested the prediction that detection error in NGT studies could be induced by temporal variability within season, leading to underestimation of occupancy. NGT via hair trapping consistently underestimated grizzly bear occupancy at a site when compared to camera trapping. At best occupancy was underestimated by 50%; at worst, by 95%. Probability of false absence was reduced through successive surveys, but this mainly accounts for error imparted by movement among repeated surveys, not necessarily missed detections by extant bears. The implications of missed detections and biased occupancy estimates for density estimation-which form the crux of management plans-require consideration. We suggest hair-trap NGT studies should estimate and correct detection error using independent survey methods such as cameras, to ensure the reliability of the data upon which species management and conservation actions are based.

Dataset Information

All that glisters is not gold: sampling-process uncertainty in disease-vector surveys with false-negative and false-positive detections.

Background

Methodology/principal findings

Conclusions/significance

Publications

All that glisters is not gold: sampling-process uncertainty in disease-vector surveys with false-negative and false-positive detections.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets