Dataset Information

A taxonomy of quality assessment methods for volunteered and crowdsourced geographic information.

ABSTRACT: The growing use of crowdsourced geographic information (CGI) has prompted the employment of several methods for assessing information quality, which are aimed at addressing concerns on the lack of quality of the information provided by non-experts. In this work, we propose a taxonomy of methods for assessing the quality of CGI when no reference data are available, which is likely to be the most common situation in practice. Our taxonomy includes 11 quality assessment methods that were identified by means of a systematic literature review. These methods are described in detail, including their main characteristics and limitations. This taxonomy not only provides a systematic and comprehensive account of the existing set of methods for CGI quality assessment, but also enables researchers working on the quality of CGI in various sources (e.g., social media, crowd sensing, collaborative mapping) to learn from each other, thus opening up avenues for future work that combines and extends existing methods into new application areas and domains.

SUBMITTER: Degrossi LC

PROVIDER: S-EPMC5993263 | biostudies-literature | 2018 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A taxonomy of quality assessment methods for volunteered and crowdsourced geographic information.

Degrossi Lívia Castro LC Porto de Albuquerque João J Dos Santos Rocha Roberto R Zipf Alexander A

Transactions in GIS : TG 20180419 2

The growing use of crowdsourced geographic information (CGI) has prompted the employment of several methods for assessing information quality, which are aimed at addressing concerns on the lack of quality of the information provided by non-experts. In this work, we propose a taxonomy of methods for assessing the quality of CGI when no reference data are available, which is likely to be the most common situation in practice. Our taxonomy includes 11 quality assessment methods that were identified ...[more]

PMID: 29937686

Similar Datasets

Project description:Environmental exposure assessment based on Geographic Information Systems (GIS) and study participants' residential proximity to environmental exposure sources relies on the positional accuracy of subjects' residences to avoid misclassification bias. Our study compared the positional accuracy of two automatic geocoding methods to a manual reference method.We geocoded 4,247 address records representing the residential history (1990-2008) of 1,685 women from the French national E3N cohort living in the Rhône-Alpes region. We compared two automatic geocoding methods, a free-online geocoding service (method A) and an in-house geocoder (method B), to a reference layer created by manually relocating addresses from method A (method R). For each automatic geocoding method, positional accuracy levels were compared according to the urban/rural status of addresses and time-periods (1990-2000, 2001-2008), using Chi Square tests. Kappa statistics were performed to assess agreement of positional accuracy of both methods A and B with the reference method, overall, by time-periods and by urban/rural status of addresses.Respectively 81.4% and 84.4% of addresses were geocoded to the exact address (65.1% and 61.4%) or to the street segment (16.3% and 23.0%) with methods A and B. In the reference layer, geocoding accuracy was higher in urban areas compared to rural areas (74.4% vs. 10.5% addresses geocoded to the address or interpolated address level, p < 0.0001); no difference was observed according to the period of residence. Compared to the reference method, median positional errors were 0.0 m (IQR = 0.0-37.2 m) and 26.5 m (8.0-134.8 m), with positional errors <100 m for 82.5% and 71.3% of addresses, for method A and method B respectively. Positional agreement of method A and method B with method R was 'substantial' for both methods, with kappa coefficients of 0.60 and 0.61 for methods A and B, respectively.Our study demonstrates the feasibility of geocoding residential addresses in epidemiological studies not initially recorded for environmental exposure assessment, for both recent addresses and residence locations more than 20 years ago. Accuracy of the two automatic geocoding methods was comparable. The in-house method (B) allowed a better control of the geocoding process and was less time consuming.

Project description:We present primary results from the Sequencing Quality Control (SEQC) project, coordinated by the United States Food and Drug Administration. Examining Illumina HiSeq, Life Technologies SOLiD and Roche 454 platforms at multiple laboratory sites using reference RNA samples with built-in controls, we assess RNA sequencing (RNA-seq) performance for sequence discovery and differential expression profiling and compare it to microarray and quantitative PCR (qPCR) data using complementary metrics. At all sequencing depths, we discover unannotated exon-exon junctions, with >80% validated by qPCR. We find that measurements of relative expression are accurate and reproducible across sites and platforms if specific filters are used. In contrast, RNA-seq and microarrays do not provide accurate absolute measurements, and gene-specific biases are observed, for these and qPCR. Measurement performance depends on the platform and data analysis pipeline, and variation is large for transcriptlevel profiling. The complete SEQC data sets, comprising >100 billion reads (10Tb), provide unique resources for evaluating RNA-seq analyses for clinical and regulatory settings. The well-characterized reference RNA samples A (pooled cell lines) and B (human brain) from the MAQC consortium, adding spike-ins of synthetic RNA from the External RNA Control Consortium (ERCC). Samples C and D were then constructed by combining A and B in known mixing ratios, 3:1 and 1:3, respectively. All samples were distributed to several independent sites for RNA-Seq library construction and profiling by Illumina HiSeq 2000 and LifeTech SOLiD 5500 platforms. Also, vendors created their own cDNA libraries that were then distributed to each test site, in order to examine the degree of a M-bM-^@M-^\site effectM-bM-^@M-^] that was independent of the library preparation process. To support an assessment of gene models, samples A and B were also sequenced at independent sites by the Roche 454 platform, providing longer reads. For comparison to other technologies, these data were also compared to the MAQC-I Affymetrix U133 Plus2 microarray, several current microarray platforms, and also assessed by 20,801 PrimePCR reactions.

Project description:BackgroundOver 20,000 parents in the United States face the challenge of participating in decisions about whether to use life support for their infants born on the cusp of viability every year. Clinicians must help families grasp complex medical information about their baby's immediate prognosis as well as the risk for significant long-term morbidity. Patients faced with this decision want supplemental information and frequently seek medical information on the Internet. Empirical evidence about the quality of websites is lacking.ObjectiveWe sought to evaluate the quality of online information available about periviable birth and treatment options for infants born at the cusp of viability.MethodsWe read a counseling script to 20 pregnant participants that included information typically provided by perinatal and neonatal providers when periviable birth is imminent. The women were then asked to list terms they would use to search the Internet if they wanted additional information. Using these search terms, two reviewers evaluated the content of websites obtained via a Google search. We used two metrics to assess the quality of websites. The first was the DISCERN instrument, a validated questionnaire designed to assess the quality of patient-targeted health information for treatment choices. The second metric was the Essential Content Tool (ECT), a tool designed to address key components of counseling around periviable birth as outlined by professional organizations. DISCERN scores were classified as low quality if scores were 2, fair quality if scores were 3, and high quality if scores were 4 or higher. Scores of 6 or higher on the ECT were considered high quality. Interreviewer agreement was assessed by calculated kappa statistic.ResultsA total of 97 websites were reviewed. Over half (57/97, 59%) were for-profit sites, news stories, or personal blogs; 28% (27/97) were government or medical sites; and 13% (13/97) were nonprofit or advocacy sites. The majority of sites scored poorly in DISCERN questions designed to assess the reliability of information presented as well as data regarding treatment choices. Only 7% (7/97) of the websites were high quality as defined by the DISCERN tool. The majority of sites did not address the essential content defined by the ECT. Importantly, only 18% of websites (17/97) indicated that there are often a number of reasonable approaches to newborn care when faced with periviable birth. Agreement was strong, with kappa ranging from .72 to .91.ConclusionsMost information about periviable birth found on the Internet using common search strategies is of low quality. News stories highlighting positive outcomes are disproportionately represented. Few websites discuss comfort care or how treatment decisions impact quality of life.

Dataset Information

A taxonomy of quality assessment methods for volunteered and crowdsourced geographic information.

Publications

A taxonomy of quality assessment methods for volunteered and crowdsourced geographic information.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets