Unknown

Dataset Information

0

Crowdsourcing the Measurement of Interstate Conflict.


ABSTRACT: Much of the data used to measure conflict is extracted from news reports. This is typically accomplished using either expert coders to quantify the relevant information or machine coders to automatically extract data from documents. Although expert coding is costly, it produces quality data. Machine coding is fast and inexpensive, but the data are noisy. To diminish the severity of this tradeoff, we introduce a method for analyzing news documents that uses crowdsourcing, supplemented with computational approaches. The new method is tested on documents about Militarized Interstate Disputes, and its accuracy ranges between about 68 and 76 percent. This is shown to be a considerable improvement over automated coding, and to cost less and be much faster than expert coding.

SUBMITTER: D'Orazio V 

PROVIDER: S-EPMC4911154 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

altmetric image

Publications

Crowdsourcing the Measurement of Interstate Conflict.

D'Orazio Vito V   Kenwick Michael M   Lane Matthew M   Palmer Glenn G   Reitter David D  

PloS one 20160616 6


Much of the data used to measure conflict is extracted from news reports. This is typically accomplished using either expert coders to quantify the relevant information or machine coders to automatically extract data from documents. Although expert coding is costly, it produces quality data. Machine coding is fast and inexpensive, but the data are noisy. To diminish the severity of this tradeoff, we introduce a method for analyzing news documents that uses crowdsourcing, supplemented with comput  ...[more]

Similar Datasets

| S-EPMC5645420 | biostudies-literature
| S-EPMC6220355 | biostudies-literature
| S-EPMC5834001 | biostudies-literature
| S-EPMC3924214 | biostudies-other
| S-EPMC6389429 | biostudies-literature
| S-EPMC4701001 | biostudies-literature
| S-EPMC7158995 | biostudies-literature
| S-EPMC4051500 | biostudies-literature
| S-EPMC5581186 | biostudies-literature
| S-EPMC4192655 | biostudies-literature