Dataset Information

A generalized approach for producing, quantifying, and validating citizen science data from wildlife images.

ABSTRACT: Citizen science has the potential to expand the scope and scale of research in ecology and conservation, but many professional researchers remain skeptical of data produced by nonexperts. We devised an approach for producing accurate, reliable data from untrained, nonexpert volunteers. On the citizen science website www.snapshotserengeti.org, more than 28,000 volunteers classified 1.51 million images taken in a large-scale camera-trap survey in Serengeti National Park, Tanzania. Each image was circulated to, on average, 27 volunteers, and their classifications were aggregated using a simple plurality algorithm. We validated the aggregated answers against a data set of 3829 images verified by experts and calculated 3 certainty metrics-level of agreement among classifications (evenness), fraction of classifications supporting the aggregated answer (fraction support), and fraction of classifiers who reported "nothing here" for an image that was ultimately classified as containing an animal (fraction blank)-to measure confidence that an aggregated answer was correct. Overall, aggregated volunteer answers agreed with the expert-verified data on 98% of images, but accuracy differed by species commonness such that rare species had higher rates of false positives and false negatives. Easily calculated analysis of variance and post-hoc Tukey tests indicated that the certainty metrics were significant indicators of whether each image was correctly classified or classifiable. Thus, the certainty metrics can be used to identify images for expert review. Bootstrapping analyses further indicated that 90% of images were correctly classified with just 5 volunteers per image. Species classifications based on the plurality vote of multiple citizen scientists can provide a reliable foundation for large-scale monitoring of African wildlife.

SUBMITTER: Swanson A

PROVIDER: S-EPMC4999033 | biostudies-literature | 2016 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A generalized approach for producing, quantifying, and validating citizen science data from wildlife images.

Swanson Alexandra A Kosmala Margaret M Lintott Chris C Packer Craig C

Conservation biology : the journal of the Society for Conservation Biology 20160425 3

Citizen science has the potential to expand the scope and scale of research in ecology and conservation, but many professional researchers remain skeptical of data produced by nonexperts. We devised an approach for producing accurate, reliable data from untrained, nonexpert volunteers. On the citizen science website www.snapshotserengeti.org, more than 28,000 volunteers classified 1.51 million images taken in a large-scale camera-trap survey in Serengeti National Park, Tanzania. Each image was c ...[more]

PMID: 27111678

Similar Datasets

Project description:Abstract The GLOBE Program's GLOBE Observer application is a free citizen science mobile data collection and visualization tool compatible with iOS and Android operating systems. Citizen scientists armed with the app can report the mosquito larval habitats they identify using the GLOBE Mosquito Habitat Mapper tool. This data can complement the climate, weather, and land cover data obtained from satellite measurements by scientists who develop risk models for mosquito‐borne diseases. Public participation in mosquito surveillance research provides the opportunity to obtain the volume, velocity and variety of data needed to fight the threat of vector‐borne diseases, especially in under‐resourced communities with minimal to no municipal surveillance and mitigation services. GLOBE Mosquito Habitat Mappers document and describe potential and active mosquito larval habitats in and around their homes and communities. An easy‐to‐use pictorial interface enables users to geolocate and describe oviposition sites encountered, count and identify mosquito larvae, and when appropriate, eliminate the larval habitats. During Mosquito Habitat Mapper's first 3 years of use, over 24,000 data observations have been reported throughout the world. This technical report summarizes GLOBE Mosquito Habitat Mapper data reported by GLOBE citizen scientists from three regions: Africa, Asia and the Pacific Islands, and Latin America and the Caribbean. Localized mosquito larvae distribution patterns were examined by comparing data collected in three cities in Senegal–Dakar, Touba, and Thilmakha. The Senegal data show habitat and genera differences among mosquitoes identified by citizen scientists in the cities and illustrates the potential of the app for community‐based surveillance and research. Key Points GLOBE Observer is The GLOBE Program's mobile app. The GLOBE Mosquito Habitat Mapper on this platform enables citizen scientists to identify, describe and report mosquito larvae and habitats GLOBE Mosquito Habitat Mappers not only collect data, but participate in source reduction and reduce risk of disease in their community GLOBE Mosquito Habitat Mapper data has practical applications in municipal surveillance as well as in mosquito vector borne disease research

Project description:Appropriate large-scale citizen-science data present important new opportunities for biodiversity modelling, due in part to the wide spatial coverage of information. Recently proposed occupancy modelling approaches naturally incorporate random effects in order to account for annual variation in the composition of sites surveyed. In turn this leads to Bayesian analysis and model fitting, which are typically extremely time consuming. Motivated by presence-only records of occurrence from the UK Butterflies for the New Millennium data base, we present an alternative approach, in which site variation is described in a standard way through logistic regression on relevant environmental covariates. This allows efficient occupancy model-fitting using classical inference, which is easily achieved using standard computers. This is especially important when models need to be fitted each year, typically for many different species, as with British butterflies for example. Using both real and simulated data we demonstrate that the two approaches, with and without random effects, can result in similar conclusions regarding trends. There are many advantages to classical model-fitting, including the ability to compare a range of alternative models, identify appropriate covariates and assess model fit, using standard tools of maximum likelihood. In addition, modelling in terms of covariates provides opportunities for understanding the ecological processes that are in operation. We show that there is even greater potential; the classical approach allows us to construct regional indices simply, which indicate how changes in occupancy typically vary over a species' range. In addition we are also able to construct dynamic occupancy maps, which provide a novel, modern tool for examining temporal changes in species distribution. These new developments may be applied to a wide range of taxa, and are valuable at a time of climate change. They also have the potential to motivate citizen scientists.

Project description:As libraries struggle to keep pace with the changing societal landscape, emerging practices such as citizen science (CS) initiatives are being incorporated to reinforce the idea of public libraries as gathering, meeting, and collaboration spaces within the context of shared community and shared learning resources. However, there is little empirical evidence of whether the most open and participatory ways that CS puts forward can converge with and be nurtured by the essence of public libraries. Also, the roles of librarians and users in the 'next generation public library' have been under-developed. As the number of CS initiatives at public libraries grows, so does the need to collect evidence on the impact and the capacity of assimilation of CS practices. The data describes librarians and users' perceptions of participating in a citizen science project. Two hands-on activities for librarians of the Barcelona Network of Public Libraries were implemented. One was a training course for 30 librarians from 24 libraries which allowed them to envisage citizen science implementation in each library. The second activity consisted in the co-creation of a citizen social science project. 40 library users, 7 librarians from 3 different cities, and professional scientists, were involved. The data on librarians and users' perception was collected through participant observation, surveys, and a focus group to identify strengths and challenges of implementing citizen science at public libraries. The data covers librarians and users attitudes towards citizen science, their motivations to participate, their perceived ability to implement a citizen science project (as for librarians) or to contribute to science (as for library users), and the participants intention to keep engaged with citizen science, drawing on the Theory of Planned Behavior. Responses to closed-ended survey questions are analyzed at a descriptive level. The qualitative feedback from the focus group and the open-ended survey question on motivations is subjected to a thematic analysis. The data offers interesting insights to identify opportunities and challenges of implementing citizen science at public libraries, contributing to the debate over the public library's mission as local community hub.

Dataset Information

A generalized approach for producing, quantifying, and validating citizen science data from wildlife images.

Publications

A generalized approach for producing, quantifying, and validating citizen science data from wildlife images.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets