Dataset Information

Virtual audits of the urban streetscape: comparing the inter-rater reliability of GigaPan® to Google Street View.

ABSTRACT: BACKGROUND:Although previous research has highlighted the association between the built environment and individual health, methodological challenges in assessing the built environment remain. In particular, many researchers have demonstrated the high inter-rater reliability of assessing large or objective built environment features and the low inter-rater reliability of assessing small or subjective built environment features using Google Street View. New methods for auditing the built environment must be evaluated to understand if there are alternative tools through which researchers can assess all types of built environment features with high agreement. This paper investigates measures of inter-rater reliability of GigaPan®, a tool that assists with capturing high-definition panoramic images, relative to Google Street View. METHODS:Street segments (n?=?614) in Pittsburgh, Pennsylvania in the United States were randomly selected to audit using GigaPan® and Google Street View. Each audit assessed features related to land use, traffic and safety, and public amenities. Inter-rater reliability statistics, including percent agreement, Cohen's kappa, and the prevalence-adjusted bias-adjusted kappa (PABAK) were calculated for 106 street segments that were coded by two, different, human auditors. RESULTS:Most large-scale, objective features (e.g. bus stop presence or stop sign presence) demonstrated at least substantial inter-rater reliability for both methods, but significant differences emerged across finely detailed features (e.g. trash) and features at segment endpoints (e.g. sidewalk continuity). After adjusting for the effects of bias and prevalence, the inter-rater reliability estimates were consistently higher for almost all built environment features across GigaPan® and Google Street View. CONCLUSION:GigaPan® is a reliable, alternative audit tool to Google Street View for studying the built environment. GigaPan® may be particularly well-suited for built environment projects with study settings in areas where Google Street View imagery is nonexistent or updated infrequently. The potential for enhanced, detailed imagery using GigaPan® will be most beneficial in studies in which current, time sensitive data are needed or microscale built environment features would be challenging to see in Google Street View. Furthermore, to better understand the effects of prevalence and bias in future reliability studies, researchers should consider using PABAK to supplement or expand upon Cohen's kappa findings.

SUBMITTER: Bromm KN

PROVIDER: S-EPMC7422490 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Virtual audits of the urban streetscape: comparing the inter-rater reliability of GigaPan® to Google Street View.

Bromm Katherine N KN Lang Ian-Marshall IM Twardzik Erica E EE Antonakos Cathy L CL Dubowitz Tamara T Colabianchi Natalie N

International journal of health geographics 20200812 1

<h4>Background</h4>Although previous research has highlighted the association between the built environment and individual health, methodological challenges in assessing the built environment remain. In particular, many researchers have demonstrated the high inter-rater reliability of assessing large or objective built environment features and the low inter-rater reliability of assessing small or subjective built environment features using Google Street View. New methods for auditing the built e ...[more]

PMID: 32787861

Similar Datasets

Project description:BackgroundAltering micro-scale features of neighborhood walkability (e.g., benches, sidewalks, and cues of social disorganization or crime) could be a relatively cost-effective method of creating environments that are conducive to active living. Traditionally, measuring the micro-scale environment has required researchers to perform observational audits. Technological advances have led to the development of virtual audits as alternatives to observational field audits with the enviable properties of cost-efficiency from elimination of travel time and increased safety for auditors. This study examined the reliability of the Virtual Systematic Tool for Evaluating Pedestrian Streetscapes (Virtual-STEPS), a Google Street View-based auditing tool specifically designed to remotely assess micro-scale characteristics of the built environment.MethodsWe created Virtual-STEPS, a tool with 40 items categorized into 6 domains (pedestrian infrastructure, traffic calming and streets, building characteristics, bicycling infrastructure, transit, and aesthetics). Items were selected based on their past abilities to predict active living and on their feasibility for a virtual auditing tool. Two raters performed virtual and field audits of street segments in Montreal neighborhoods stratified by the Walkscore that was used to determine the 'walking-friendliness' of a neighborhood. The reliability between virtual and field audits (n?=?40), as well as inter-rater reliability (n?=?60) were assessed using percent agreement, Cohen's Kappa statistic, and the Intra-class Correlation Coefficient.ResultsVirtual audits and field audits (excluding travel time) took similar amounts of time to perform (9.8 versus 8.2?min). Percentage agreement between virtual and field audits, and for inter-rater agreement was 80% or more for the majority of items included in the Virtual-STEPS tool. There was high reliability between virtual and field audits with Kappa and ICC statistics indicating that 20 out of 40 (50.0%) items had almost perfect agreement and 13 (32.5%) items had substantial agreement. Inter-rater reliability was also high with 17 items (42.5%) with almost perfect agreement and 11 (27.5%) items with substantial agreement.ConclusionsVirtual-STEPS is a reliable tool. Tools that measure the micro-scale environment are important because changing this environment could be a relatively cost-effective method of creating environments that are conducive to active living.

Project description:Navigation in virtual worlds is ubiquitous in games and other virtual reality (VR) applications and mainly relies on external controllers. As brain-computer interfaces (BCI)s rely on mental control, bypassing traditional neural pathways, they provide to paralyzed users an alternative way to navigate. However, the majority of BCI-based navigation studies adopt cue-based visual paradigms, and the evoked brain responses are encoded into navigation commands. Although robust and accurate, these paradigms are less intuitive and comfortable for navigation compared to imagining limb movements (motor imagery, MI). However, decoding motor imagery from EEG activity is notoriously challenging. Typically, wet electrodes are used to improve EEG signal quality, including a large number of them to discriminate between movements of different limbs, and a cuedbased paradigm is used instead of a self-paced one to maximize decoding performance. Motor BCI applications primarily focus on typing applications or on navigating a wheelchair-the latter raises safety concerns-thereby calling for sensors scanning the environment for obstacles and potentially hazardous scenarios. With the help of new technologies such as virtual reality (VR), vivid graphics can be rendered, providing the user with a safe and immersive experience; and they could be used for navigation purposes, a topic that has yet to be fully explored in the BCI community. In this study, we propose a novel MI-BCI application based on an 8-dry-electrode EEG setup, with which users can explore and navigate in Google Street View®. We pay attention to system design to address the lower performance of the MI decoder due to the dry electrodes' lower signal quality and the small number of electrodes. Specifically, we restricted the number of navigation commands by using a novel middle-level control scheme and avoided decoder mistakes by introducing eye blinks as a control signal in different navigation stages. Both offline and online experiments were conducted with 20 healthy subjects. The results showed acceptable performance, even given the limitations of the EEG set-up, which we attribute to the design of the BCI application. The study suggests the use of MI-BCI in future games and VR applications for consumers and patients temporarily or permanently devoid of muscle control.

Dataset Information

Virtual audits of the urban streetscape: comparing the inter-rater reliability of GigaPan® to Google Street View.

Publications

Virtual audits of the urban streetscape: comparing the inter-rater reliability of GigaPan® to Google Street View.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets