Assessing streetscape greenery with deep neural network using Google Street View.
Ontology highlight
ABSTRACT:
SUBMITTER: Kameoka T
PROVIDER: S-EPMC8987839 | biostudies-literature | 2022 Mar
REPOSITORIES: biostudies-literature
Publications
Assessing streetscape greenery with deep neural network using Google Street View.
Kameoka Taishin T Uchida Atsuhiko A Sasaki Yu Y Ise Takeshi T
Breeding science 20220225 1
The importance of greenery in urban areas has traditionally been discussed from ecological and esthetic perspectives, as well as in public health and social science fields. The recent advancements in empirical studies were enabled by the combination of 'big data' of streetscapes and automated image recognition. However, the existing methods of automated image recognition for urban greenery have problems such as the confusion of green artificial objects and the excessive cost of model training. T ...[more]
Similar Datasets
Project description:Virtual audits using Google Street View are an increasingly popular method of assessing neighborhood environments for health and urban planning research. However, the validity of these studies may be threatened by issues of image availability, image age, and variance of image age, particularly in the Global South. This study identifies patterns of Street View image availability, image age, and image age variance across cities in Latin America and assesses relationships between these measures and measures of resident socioeconomic conditions. Image availability was assessed at 530,308 near-road points within the boundaries of 371 Latin American cities described by the SALURBAL (Salud Urbana en America Latina) project. At the subcity level, mixed-effect linear and logistic models were used to assess relationships between measures of socioeconomic conditions and image availability, average image age, and the standard deviation of image age. Street View imagery was available at 239,394 points (45.1%) of the total sampled, and rates of image availability varied widely between cities and countries. Subcity units with higher scores on measures of socioeconomic conditions had higher rates of image availability (OR = 1.11 per point increase of combined index, p < 0.001) and the imagery was newer on average (- 1.15 months per point increase of combined index, p < 0.001), but image capture date within these areas varied more (0.59-month increase in standard deviation of image age per point increase of combined index, p < 0.001). All three assessed threats to the validity of Street View virtual audit studies spatially covary with measures of socioeconomic conditions in Latin American cities. Researchers should be attentive to these issues when using Street View imagery.
| S-EPMC7392983 | biostudies-literature
Project description:Gentrification is multidimensional and complex, but there is general agreement that visible changes to neighbourhoods are a clear manifestation of the process. Recent advances in computer vision and deep learning provide a unique opportunity to support automated mapping or 'deep mapping' of perceptual environmental attributes. We present a Siamese convolutional neural network (SCNN) that automatically detects gentrification-like visual changes in temporal sequences of Google Street View (GSV) images. Our SCNN achieves 95.6% test accuracy and is subsequently applied to GSV sequences at 86110 individual properties over a 9-year period in Ottawa, Canada. We use Kernel Density Estimation (KDE) to produce maps that illustrate where the spatial concentration of visual property improvements was highest within the study area at different times from 2007-2016. We find strong concordance between the mapped SCNN results and the spatial distribution of building permits in the City of Ottawa from 2011 to 2016. Our mapped results confirm those urban areas that are known to be undergoing gentrification as well as revealing areas undergoing gentrification that were previously unknown. Our approach differs from previous works because we examine the atomic unit of gentrification, namely, the individual property, for visual property improvements over time and we rely on KDE to describe regions of high spatial intensity that are indicative of gentrification processes.
| S-EPMC6415887 | biostudies-literature
Project description:BACKGROUND:Although previous research has highlighted the association between the built environment and individual health, methodological challenges in assessing the built environment remain. In particular, many researchers have demonstrated the high inter-rater reliability of assessing large or objective built environment features and the low inter-rater reliability of assessing small or subjective built environment features using Google Street View. New methods for auditing the built environment must be evaluated to understand if there are alternative tools through which researchers can assess all types of built environment features with high agreement. This paper investigates measures of inter-rater reliability of GigaPan®, a tool that assists with capturing high-definition panoramic images, relative to Google Street View. METHODS:Street segments (n?=?614) in Pittsburgh, Pennsylvania in the United States were randomly selected to audit using GigaPan® and Google Street View. Each audit assessed features related to land use, traffic and safety, and public amenities. Inter-rater reliability statistics, including percent agreement, Cohen's kappa, and the prevalence-adjusted bias-adjusted kappa (PABAK) were calculated for 106 street segments that were coded by two, different, human auditors. RESULTS:Most large-scale, objective features (e.g. bus stop presence or stop sign presence) demonstrated at least substantial inter-rater reliability for both methods, but significant differences emerged across finely detailed features (e.g. trash) and features at segment endpoints (e.g. sidewalk continuity). After adjusting for the effects of bias and prevalence, the inter-rater reliability estimates were consistently higher for almost all built environment features across GigaPan® and Google Street View. CONCLUSION:GigaPan® is a reliable, alternative audit tool to Google Street View for studying the built environment. GigaPan® may be particularly well-suited for built environment projects with study settings in areas where Google Street View imagery is nonexistent or updated infrequently. The potential for enhanced, detailed imagery using GigaPan® will be most beneficial in studies in which current, time sensitive data are needed or microscale built environment features would be challenging to see in Google Street View. Furthermore, to better understand the effects of prevalence and bias in future reliability studies, researchers should consider using PABAK to supplement or expand upon Cohen's kappa findings.
| S-EPMC7422490 | biostudies-literature
Project description:BackgroundResearch indicates that neighborhood environment characteristics such as physical disorder influence health and health behavior. In-person audit of neighborhood environments is costly and time-consuming. Google Street View may allow auditing of neighborhood environments more easily and at lower cost, but little is known about the feasibility of such data collection.PurposeTo assess the feasibility of using Google Street View to audit neighborhood environments.MethodsThis study compared neighborhood measurements coded in 2008 using Street View with neighborhood audit data collected in 2007. The sample included 37 block faces in high-walkability neighborhoods in New York City. Field audit and Street View data were collected for 143 items associated with seven neighborhood environment constructions: aesthetics, physical disorder, pedestrian safety, motorized traffic and parking, infrastructure for active travel, sidewalk amenities, and social and commercial activity. To measure concordance between field audit and Street View data, percentage agreement was used for categoric measures and Spearman rank-order correlations were used for continuous measures.ResultsThe analyses, conducted in 2009, found high levels of concordance (≥80% agreement or ≥0.60 Spearman rank-order correlation) for 54.3% of the items. Measures of pedestrian safety, motorized traffic and parking, and infrastructure for active travel had relatively high levels of concordance, whereas measures of physical disorder had low levels. Features that are small or that typically exhibit temporal variability had lower levels of concordance.ConclusionsThis exploratory study indicates that Google Street View can be used to audit neighborhood environments.
| S-EPMC3031144 | biostudies-literature
Project description:Mapping species spatial distribution using spatial inference and prediction requires a lot of data. Occurrence data are generally not easily available from the literature and are very time-consuming to collect in the field. For that reason, we designed a survey to explore to which extent large-scale databases such as Google maps and Google Street View could be used to derive valid occurrence data. We worked with the Pine Processionary Moth (PPM) Thaumetopoea pityocampa because the larvae of that moth build silk nests that are easily visible. The presence of the species at one location can therefore be inferred from visual records derived from the panoramic views available from Google Street View. We designed a standardized procedure allowing evaluating the presence of the PPM on a sampling grid covering the landscape under study. The outputs were compared to field data. We investigated two landscapes using grids of different extent and mesh size. Data derived from Google Street View were highly similar to field data in the large-scale analysis based on a square grid with a mesh of 16 km (96% of matching records). Using a 2 km mesh size led to a strong divergence between field and Google-derived data (46% of matching records). We conclude that Google database might provide useful occurrence data for mapping the distribution of species which presence can be visually evaluated such as the PPM. However, the accuracy of the output strongly depends on the spatial scales considered and on the sampling grid used. Other factors such as the coverage of Google Street View network with regards to sampling grid size and the spatial distribution of host trees with regards to road network may also be determinant.
| S-EPMC3794037 | biostudies-literature
Project description:The United States spends more than $250 million each year on the American Community Survey (ACS), a labor-intensive door-to-door study that measures statistics relating to race, gender, education, occupation, unemployment, and other demographic factors. Although a comprehensive source of data, the lag between demographic changes and their appearance in the ACS can exceed several years. As digital imagery becomes ubiquitous and machine vision techniques improve, automated data analysis may become an increasingly practical supplement to the ACS. Here, we present a method that estimates socioeconomic characteristics of regions spanning 200 US cities by using 50 million images of street scenes gathered with Google Street View cars. Using deep learning-based computer vision techniques, we determined the make, model, and year of all motor vehicles encountered in particular neighborhoods. Data from this census of motor vehicles, which enumerated 22 million automobiles in total (8% of all automobiles in the United States), were used to accurately estimate income, race, education, and voting patterns at the zip code and precinct level. (The average US precinct contains ∼1,000 people.) The resulting associations are surprisingly simple and powerful. For instance, if the number of sedans encountered during a drive through a city is higher than the number of pickup trucks, the city is likely to vote for a Democrat during the next presidential election (88% chance); otherwise, it is likely to vote Republican (82%). Our results suggest that automated systems for monitoring demographics may effectively complement labor-intensive approaches, with the potential to measure demographics with fine spatial resolution, in close to real time.
| S-EPMC5740675 | biostudies-literature
Project description:BackgroundStreet imagery is a promising and growing big data source providing current and historical images in more than 100 countries. Studies have reported using this data to audit road infrastructure and other built environment features. Here we explore a novel application, using Google Street View (GSV) to predict travel patterns at the city level.MethodsWe sampled 34 cities in Great Britain. In each city, we accessed 2000 GSV images from 1000 random locations. We selected archived images from time periods overlapping with the 2011 Census and the 2011-2013 Active People Survey (APS). We manually annotated the images into seven categories of road users. We developed regression models with the counts of images of road users as predictors. The outcomes included Census-reported commute shares of four modes (combined walking plus public transport, cycling, motorcycle, and car), as well as APS-reported past-month participation in walking and cycling.ResultsWe found high correlations between GSV counts of cyclists ('GSV-cyclists') and cycle commute mode share (r = 0.92)/past-month cycling (r = 0.90). Likewise, GSV-pedestrians was moderately correlated with past-month walking for transport (r = 0.46), GSV-motorcycles was moderately correlated with commute share of motorcycles (r = 0.44), and GSV-buses was highly correlated with commute share of walking plus public transport (r = 0.81). GSV-car was not correlated with car commute mode share (r = -0.12). However, in multivariable regression models, all outcomes were predicted well, except past-month walking. The prediction performance was measured using cross-validation analyses. GSV-buses and GSV-cyclists are the strongest predictors for most outcomes.ConclusionsGSV images are a promising new big data source to predict urban mobility patterns. Predictive power was the greatest for those modes that varied the most (cycle and bus). With its ability to identify mode of travel and capture street activity often excluded in routinely carried out surveys, GSV has the potential to be complementary to new and traditional data. With half the world's population covered by street imagery, and with up to 10 years historical data available in GSV, further testing across multiple settings is warranted both for cross-sectional and longitudinal assessments.
| S-EPMC5931639 | biostudies-literature
Project description:BackgroundAltering micro-scale features of neighborhood walkability (e.g., benches, sidewalks, and cues of social disorganization or crime) could be a relatively cost-effective method of creating environments that are conducive to active living. Traditionally, measuring the micro-scale environment has required researchers to perform observational audits. Technological advances have led to the development of virtual audits as alternatives to observational field audits with the enviable properties of cost-efficiency from elimination of travel time and increased safety for auditors. This study examined the reliability of the Virtual Systematic Tool for Evaluating Pedestrian Streetscapes (Virtual-STEPS), a Google Street View-based auditing tool specifically designed to remotely assess micro-scale characteristics of the built environment.MethodsWe created Virtual-STEPS, a tool with 40 items categorized into 6 domains (pedestrian infrastructure, traffic calming and streets, building characteristics, bicycling infrastructure, transit, and aesthetics). Items were selected based on their past abilities to predict active living and on their feasibility for a virtual auditing tool. Two raters performed virtual and field audits of street segments in Montreal neighborhoods stratified by the Walkscore that was used to determine the 'walking-friendliness' of a neighborhood. The reliability between virtual and field audits (n = 40), as well as inter-rater reliability (n = 60) were assessed using percent agreement, Cohen's Kappa statistic, and the Intra-class Correlation Coefficient.ResultsVirtual audits and field audits (excluding travel time) took similar amounts of time to perform (9.8 versus 8.2 min). Percentage agreement between virtual and field audits, and for inter-rater agreement was 80% or more for the majority of items included in the Virtual-STEPS tool. There was high reliability between virtual and field audits with Kappa and ICC statistics indicating that 20 out of 40 (50.0%) items had almost perfect agreement and 13 (32.5%) items had substantial agreement. Inter-rater reliability was also high with 17 items (42.5%) with almost perfect agreement and 11 (27.5%) items with substantial agreement.ConclusionsVirtual-STEPS is a reliable tool. Tools that measure the micro-scale environment are important because changing this environment could be a relatively cost-effective method of creating environments that are conducive to active living.
| S-EPMC6734502 | biostudies-literature
Project description:People are increasingly concerned with understanding their personal environment, including possible exposure to harmful air pollutants. In order to make informed decisions on their day-to-day activities, they are interested in real-time information on a localized scale. Publicly available, fine-scale, high-quality air pollution measurements acquired using mobile monitors represent a paradigm shift in measurement technologies. A methodological framework utilizing these increasingly fine-scale measurements to provide real-time air pollution maps and short-term air quality forecasts on a fine-resolution spatial scale could prove to be instrumental in increasing public awareness and understanding. The Google Street View study provides a unique source of data with spatial and temporal complexities, with the potential to provide information about commuter exposure and hot spots within city streets with high traffic. We develop a computationally efficient spatiotemporal model for these data and use the model to make short-term forecasts and high-resolution maps of current air pollution levels. We also show via an experiment that mobile networks can provide more nuanced information than an equally-sized fixed-location network. This modeling framework has important real-world implications in understanding citizens' personal environments, as data production and real-time availability continue to be driven by the ongoing development and improvement of mobile measurement technologies.
| S-EPMC7953849 | biostudies-literature
Project description:In face-to-face household surveys, field interviewers are sometimes asked to make notes of characteristics of the dwelling unit on the sampled address as well as its surroundings before making contact with a household member living at the sample address. Field interviewer observations of this kind are used to improve efficiency of field data collection and to be used as nonresponse adjustment. However, field interviewer observations can be expensive and the quality of observations needs to be improved. Recently, survey organizations start to utilize Google Street View to conduct virtual observations of the dwelling unit and the neighborhood. This paper reports a feasibility study that evaluates the feasibility of using virtual observations, assesses its agreement with field interviewer observation results, and examine whether virtual observations correlate with survey response status and survey estimates. We found moderate to high agreements between virtual and interviewer observation results. We also found that some observation results are significantly related to response status and survey estimates. However, virtual observations using GSV have coverage issues, which could limit their potential use.
| S-EPMC11293716 | biostudies-literature