Inter-American Development Bank
facebook
twitter
youtube
linkedin
instagram
Abierto al públicoBeyond BordersCaribbean Development TrendsCiudades SosteniblesEnergía para el FuturoEnfoque EducaciónFactor TrabajoGente SaludableGestión fiscalGobernarteIdeas MatterIdeas que CuentanIdeaçãoImpactoIndustrias CreativasLa Maleta AbiertaMoviliblogMás Allá de las FronterasNegocios SosteniblesPrimeros PasosPuntos sobre la iSeguridad CiudadanaSostenibilidadVolvamos a la fuente¿Y si hablamos de igualdad?Home
Citizen Security and Justice Creative Industries Development Effectiveness Early Childhood Development Education Energy Envirnment. Climate Change and Safeguards Fiscal policy and management Gender and Diversity Health Labor and pensions Open Knowledge Public management Science, Technology and Innovation  Trade and Regional Integration Urban Development and Housing Water and Sanitation
  • Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer

Abierto al público

  • HOME
    • About
    • Editorial Guidelines
  • CATEGORIES
    • Knowledge Management
    • Open Data
    • Open Learning
    • Open Source
    • Open Systems
  • Authors
  • English
    • Español
open-toolbox-urban-planning

Presenting the Open Urban Planning Toolbox

November 26, 2019 by Patricio Zambrano Barragán - Jordan Fischer - Edgar Lemus 1 Comment


These open-source tools leverage machine learning and crowdsourced data for urban development in Latin America and the Caribbean

“We don’t have data on that.” We hear these words repeatedly while working on urban development projects with cities and countries in Latin America and the Caribbean. This is problematic when we consider the region’s population is already 80% urban. Considering the digital revolution, Latin American and Caribbean cities should be poised to generate, analyze, and disseminate urban data. Yet, all too often, our partners do not have the tools necessary for delivering urban services to informal areas, identifying and allocating lands best suited for development while protecting at-risk areas, and working with individual families to assess and improve housing conditions, among other tasks. Much of the existing technology available to support this work is either too expensive, difficult to use, or not designed for the specific conditions of cities in a developing country.

Open-source tools for Urban Planning in Latin America and the Caribbean

To address these needs, the IDB’s Housing and Urban Development Division (HUD) has developed an Open Urban Planning Toolbox, a set of open-source tools to support each step of the urban development planning process, from early design through implementation and evaluation of projects.

The methods and functions of the tools are mixed; Some use techniques such as machine learning as well as crowdsourced data. Finally, considering the importance of “ground-truthing” or field verification of the data and the understanding of urban challenges at the neighborhood and home level, we have also adapted a digital system of data collection in the field to guarantee information faster and spatially accurate.

All tools included in the toolbox to date are listed below. When a new tool is added, the list will be updated here. The links take you to the sections that describe each tool in more detail:

  1. Building Detection Model
  2. Urban Growth Model
  3. OSM Extraction Tool
  4. OpenMapKit
  5. Housing Deficit Estimator
  6. Georeferenced Program Evaluation (GPE) – NEW!

These tools were developed by leveraging academic and private sector expertise in the context of specific IDB-funded projects. These include projects in Guyana, with the Adequate Housing and Urban Accessibility Program (GY-L1031) and Sustainable Housing for the Hinterland (GY-L1028); and Buenos Aires, Argentina (RG-T3397) within the framework of the Cities Laboratory. Several of these projects have included training and testing sessions between public officials and beneficiary communities to strengthen the development and use of the tools. By sharing the tools through the IDB’s Code for Development initiative, we invite our fellow planners and technologists to use and improve on the Open Urban Planning Toolbox.

1. Identify existing structures with the Building Detection Model

City planners often lack updated digital maps of existing buildings and structures. The Building Detection Model can automatically generate a basic map of buildings from satellite images. It uses semantic segmentation, which is the process of assigning each pixel in an image into a category; in this case, the categories are ‘building’ or ‘not building’. This allows planners to create detailed digital files of hard-to-reach and remote areas, such as the Guyana hinterland, where our partners are currently planning for housing interventions.

On the left, a regular satellite image. On the right, the Building Detection Model colorizes the buildings it has identified.

Beyond generating a map of existing structures, urban and housing agencies can use the model’s results to estimate population size, neighborhood density, access to resources, etc., and as a base across which to extrapolate household level information. In addition, these estimates can help with downstream tasks such as measuring and detecting unplanned/informal urban sprawl, informing planned interventions and the provision of urban ecosystem services to such areas.

The model, which uses machine learning techniques for the basic categorization, was trained on data from Paramaribo (Suriname), Georgetown (Guyana) and Belize City (Belize), all of which have similar climate/vegetation, styles of architecture and patterns of urban sprawl. For improved results, the model should be re-trained for a new city with different topography and sprawl patterns.

Inputs:   Satellite images
Method: Semantic segmentation with Raster Vision
Language: Python
Outputs: Building footprints

View the repository here.

 

2. Project growth with the Urban Growth Model 

While urban growth prediction models are not new, they have historically required significant resources in time, expertise, and calculations. This model automates that process, allowing urban planners to spatially extrapolate the growth of their city under different scenarios (e.g., future population size, different time horizons, sensitivity to restricted areas, degree of randomness, etc.), based on past growth and current land use.

As inputs, the model uses monochrome images with standardized size and boundaries prepared from satellite images of an urban area. These images can be physical maps, density maps, or maps denoting legislative or social boundaries, depending on the conditions of the urban area and the modeler’s discretion. Attraction features will include, for instance, proximity to transit stations, and will be assigned a positive weight; restrictor features will include conditions such as flood-risk or conservation lands and will be assigned a negative weight.

The model allows for the visualization of different growth scenarios, depending on the calibrations and inputs.

Using these inputs, a regularized spatial logistic regression model predicts future urban growth on a pixel-by-pixel level within the determined boundaries, and outputs a binary raster file showing growth.

Inputs: Processed single-feature images
Method: Lasso-regularized spatial logistic regression
Language:  Python
Outputs:  Binary prediction file

View the repository here.

 3. Generate neighborhood-level maps with the OSM Extraction Tool

Even in relatively well-established urban areas, development can take place informally or without complete records. Luckily, OpenStreetMap (OSM) uses crowdsourcing to generate detailed data at the building level. It is not always easy to download this data, however. Previously, an API called Overpass has been used to pull this data, but it requires knowledge of its own specific query language, which can be a significant barrier to urban planners without training in programming.

The tool allows analysts to pull data on specific attributes from a selected area.

Our OSM Extraction Tool eliminates the need to write any code and offers a more user-friendly and intuitive interface to extract relevant shapefiles and fill data gaps. The tool allows users to select specific areas; download detailed maps of roads, buildings, and other features in those areas; and update or add information to existing GIS data. Files downloaded from the OSM Extraction Tool can be conflated (selectively merged) with existing records using JOSM (Java OpenStreetMap) editor.

Inputs: Existing GIS data (if none is available, this tool can still work with no base data)
Language: JavaScript
Outputs: Shapefiles (roads, buildings, waterways, etc.)

View the repository here.

4. Empower digital field data collection with OpenMapKit

Paper records are still quite common for field data collection in many housing agencies, where the infrastructure required to create, implement, manage and maintain survey data often includes paywalls or high levels of technical expertise. OpenMapKit (OMK) solves one of the most immediate needs for government agencies to collect and manage data from the field, incorporating automatic georeferencing into the collection process.

Staff from Guyana’s Central Housing and Planning Authority train for field data collection with OMK.

The kit consists of an Android mobile device and three software components: the OMK Server (which allows users to store and manage survey data), OMK Survey App (which allows users to create and edit digital surveys), and the OpenDataKit (ODK) Collection App (the main interface for users to collect survey data in the field).

Surveys are created in the office with a drag-and-drop interface (including instructions and skip logic) and downloaded onto the enumerator’s android device. Once in the field, the survey can then use all the sensors and functionality available on the phone: text, numbers, photographs, videos, annotations, signatures, etc.; for geospatial data, the software connects directly to the phone’s GPS or allows manual placement of points and polygons directly on a map.

Inputs:   Android phone, Designed survey
Language:  Java
Outputs:  Georeferenced survey results

View the repository here.

5. Housing Deficit Estimator

At the national level, governments may lack recent detailed information on housing needs. Incomplete or out-of-date understanding might result in well-intentioned but wasteful policies that fail to address the most pressing problems. A classic example of this problem is ‘building housing in the desert’, wherein a government spends millions to build more houses far from jobs and services, when in fact residents’ problems would have been much better addressed – and at a much lower cost – had they received subsidies for home improvement in the relatively central locations where they already lived.

Left: Qualitative housing deficit in the surrounding areas of Georgetown, Guyana, 2012 Center: Nocturnal luminosity extracted from satellite imagery of the same geographic area Right: Estimated qualitative housing deficit, 2019

The Housing Deficit Estimator first uses a methodology based on a similar exercise by Colombia’s Department of Statistics (DANE) to numerically standardize the national quantitative and qualitative housing deficit by the smallest available administrative division.

In Guyana, as in many other countries in Latin America and the Caribbean, qualitative housing needs (low-durability materials, lack of access to services, etc) are much more pressing than quantitative needs (the availability of any kind of housing). An association analysis shows which contributors to qualitative deficit are commonly associated with one another.

Finally, using a methodology popularized by the World Bank, the Housing Deficit Estimator uses nocturnal luminosity (‘night lights’) as a proxy for urban built-up environment and infrastructure to estimate qualitative housing needs in years when census data is not available.

Inputs: Census data, nighttime satellite images
Method: Indexing, association analysis, simple regression
Language: R
Outputs: Granular estimates of qualitative housing need

View the repository here.

6. Map and analyze the geographic reach of programs with Georeferenced Program Evaluation (GPE)

Access to resources in cities can vary greatly from neighborhood to neighborhood, often along socioeconomic lines. A successful social program must address these disparities upfront, actively seeking to provide services in areas of the city where resources are typically scarce. This R package provides geographic analysis and visualization of services used within a city, allowing the user to verify if a given program reached neighborhoods where the need is greatest, study patterns of use around the city, and otherwise assess the program’s geographic impact.

Georeferenced evaluation of the Culture Pass project in Buenos Aires.

Developed to analyze the impact of Culture Pass, a program to broaden youth access to the extensive cultural life in Buenos Aires, this R package includes functions that will allow the user to:

  1. Georeference addresses
  2. Obtain base maps of any city’s urban grid
  3. Estimate a matrix of distances between origin and destination
  4. Calculate metrics of frequency, distribution by group, and distance travelled by consumers/beneficiaries to points of sale/access
  5. Create visualizations that explore the difference between frequency and type of consumption by consumer/beneficiary attribute

Inputs:  tabular data with addresses, or “lon” and “lat” columns
Language: R
Outputs: georeferenced locations, program evaluation maps and other visualizations, estimates of distance and delay

View the repository here.

What’s next for the Open Urban Planning Toolbox?

Data-driven urban planning also demands proper modelling and understanding of dynamic urban systems. Upcoming HUD projects will see tools for this kind of contextual analysis added to the Toolbox, including crowd-sourced mobility mapping using General Transit Feed Specification (GTFS), a format that enables open and collaborative use of urban transport data.

Open-source software is made stronger by the community that contributes to it. We welcome users to apply the tools in their own cities, share ideas for improvement, and help identify areas of need that could be addressed with new open-source tools.

As we continue to add to our Toolbox, we will always follow key values: a shared commitment to open data and open-source tech; improved access to cutting-edge techniques, such as artificial intelligence, through active collaboration with global partners; and a focus on the participatory and democratic use of digital technology.

We’d love to hear about successful applications of these tools in the comments below. Also, please feel free to reach out for new opportunities to collaborate at pzambrano@iadb.org. 


Filed Under: Open Source Tagged With: Actionable Resources, Code for Development, Geospatial Data

Patricio Zambrano Barragán

Patricio Zambrano-Barragán was a Housing and Urban Development Specialist at the Inter-American Development Bank. He currently led urban development projects throughout Latin America and the Caribbean, including housing policy and finance projects; resilient urban infrastructure; and geospatial and civic data analytics. Prior to joining the IDB, he led research on territorial management and climate-ready infrastructure at the Massachusetts Institute of Technology and the Natural Resources Defense Council (NRDC). Patricio has worked with the Office of the Deputy Mayor in Quito, Ecuador; with the New York City Department of Housing Preservation and Development (HPD) on distressed asset financing; and as a management consultant with New York-based Katzenbach Partners. Patricio is a doctoral candidate in City and Regional Planning at the University of Pennsylvania, and holds a Master's in City and Regional Planning from the Massachusetts Institute of Technology and a B.A. in Political Science from Yale University.

Jordan Fischer

Jordan Jasuta Fischer trabaja en inteligencia artificial y análisis cognitivo en la división de sector público de IBM. Previamente, se especializaba en proyectos de código abierto, tecnología cívica y análisis geoespacial en Latinoamérica con el BID. Su experiencia en soluciones tecnológicas, gerencia de datos, y análisis avanzado en el campo del desarrollo internacional ha cubierto temas tan diversos como la administración pública, la salud pública, y los derechos humanos. Jordan tiene una maestría en Análisis de Negocios de la Universidad de George Washington y un bachillerato en Economía de la Universidad de Utah.

Edgar Lemus

Edgar is a map-maker and civic technologist with a background in Environmental Science, Policy and Management. At the IDB, he explores strategies in public service innovation in Latin America and the Caribbean. Particularly, through the deployment of open software for geostatistical analysis to improve the technical capacities of local governments, bridge the geographic data gap in the region, and build climate change resiliency.

Reader Interactions

Comments

  1. carlos Itza says

    October 29, 2019 at 5:17 pm

    good software

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Follow Us

Suscríbete

About this blog

Open knowledge is defined as knowledge that is accessible, freely used, and free to its user. This concept is part of a movement that seeks to generate solutions for public good in a collaborative manner. In "Abierto al Público" we explore the use of open knowledge through data, code and other media.

Search

Explorar temas

Access to Information Actionable Resources Artificial Intelligence BIDAcademy Big Data Citizen Participation Climate Change Code for Development Coronavirus Creative Commons Crowdsourcing Data Analysis Data Journalism Data Privacy Data Visualization Development projects Digital Badges Digital Economy Digital Inclusion Entrepeneurship Events Gender and Diversity Geospatial Data Hackathons How to Instructional Design Key Concepts Knowledge Products Lessons Learned Methodologies MOOC Most Read Natural Language Processing Numbers for Development Open Access Open Government Open Innovation Open Knowledge Open Science Solidarity Sustainable Development Goals Teamwork Text Analytics

Similar Posts

  • Getting the most out of your open source software initiative
  • (Re)use that code! Join the IDB Code Expedition
  • Meet BA Obras: an open platform for monitoring public works
  • The IDB is committed to the open source model for development
  • Meet SmartReader, our open-source text analytics tool

Footer

Banco Interamericano de Desarrollo
facebook
twitter
youtube
youtube
youtube

Blog posts written by Bank employees:

Copyright © Inter-American Development Bank ("IDB"). This work is licensed under a Creative Commons IGO 3.0 Attribution-NonCommercial-NoDerivatives. (CC-IGO 3.0 BY-NC-ND) license and may be reproduced with attribution to the IDB and for any non-commercial purpose. No derivative work is allowed. Any dispute related to the use of the works of the IDB that cannot be settled amicably shall be submitted to arbitration pursuant to the UNCITRAL rules. The use of the IDB's name for any purpose other than for attribution, and the use of IDB's logo shall be subject to a separate written license agreement between the IDB and the user and is not authorized as part of this CC- IGO license. Note that link provided above includes additional terms and conditions of the license.


For blogs written by external parties:

For questions concerning copyright for authors that are not IADB employees please complete the contact form for this blog.

The opinions expressed in this blog are those of the authors and do not necessarily reflect the views of the IDB, its Board of Directors, or the countries they represent.

Attribution: in addition to giving attribution to the respective author and copyright owner, as appropriate, we would appreciate if you could include a link that remits back the IDB Blogs website.



Privacy Policy

Copyright © 2023 · Magazine Pro on Genesis Framework · WordPress · Log in

Banco Interamericano de Desarrollo

Aviso Legal

Las opiniones expresadas en estos blogs son las de los autores y no necesariamente reflejan las opiniones del Banco Interamericano de Desarrollo, sus directivas, la Asamblea de Gobernadores o sus países miembros.

facebook
twitter
youtube
This site uses cookies to optimize functionality and give you the best possible experience. If you continue to navigate this website beyond this page, cookies will be placed on your browser.
To learn more about cookies, click here
x
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Non-necessary

Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.

SAVE & ACCEPT