Inter-American Development Bank
facebook
twitter
youtube
linkedin
instagram
Abierto al públicoBeyond BordersCaribbean Development TrendsCiudades SosteniblesEnergía para el FuturoEnfoque EducaciónFactor TrabajoGente SaludableGestión fiscalGobernarteIdeas MatterIdeas que CuentanIdeaçãoImpactoIndustrias CreativasLa Maleta AbiertaMoviliblogMás Allá de las FronterasNegocios SosteniblesPrimeros PasosPuntos sobre la iSeguridad CiudadanaSostenibilidadVolvamos a la fuente¿Y si hablamos de igualdad?Home
Citizen Security and Justice Creative Industries Development Effectiveness Early Childhood Development Education Energy Envirnment. Climate Change and Safeguards Fiscal policy and management Gender and Diversity Health Labor and pensions Open Knowledge Public management Science, Technology and Innovation  Trade and Regional Integration Urban Development and Housing Water and Sanitation
  • Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer

Ideas Matter

  • HOME
  • CATEGORIES
    • Behavioral Economics
    • Environment and Climate Change
    • Macroeconomics and Finance
    • Microeconomics and Competitiveness
    • Politics and Institutions
    • Social Issues
  • Authors
  • Spanish
Big data urban research cities Latin America public policy Caribbean

Big Data: New Opportunities and Challenges for Urban Research

March 23, 2020 by Juan Pablo Chauvin Leave a Comment


Fifteen years ago, researchers were restricted to using surveys, censuses and basic administrative data when they examined cities and local policies. But those methods have real limitations. Surveys can be prohibitively expensive. Censuses may be out of date and administrative data often fail to represent the population as a whole.

Today, we live in a radically different world. New technologies, ranging from cell phones, smart cards, and social media, to motion sensors, drones, and Google searches and images, offer huge amounts of granular, real time information. That has revolutionized the possibilities for learning about everything from housing and transport to inter-city trade. It has vastly expanded the opportunities for understanding and improving the urban environment.

New privacy challenges

These new opportunities, however, present significant new challenges. Perhaps the most consequential is that the acquisition and use of greatly expanded amounts and types of information can run up against privacy concerns. Data from cell phones’ call logs, motion sensors, and global positioning systems (GPS), to cite one example, can reveal where people live and work, where they shop, whom they meet with, and what kind of transport and routes they use as they move about. Such data, can, in short, expose intimate and personal details that most people would rather keep to themselves.

The trick for researchers is finding ways to use the information to improve public policy while walking the delicate line that ensures that people’s identities are protected.

A solution implemented by various institutions that handle sensitive data from the public, such as the United States Census Bureau, is to operate special data centers where researchers can use large data sets from state and federal agencies in a highly controlled environment that ensures that identities are not revealed. Such facilities could be set up or expanded in government institutions around Latin America, at universities, and at multilateral banks. The possibilities for urban research with such protections in place—and their potential benefits for better policy interventions—are enormous.

Cities around the world are starting to seize some of these opportunities. A few such cases were presented last September in a workshop at the 6th Urbanization and Poverty Reduction Research Conference, co-organized by the IDB, the World Bank, George Washington University and the International Growth Centre.

Big data improves local governance

The local government in Cape Town, South Africa, for example, has implemented a comprehensive data strategy in recent years. This has involved investing in computing infrastructure along with skilled personnel and introducing innovations such a data “sandbox.”  This is a space where rich databases from multiple sources are made available to data scientists and engineers for use in tackling policy problems in areas ranging from labor markets to climate change adaptation.

This data-driven approach has already proved of critical importance. When in 2017 the city faced the possibility of running out of water, it integrated information from dam level sensors and household water meters with customized infographics for individual households to nudge them towards more sustainable consumption and avert the consequences of drought. The city government has also used a combination of satellite, demographic, and historical data on land invasions to predict the probability of specific plots of land being occupied by squatters.

In Lagos, Nigeria, large databases have similarly helped the local government to eliminate unneeded traffic junctions and roundabouts as well as build pedestrian bridges and optimize the design of the Bus Rapid Transit System. Meanwhile, local authorities have introduced passenger information systems, which allow users to retrieve valuable information from their phones, including the location of buses and their predicted departures and arrivals. Those improvements have relieved traffic congestion and led to monetary and travel savings.

There is much more to learn. We can now use satellite readings of urban luminosity to measure the intensity of local economic activity in different areas of a city; credit card data to better understand the location of economic activity across and within cities, and social networks to tap into public sentiment, including the possibility of better understanding the emergence of violent protests, such as those that broke out in Latin America last year.

The challenges of privacy protection in Latin America

Not all of this is based on confidential information, of course. But much of it is, and the risks of violating privacy became glaringly evident in September 2019 when the breach of an unsecured server run by a marketing and analytics firm revealed copious amounts of data on nearly every citizen in Ecuador, including their names, dates of birth, tax identification numbers and employment information.

To their credit, several Latin American countries, including Brazil, Chile, Argentina and Mexico have embarked on reforms intended to put their General Data Protection Regulations (GDPRs) in line with those of the European Union, and, in the process, enhance trade with EU partners. As a recent IDB analysis reveals, Brazil passed a bill in 2018 that creates a national data protection authority. The law also obligates firms and public agencies handling public data to appoint a data protection officer and imposes fines of up to 2% of a group’s gross revenues for noncompliance. Mexico, which passed a data protection law in 2012, prosecuted more than 140 cases between June 2012 and June 2017, fining violating companies about $17 million.

Solutions like the creation of specialized data centers—with the rigorous protocols for anonymity like those required by the US Census Bureau and similar institutions around the world—fit right in with this trend. If established more widely at research universities, multilateral institutions, and other research centers, they would allow researchers to use the big data available in Latin American and Caribbean cities to both help individual countries and extract important conclusions about region-wide social and economic dynamics. They could speed innovations in urban policy while protecting the privacy rights of individual citizens.


Filed Under: Microeconomics and Competitiveness Tagged With: #BigData

Juan Pablo Chauvin

Juan Pablo Chauvin is a Research Economist in the Research Department of the Inter-American Development Bank. He is also an associate at the Center for International Development at Harvard University. His research focuses on the economic development of cities and regions, with a focus on understanding the connections between labor markets, housing markets, and the industrial composition of places. In the past, he has been a consultant with the German Technical Cooperation Agency (GiZ), the World Bank, the OECD and the private sector; advising local and national governments in South America, Asia, the MENA region and South East Europe. He has also been an instructor at the Harvard Kennedy School and at Ecuadorian Universities. He holds a PhD in Public Policy and a Masters in Public Administration - International Development from Harvard, a Masters in Public Policy from FLACSO - Ecuador, and B.A.s in Sociology and Economics from Universidad San Francisco de Quito.

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Follow Us

Subscribe

Search

Related posts

  • Trust: An Obstacle and an Opportunity for Digital Transformation
  • Climate Change, Migration and the Urban Housing and Labor Markets
  • What Can City Governments in Latin America Do to Improve Public Health?
  • Can AI Technologies Help Expand Credit Access?
  • Maximizing the Potential of Urban Migration in Latin America and the Caribbean

About this blog

The blog of the IDB's Research Department shares ideas that matter on public policy and development in Latin America and the Caribbean.

Footer

Banco Interamericano de Desarrollo
facebook
twitter
youtube
youtube
youtube

    Blog posts written by Bank employees:

    Copyright © Inter-American Development Bank ("IDB"). This work is licensed under a Creative Commons IGO 3.0 Attribution-NonCommercial-NoDerivatives. (CC-IGO 3.0 BY-NC-ND) license and may be reproduced with attribution to the IDB and for any non-commercial purpose. No derivative work is allowed. Any dispute related to the use of the works of the IDB that cannot be settled amicably shall be submitted to arbitration pursuant to the UNCITRAL rules. The use of the IDB's name for any purpose other than for attribution, and the use of IDB's logo shall be subject to a separate written license agreement between the IDB and the user and is not authorized as part of this CC- IGO license. Note that link provided above includes additional terms and conditions of the license.


    For blogs written by external parties:

    For questions concerning copyright for authors that are not IADB employees please complete the contact form for this blog.

    The opinions expressed in this blog are those of the authors and do not necessarily reflect the views of the IDB, its Board of Directors, or the countries they represent.

    Attribution: in addition to giving attribution to the respective author and copyright owner, as appropriate, we would appreciate if you could include a link that remits back the IDB Blogs website.



    Privacy Policy

    Copyright © 2025 · Magazine Pro on Genesis Framework · WordPress · Log in

    Banco Interamericano de Desarrollo

    Aviso Legal

    Las opiniones expresadas en estos blogs son las de los autores y no necesariamente reflejan las opiniones del Banco Interamericano de Desarrollo, sus directivas, la Asamblea de Gobernadores o sus países miembros.

    facebook
    twitter
    youtube
    This site uses cookies to optimize functionality and give you the best possible experience. If you continue to navigate this website beyond this page, cookies will be placed on your browser.
    To learn more about cookies, click here
    X
    Manage consent

    Privacy Overview

    This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
    Necessary
    Always Enabled
    Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
    Non-necessary
    Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
    SAVE & ACCEPT