Inter-American Development Bank
facebook
twitter
youtube
linkedin
instagram
Abierto al públicoBeyond BordersCaribbean Development TrendsCiudades SosteniblesEnergía para el FuturoEnfoque EducaciónFactor TrabajoGente SaludableGestión fiscalGobernarteIdeas MatterIdeas que CuentanIdeaçãoImpactoIndustrias CreativasLa Maleta AbiertaMoviliblogMás Allá de las FronterasNegocios SosteniblesPrimeros PasosPuntos sobre la iSeguridad CiudadanaSostenibilidadVolvamos a la fuente¿Y si hablamos de igualdad?Home
Citizen Security and Justice Creative Industries Development Effectiveness Early Childhood Development Education Energy Envirnment. Climate Change and Safeguards Fiscal policy and management Gender and Diversity Health Labor and pensions Open Knowledge Public management Science, Technology and Innovation  Trade and Regional Integration Urban Development and Housing Water and Sanitation
  • Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer

Ideas Matter

  • HOME
  • CATEGORIES
    • Behavioral Economics
    • Environment and Climate Change
    • Macroeconomics and Finance
    • Microeconomics and Competitiveness
    • Politics and Institutions
    • Social Issues
  • Authors
  • Spanish

When Big Data and Machine Learning Spur Development Efforts

July 24, 2020 by Jennifer Linares Leave a Comment


In October 2016, Hurricane Matthew made landfall in Haiti, flooding coasts, destroying crops, killing livestock, washing away roads and bridges, and destroying around 200,000 homes. International organizations, including the Inter-American Development Bank (IDB) and the World Bank, rushed to supply immediate assistance. However, long-term recovery in the most affected regions of the country was further impeded by a lack of up-to-date, subnational socioeconomic indicators that would reveal which municipalities were most affected and what kind of development efforts were most needed.

This information deficit in Haiti’s case is directly related to the fact that the last nationwide census had been carried out more than a decade before, in 2003, and the last household survey, in 2012, mostly because of the large expense of conducting such data collection efforts. That meant there was little up-to-date information detailing poverty and inequality at the sub-departmental level, making social investment efforts for both the government and international agencies especially challenging.

A Widespread Problem of Insufficient Data

The problem is not limited to Haiti, of course. Throughout the developing world, including many countries in Latin America and the Caribbean, the expense of carrying out censuses and household surveys (estimated at US$105 per household in Latin America and the Caribbean) has limited efforts to acquire the information that would allow for targeted and more effective recovery efforts after crises. And that need, already great in Latin America and the Caribbean because of frequent climate-related disasters, has grown exponentially with the Covid-19 pandemic. Far more territorially detailed data for assisting vulnerable households is required amidst the economic devastation wrought by the disease outbreak.

The good news is that by combining the latest techniques in big data with information taken from cellphones and imagery from satellites or airplanes, data scientists can update the information from household surveys at a relatively low cost, disaggregate it to the municipal or sub-municipal level, and provide highly detailed snapshots of poverty and inequality needed by government authorities and international organizations.

Big Data Techniques at Work in Haiti

A recent study of poverty and inequality in Haiti by the IDB using such techniques shows how that can be done. For the study, researchers created a computational, machine learning framework in which data from the 2003 census was combined with that from the 2012 household survey (ECVMAS), allowing algorithms to find common patterns. This procedure allowed for researchers to obtain 2012 poverty and inequality estimates at the commune (roughly municipality) level. These were previously unavailable as ECVMAS has a sample that is only valid at the department level.

The resulting estimates were then used to validate the second procedure, which consisted of combining aerial imagery from 2014 as well as anonymized mobile phone data from 2015-2017 and feeding them into a machine learning system to give a much more up-to-date idea of the current situation. Aerial images, for example, reveal from the quality of roofs, buildings, and other characteristics which areas are poorest, while showing which parts of the rural heartland are suffering agriculturally from erosion, the quality of vegetation, and other factors. Call detail records, supplied by telephone companies, complement that information, bringing to light different levels of wealth from callers’ mobility, the diversity of their contacts, and other factors associated with social and economic opportunities.

Similarly, a second set of socioeconomic estimates were done for 2019 using free satellite images from Google, which allow for the extraction of features similar to those found in aerial images. All this information, entered into a system made increasingly sophisticated by machine learning, allowed for a geographically detailed, current view of what was happening in Haiti between 2014 and 2019, permitting researchers to create dynamic maps of poverty and inequality for use by policymakers.

Figure 1: Map of Poverty in Haiti at the Commune Level (2019)

Map of Poverty in Haiti at the Commune Level

The effort showed, among other things, that the better performing, wealthier communes were located in the Ouest department, where Port-au-Prince is located; that some communes in the southern departments are now among the most impoverished compared to the rest, possibly due to the effects of Hurricane Matthew; and that the situation for some communes in the northwest is becoming ever more dire compared to the rest of the communes, probably because of the severe food security situation in that region, a result of climate shocks, social unrest, and other factors that have been documented by the World Food Programme. This is information that would not have been available from the census 17 years ago or the last household survey eight years ago. Moreover, by pinpointing where the most vulnerable people currently live in the country, it provides the potential basis for prioritizing cash transfer programs and other social interventions, a particularly important contribution given the government’s limited fiscal space during the Covid-19 pandemic.

It should be pointed out the information has only been fully validated through 2014 and needs final validation for 2019, and that these state-of-the-art techniques in no way substitute for censuses and household surveys that provide the essential data on which all else is based. Nonetheless, as a recent study using similar techniques in Belize shows, they are widely applicable. They are relatively inexpensive, and they have many potential uses beyond just measuring poverty and inequality. The aerial imagery and cellphone data employed, for example, can also show disruption in transportation networks, the existence of informal settlements, rural-to-city migration, and myriad other factors crucial for long-term development efforts.

Figure 2: Map of Main Roads in Haiti Using Mobile Phone Data

Map of Main Roads in Haiti Using Mobile Phone Data

A Potential Breakthrough for Policymakers

Governments in the developing world, including Latin America and the Caribbean, often confront a dilemma. They must choose between conducting expensive census and household surveys to acquire accurate socioeconomic indicators and using that money for social investment. This sets up a vicious circle, given that accurate socioeconomic indicators are also essential to effective social interventions. The new techniques involving big data and machine learning provide a way out, allowing for up-to-date, accurate, and geographically detailed snapshots of social conditions between the large-scale efforts that censuses and household surveys entail. They help eliminate the significant time lag in data collecting and could amount to a breakthrough for policymakers in the region.


Jennifer Linares is a Country Economist at the Inter-American Development Bank, where she is responsible for the macroeconomic monitoring of Haiti and the management of all knowledge products related to this country. Over the past five years, she has worked at the IDB in several roles, including Economics Consultant for the Department of Central America, Haiti, Mexico, Panama, and the Dominican Republic (CID) and Economics Consultant at the IDB country office in Panama. Prior to joining the IDB, Jennifer worked as an Economist and Research Analyst at Florida TaxWatch Research Institute where she was in charge of research related to state competitiveness and the effectiveness of several state programs. Jennifer holds a Master’s in Economics from Florida State University.


Filed Under: Uncategorized Tagged With: #BigData

Jennifer Linares

Jennifer Linares is a Country Economist at the Inter-American Development Bank, where she is responsible for the macroeconomic monitoring of Haiti and the management of all knowledge products related to this country. Over the past five years, she has worked at the IDB in several roles, including Economics Consultant for the Department of Central America, Haiti, Mexico, Panama, and the Dominican Republic (CID) and Economics Consultant at the IDB country office in Panama. Prior to joining the IDB, Jennifer worked as an Economist and Research Analyst at Florida TaxWatch Research Institute where she was in charge of research related to state competitiveness and the effectiveness of several state programs. Jennifer holds a Master's in Economics from Florida State University.

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Follow Us

Subscribe

Search

Related posts

  • The DIA that Never Ends
  • “The Wire” as a Mirror of Intergenerational Inequality
  • Coronavirus Survey Results Show Big Impacts, Linkages between Labor Markets and Inequality
  • IDB Opens Doors to Promising Young Research Assistants
  • How the Fall in Remittances During the Pandemic Threatens Regional Wellbeing

About this blog

The blog of the IDB's Research Department shares ideas that matter on public policy and development in Latin America and the Caribbean.

Footer

Banco Interamericano de Desarrollo
facebook
twitter
youtube
youtube
youtube

    Blog posts written by Bank employees:

    Copyright © Inter-American Development Bank ("IDB"). This work is licensed under a Creative Commons IGO 3.0 Attribution-NonCommercial-NoDerivatives. (CC-IGO 3.0 BY-NC-ND) license and may be reproduced with attribution to the IDB and for any non-commercial purpose. No derivative work is allowed. Any dispute related to the use of the works of the IDB that cannot be settled amicably shall be submitted to arbitration pursuant to the UNCITRAL rules. The use of the IDB's name for any purpose other than for attribution, and the use of IDB's logo shall be subject to a separate written license agreement between the IDB and the user and is not authorized as part of this CC- IGO license. Note that link provided above includes additional terms and conditions of the license.


    For blogs written by external parties:

    For questions concerning copyright for authors that are not IADB employees please complete the contact form for this blog.

    The opinions expressed in this blog are those of the authors and do not necessarily reflect the views of the IDB, its Board of Directors, or the countries they represent.

    Attribution: in addition to giving attribution to the respective author and copyright owner, as appropriate, we would appreciate if you could include a link that remits back the IDB Blogs website.



    Privacy Policy

    Copyright © 2025 · Magazine Pro on Genesis Framework · WordPress · Log in

    Banco Interamericano de Desarrollo

    Aviso Legal

    Las opiniones expresadas en estos blogs son las de los autores y no necesariamente reflejan las opiniones del Banco Interamericano de Desarrollo, sus directivas, la Asamblea de Gobernadores o sus países miembros.

    facebook
    twitter
    youtube
    This site uses cookies to optimize functionality and give you the best possible experience. If you continue to navigate this website beyond this page, cookies will be placed on your browser.
    To learn more about cookies, click here
    X
    Manage consent

    Privacy Overview

    This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
    Necessary
    Always Enabled
    Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
    Non-necessary
    Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
    SAVE & ACCEPT