Inter-American Development Bank
facebook
twitter
youtube
linkedin
instagram
Abierto al públicoBeyond BordersCaribbean Development TrendsCiudades SosteniblesEnergía para el FuturoEnfoque EducaciónFactor TrabajoGente SaludableGestión fiscalGobernarteIdeas MatterIdeas que CuentanIdeaçãoImpactoKreatopolisLa Maleta AbiertaMoviliblogMás Allá de las FronterasNegocios SosteniblesPrimeros PasosPuntos sobre la iSeguridad CiudadanaSostenibilidadVolvamos a la fuente ¿Y si hablamos de igualdad?Home
Citizen Security and Justice Creative Industries Development Effectiveness Early Childhood Development Education Energy Envirnment. Climate Change and Safeguards Fiscal policy and management Gender and Diversity Health Labor and pensions Open Knowledge Public management Science, Technology and Innovation  Trade and Regional Integration Urban Development and Housing Water and Sanitation
  • Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer

Impacto

  • HOME
  • CATEGORIES
    • Beyond development effectiveness
    • Evaluation methods and techniques
    • Measuring our performance
    • What does and doesn’t work in development
  • Authors
  • English

Timely thoughts on impact evaluations

March 18, 2014 por Arturo Galindo Leave a Comment


blog arturo tardis

Everyone has great ideas when it comes to designing development projects or policies.

At the drawing board, and with a bit of ideological support, an abundance of ideas are born that could easily improve countless lives. However, these ideas, while sound in theory, don´t always work.  If only there was a time machine to take us to the future to verify the effectiveness of our projects and policies before implementation.

In the British TV show “Doctor Who”, which has been running for over 50 years (talk about an effective intervention!), the main character travels through time and space in a device called the Tardis. With a Tardis, our projects would certainly reach 100% of their development goals and we would be the super champions of development effectiveness.

Unfortunately, economists don’t have such a device. Instead we have economic theory and empirical methods to validate some of our theories and anticipate the results of our projects. Among them are impact evaluations.

In a nutshell, impact evaluations measure the results of an intervention for a certain group of people.  The methodologies frequently used identify changes in any relevant dimension in the population that benefits from an intervention and compares them to a group of people (preferably identical) that did not receive it. This is a way to differentiate ideas that work from the ones that don’t.

However, as economists love to say, there is no free lunch. Impact evaluations, like most activities that are intensive in data collection and analysis, can be expensive.  That’s why it is necessary to use them strategically in activities where it is of particular relevance to enhance accountability (large and very visible projects), where there are notable knowledge gaps, and to evaluate if pilot projects are worth scaling up.

blog arturo infografics

In the last five years the IDB started nearly 150 impact evaluations in different areas. Some of them have been finished and show interesting lessons that can increase the Bank’s development effectiveness.  Among them are evaluations that provide evidence on the effectiveness of projects that could be used to nurture similar discussions in other countries.

The IDB´s recently published annual report, “Development Effectiveness Overview,” highlights these lessons.

For example, a recent evaluation of an employment program in Mexico shows the benefits of properly designing programs that increase formal employment and worker’s income.   These evaluations are useful instruments that contribute to the policy debate in other countries, eventually providing a starting point for similar projects elsewhere.

Other evaluations allow us to verify if certain interventions are in fact, reaching their intended development goals.  For instance, a frequent intervention is to provide loans to SMEs through a country’s development banks.

This is a common practice, but there is little evidence of its effectiveness. A set of evaluations carried out with Bancoldex, a Colombian development bank, has helped to close the knowledge gap by showing that these types of loans increase employment, productivity, investment, and income in the SMEs that receive them.

While we do not have a time machine like the Tardis that would allow us to be completely certain on the impact of our work, we do have increasingly reliable instruments to guide us through the world of development effectiveness.

 


Filed Under: Measuring our performance Tagged With: Bancoldex, DEO 2013, Development Effectiveness Overview, Dr. Who, impact, Inter-American Development Bank, Mexico, TARDIS

Arturo Galindo

Arturo José Galindo is Division Chief of Strategic Planning and Monitoring at the Office of Strategic Planning and Development Effectiveness at the Interamerican Development Bank.

Reader Interactions

Comments

  1. Mani says

    March 18, 2014 at 3:11 pm

    Brilliant!

    Reply
  2. Mani says

    March 18, 2014 at 3:11 pm

    Brilliant!

    Reply
  3. David McKenzie says

    March 18, 2014 at 6:22 pm

    This sounds interesting, but it would be useful if you could link to the evaluations you discuss instead to just stories about them. The links to the employment program in Mexico and to the Colombia work are just to glossy stories, which claim impact evaluation shows success, but there is no discussion of what impact evaluation method was used, what the time frame of results were, etc. Links to the actual impact evaluation studies would be appreciated.

    Reply
    • Arturo Galindo says

      March 19, 2014 at 8:15 am

      Thanks for the comment David. In the story on Colombia in the webpage that is linked to the post, you will find a link to the Bancoldex impact evaluation and to other relevant information on the project. This is at the at the end of the page. I noted that we missed the link to the ones on Mexico, but they will be added shortly.

      Reply
    • Arturo Galindo says

      March 20, 2014 at 5:44 pm

      David, while the get posted in the page the links to the evaluations of Mexico are the following:
      i.Impact evaluation to the subprogram “Bécate”
      http://idbdocs.iadb.org/wsdocs/getdocument.aspx?docnum=38685632
      ii.Impact evaluation of the “Employment Support Program (PAE)”
      http://idbdocs.iadb.org/wsdocs/getdocument.aspx?docnum=38685628

      Reply
  4. David McKenzie says

    March 18, 2014 at 6:22 pm

    This sounds interesting, but it would be useful if you could link to the evaluations you discuss instead to just stories about them. The links to the employment program in Mexico and to the Colombia work are just to glossy stories, which claim impact evaluation shows success, but there is no discussion of what impact evaluation method was used, what the time frame of results were, etc. Links to the actual impact evaluation studies would be appreciated.

    Reply
    • Arturo Galindo says

      March 19, 2014 at 8:15 am

      Thanks for the comment David. In the story on Colombia in the webpage that is linked to the post, you will find a link to the Bancoldex impact evaluation and to other relevant information on the project. This is at the at the end of the page. I noted that we missed the link to the ones on Mexico, but they will be added shortly.

      Reply
    • Arturo Galindo says

      March 20, 2014 at 5:44 pm

      David, while the get posted in the page the links to the evaluations of Mexico are the following:
      i.Impact evaluation to the subprogram “Bécate”
      http://idbdocs.iadb.org/wsdocs/getdocument.aspx?docnum=38685632
      ii.Impact evaluation of the “Employment Support Program (PAE)”
      http://idbdocs.iadb.org/wsdocs/getdocument.aspx?docnum=38685628

      Reply
  5. Chelsea says

    March 22, 2014 at 12:26 pm

    Dear Mr. Galindo,

    As someone interested in development projects in Latin America and a fan of Doctor Who, I never thought I would see those two things in the same article.

    With that being said, I think the blog post is a really interesting perspective on impact evaluations and how they ultimately effect program policies, especially with the Mexican and Colombian cases. I would love to learn more.

    Reply
  6. Chelsea says

    March 22, 2014 at 12:26 pm

    Dear Mr. Galindo,

    As someone interested in development projects in Latin America and a fan of Doctor Who, I never thought I would see those two things in the same article.

    With that being said, I think the blog post is a really interesting perspective on impact evaluations and how they ultimately effect program policies, especially with the Mexican and Colombian cases. I would love to learn more.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Follow Us

Subscribe

Search

About this blog

This blog highlights effective ideas in the fight against poverty and exclusion, and analyzes the impact of development projects in Latin America and the Caribbean.

Categories

Footer

Banco Interamericano de Desarrollo
facebook
twitter
youtube
youtube
youtube

Blog posts written by Bank employees:

Copyright © Inter-American Development Bank ("IDB"). This work is licensed under a Creative Commons IGO 3.0 Attribution-NonCommercial-NoDerivatives. (CC-IGO 3.0 BY-NC-ND) license and may be reproduced with attribution to the IDB and for any non-commercial purpose. No derivative work is allowed. Any dispute related to the use of the works of the IDB that cannot be settled amicably shall be submitted to arbitration pursuant to the UNCITRAL rules. The use of the IDB's name for any purpose other than for attribution, and the use of IDB's logo shall be subject to a separate written license agreement between the IDB and the user and is not authorized as part of this CC- IGO license. Note that link provided above includes additional terms and conditions of the license.


For blogs written by external parties:

For questions concerning copyright for authors that are not IADB employees please complete the contact form for this blog.

The opinions expressed in this blog are those of the authors and do not necessarily reflect the views of the IDB, its Board of Directors, or the countries they represent.

Attribution: in addition to giving attribution to the respective author and copyright owner, as appropriate, we would appreciate if you could include a link that remits back the IDB Blogs website.



Privacy Policy

Derechos de autor © 2021 · Magazine Pro en Genesis Framework · WordPress · Log in

Banco Interamericano de Desarrollo

Aviso Legal

Las opiniones expresadas en estos blogs son las de los autores y no necesariamente reflejan las opiniones del Banco Interamericano de Desarrollo, sus directivas, la Asamblea de Gobernadores o sus países miembros.

facebook
twitter
youtube