Inter-American Development Bank
facebook
twitter
youtube
linkedin
instagram
Abierto al públicoBeyond BordersCaribbean Development TrendsCiudades SosteniblesEnergía para el FuturoEnfoque EducaciónFactor TrabajoGente SaludableGestión fiscalGobernarteIdeas MatterIdeas que CuentanIdeaçãoImpactoIndustrias CreativasLa Maleta AbiertaMoviliblogMás Allá de las FronterasNegocios SosteniblesPrimeros PasosPuntos sobre la iSeguridad CiudadanaSostenibilidadVolvamos a la fuente¿Y si hablamos de igualdad?Home
Citizen Security and Justice Creative Industries Development Effectiveness Early Childhood Development Education Energy Envirnment. Climate Change and Safeguards Fiscal policy and management Gender and Diversity Health Labor and pensions Open Knowledge Public management Science, Technology and Innovation  Trade and Regional Integration Urban Development and Housing Water and Sanitation
  • Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer

Impacto

  • HOME
  • CATEGORIES
    • Beyond development effectiveness
    • Evaluation methods and techniques
    • Measuring our performance
    • What does and doesn’t work in development
  • Authors
  • English
    • Español

Try, learn, iterate, adapt

November 21, 2013 por Autor invitado Leave a Comment


Lant Pritchett’s alternative road to development effectiveness

by Gastón Gertner*

Is my work at IDB so far from this road?

A few weeks ago, I sat at an Impact Evaluation Seminar organized by the Office of Evaluation & Oversight at the Inter-American Development Bank. Lant Pritchett delivered a provocative presentation: a sassy cocktail mix equally balanced in wit, irony and insights about development effectiveness. From the outset he seized everyone’s attention in the room with a simple question: is impact evaluation just a fad or a useful tool for development? His skepticism on the use of randomized controlled trials as a tool for development effectiveness draws on an array of different arguments, some new, others from ideas I have already heard in the past here.

Lant claims there are four problems with RCTs in how they lead to development effectiveness:

  1.  Policy improvements in the world come out from national development (having markets in place and increasing state capacity). Since national development is impervious to RCTs, the use of experiments by themselves will not deliver development on its own.
  2. There’s no empirical model of how the world works that guarantees that reforms and policies are put in place according to evidence found through RCTs.
  3. Even when we know the right intervention for a certain policy, limited capacity in developing countries to implement these polices transform RCTs into a futile exercise.
  4. Randomistas are wrong about how people, governments and agencies learn and change their behavior. Just because an RCT shows an effective intervention working, it doesn’t mean that it translates into the immediate implementation of this new policy.

In any case, and whatever your opinions are on these critiques, Lant Lant did not stop there. As promised, he continued his presentation looking forward, introducing an approach that shows how organizations that aim for development effectiveness should look like. His Problem-Driven Iterative Adaptation (PDIA) model puts the identification of problems and the quest for solutions at the center of development effectiveness.

And as he is going through the slides I’m wondering: “Wait, isn’t this exactly what we are doing at the IDB?”

Let’s break down the PDIA model:

1. Local Solutions for Local Problems

– Lant says: Don’t pretend to know the solution, start out with the problem, for example: how can we reduce crime? Increase children learning at schools?

– me at IDB: …I’m involved in a study on how to increase households’ take-up rate in connecting their bathrooms to the public sewage network in Santa Cruz de la Sierra, Bolivia. We plan to help the Government in Bolivia in testing “possible solutions” without claiming we know the answer.

2. Pushing Problem Driven Positive Deviance

– Lant says: …Consider contextual challenges; take small steps that facilitate positive deviations through an incremental approach.

– me at IDB: …(in the same sanitation project evaluation mentioned before), we are taking step by step interventions – a promotion campaign, use of incentives – that are assessed progressively, one at a time, to see how these mechanisms operate in making households connect to the sewage.

3. Try, Learn, Iterate, Adapt

– Lant says: …Use monitoring and rigorous experiential learning to allow on-the ground reality to shape the content of the policy

– me at IDB: …I’m part of an evaluation for a 2nd phase of a community based nutrition program in El Alto, Bolivia in which continuous monitoring of the intervention will inform program delivery performance on the ground, making adaptation possible.

4. Scale Learning through Diffusion

– Lant says: …Bridge agents with power with those of ideas (for effective policy design)

– me at IDB:…for the evaluations I’ve been involved in, we dedicate time to build partnerships, disseminate our results in seminars, learn from what works and track for innovative policy designs at low scale to test them, while bringing in top head decision makers.

I remember when the panel ended, I left the room puzzled, filled with questions while craving for immediate answers. Writing this blog has been a useful introspective exercise to look for some of those answers.

Finally, I’m finding out my work here is already venturing into Lant Pritchett’s roads to development effectiveness.

* Gastón Gertner is an economist at the Office of Strategic Planning and Development Effectiveness at the IADB


Filed Under: Evaluation methods and techniques Tagged With: Effectiveness, Lant Pritchett, OVE

Autor invitado

Reader Interactions

Comments

  1. steve heighway says

    December 17, 2013 at 5:44 pm

    >1. Local Solutions for Local Problems
    Who’s working with you on the project? In my experience with IDB projects, this isn’t the case. Normally the project is designed by IDB with international consultants brought in to implement the project. I wonder how many IDB projects are led by international or country consultants? Maybe this is limited to the Caribbean where I have experience, where the excuse is that there isn’t enough in-country expertise.

    Reply
    • Avatar photoFrancisco Mejía says

      January 7, 2014 at 8:53 am

      Steve

      Thanks for your comment. We are increasingly relying on local capacity to develop our projects, while implementation is almost always in the hands of the relevant government agency. In fact, we do have, since our realignment a few years back, stronger local offices staffed with local professionals. International experience is key in many projects and it is important for us to bring it to bare when relevant.

      Reply
  2. steve heighway says

    December 17, 2013 at 5:44 pm

    >1. Local Solutions for Local Problems
    Who’s working with you on the project? In my experience with IDB projects, this isn’t the case. Normally the project is designed by IDB with international consultants brought in to implement the project. I wonder how many IDB projects are led by international or country consultants? Maybe this is limited to the Caribbean where I have experience, where the excuse is that there isn’t enough in-country expertise.

    Reply
    • Avatar photoFrancisco Mejía says

      January 7, 2014 at 8:53 am

      Steve

      Thanks for your comment. We are increasingly relying on local capacity to develop our projects, while implementation is almost always in the hands of the relevant government agency. In fact, we do have, since our realignment a few years back, stronger local offices staffed with local professionals. International experience is key in many projects and it is important for us to bring it to bare when relevant.

      Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Follow Us

Subscribe

Search

About this blog

This blog highlights effective ideas in the fight against poverty and exclusion, and analyzes the impact of development projects in Latin America and the Caribbean.

Categories

Footer

Banco Interamericano de Desarrollo
facebook
twitter
youtube
youtube
youtube

    Blog posts written by Bank employees:

    Copyright © Inter-American Development Bank ("IDB"). This work is licensed under a Creative Commons IGO 3.0 Attribution-NonCommercial-NoDerivatives. (CC-IGO 3.0 BY-NC-ND) license and may be reproduced with attribution to the IDB and for any non-commercial purpose. No derivative work is allowed. Any dispute related to the use of the works of the IDB that cannot be settled amicably shall be submitted to arbitration pursuant to the UNCITRAL rules. The use of the IDB's name for any purpose other than for attribution, and the use of IDB's logo shall be subject to a separate written license agreement between the IDB and the user and is not authorized as part of this CC- IGO license. Note that link provided above includes additional terms and conditions of the license.


    For blogs written by external parties:

    For questions concerning copyright for authors that are not IADB employees please complete the contact form for this blog.

    The opinions expressed in this blog are those of the authors and do not necessarily reflect the views of the IDB, its Board of Directors, or the countries they represent.

    Attribution: in addition to giving attribution to the respective author and copyright owner, as appropriate, we would appreciate if you could include a link that remits back the IDB Blogs website.



    Privacy Policy

    Derechos de autor © 2025 · Magazine Pro en Genesis Framework · WordPress · Log in

    Banco Interamericano de Desarrollo

    Aviso Legal

    Las opiniones expresadas en estos blogs son las de los autores y no necesariamente reflejan las opiniones del Banco Interamericano de Desarrollo, sus directivas, la Asamblea de Gobernadores o sus países miembros.

    facebook
    twitter
    youtube
    This site uses cookies to optimize functionality and give you the best possible experience. If you continue to navigate this website beyond this page, cookies will be placed on your browser.
    To learn more about cookies, click here
    X
    Manage consent

    Privacy Overview

    This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
    Necessary
    Always Enabled
    Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
    Non-necessary
    Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
    SAVE & ACCEPT