Inter-American Development Bank
facebook
twitter
youtube
linkedin
instagram
Abierto al públicoBeyond BordersCaribbean Development TrendsCiudades SosteniblesEnergía para el FuturoEnfoque EducaciónFactor TrabajoGente SaludableGestión fiscalGobernarteIdeas MatterIdeas que CuentanIdeaçãoImpactoIndustrias CreativasLa Maleta AbiertaMoviliblogMás Allá de las FronterasNegocios SosteniblesPrimeros PasosPuntos sobre la iSeguridad CiudadanaSostenibilidadVolvamos a la fuente¿Y si hablamos de igualdad?Home
Citizen Security and Justice Creative Industries Development Effectiveness Early Childhood Development Education Energy Envirnment. Climate Change and Safeguards Fiscal policy and management Gender and Diversity Health Labor and pensions Open Knowledge Public management Science, Technology and Innovation  Trade and Regional Integration Urban Development and Housing Water and Sanitation
  • Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer

Impacto

  • HOME
  • CATEGORIES
    • Beyond development effectiveness
    • Evaluation methods and techniques
    • Measuring our performance
    • What does and doesn’t work in development
  • Authors
  • English
    • Español

How to evaluate a tourism reform without a time machine?

March 15, 2016 por Autor invitado Leave a Comment


Endowed with rich and diverse natural and cultural resources, Argentina’s Salta Province has long been known to have tremendous but untapped tourism potential.

salta argentina
San Francisco Church, Salta, Argentina. Image by Kevin Jones. Creative Commons License.

Located at the intersection of such natural attractions as the Andean highland plateau (the Puna), the Chaco forests, and the subtropical forest in the Yungas Biosphere Reserve, Salta’s landscape is graced with everything from colorful hillsides to sparkling ravines, mountain peaks, volcanoes, and salt flats.

Salta also boasts significant cultural wealth, including Indigenous and aboriginal communities, colonial heritage, archaeological sites, and even cave paintings from the precolonial period. The monumental Tren a las Nubes (Train to the Clouds) is one of the highest railways in the world.

Despite its attributes, Salta remained one of Argentina’s least developed provinces well into the early 2000s, with GDP per capita about half the national average (US$4,000 versus US$7,500 in 2001). Salta’s tourism industry lagged behind the rest of the country, as well.

The devaluation of the peso in 2001 presented an opportunity to boost tourism because it lowered the cost of visiting Argentina relative to other international destinations. Salta’s provincial government moved to take advantage by implementing a Tourism Development Policy (TDP), with coordinated interventions to boost the province’s tourism industry, and in so doing create new employment opportunities for the local population. The TDP measures included:

  • Building and modernizing tourism and transport infrastructure, including highways to access the city of Salta, the international airport, and bus terminals
  • Restoration of historical and cultural heritage sites
  • Tax credits for building, expanding, and remodeling hotels and other tourism facilities
  • An increased budget for the Tourism Secretariat, which was eventually elevated to the status of a ministry, allowing for the creation of a public-private Provincial Tourism Council, and the launch of an integrated promotion campaign at the national and international levels.
On the way to Mina Julia, Salta, Argentina. Imagen de rodoluca88. Licencia Creative Commons.
On the way to Mina Julia, Salta, Argentina. Image by rodoluca88. Creative Commons License.

The Inter-American Development Bank (IDB) supported the TDP with a loan to the province of Salta specifically directed toward supporting the tourism industry.

The TDP had all the ingredients to turn around Salta’s flagging tourism industry, but measuring the effectiveness of structural interventions like this has long been a riddle for evaluators. In an ideal world, they would travel back in time, erase the intervention, and measure the difference in the result, which would become what is known as the “counterfactual” to what actually happened.

In the absence of such a time machine, evaluators usually set up an artificial “control group” and then measure the results of the intervention against that comparator—not unlike a medical study that administers a drug to one group and a placebo to another and then compares the results to determine the effectiveness of the drug.

In the case of a broad policy such as the TDP, which involves a wide variety of economic agents across the tourism industry and a broad set of interventions at different levels, constructing a control group to estimate a counterfactual is highly challenging.

One possibility is to focus the evaluation only on those policy elements (such as tax credits) for which beneficiaries and comparable non-beneficiaries can be identified. This would produce rigorous evidence on the effectiveness of such elements, but at the cost of missing the structural and complex nature of the policy.

The indian village of Iruya on the Argentina andes
The indian village of Iruya on the Argentina andes

Another possibility is to adopt a structural model approach, such as a computable general equilibrium model, in which most of the relationships between different parties would be simulated.

This would better account for the comprehensive nature of the policy, but at the cost of less rigor in identifying the causal relationship between the policy and the observed effects.

To deal with this tradeoff between completeness and rigor, the IDB used a new measurement approach developed by Harvard University’s Alberto Abadie and his co-authors, called the Synthetic Control Method (SCM).

The SCM statistically combines other Argentine provinces to construct its fictional comparator—a sort of “clone province” that approximates the characteristics of Salta as closely as possible. If only a single province were selected as a comparator, it might be very similar to Salta in terms of its tourism potential, but perhaps very different in terms of per capita income levels or other characteristics.

Using the SCM enabled evaluators to construct a comparator similar to Salta across the board.

Impact Evaluation of Salta’s Tourism Development Policy

Using the SCM and drawing on data from Argentina’s Observatory of Employment and Entrepreneurial Dynamics, evaluators created not only one, but two “synthetic clones”—one for the province as described above, based on a weighted combination of other Argentinean provinces that in the seven years before the TDP’s launch had trends similar to Salta, and another for the Argentine tourism sector in general, based on a combination of different industries within the province. This evaluation has been the first to use two separate clones.

The evaluation found that Salta’s TDP increased employment in the hotel industry by an average of 11 percent per year, for an overall impact of around 110 percent between 2003 and 2013.

Over the same period, the TDP doubled employment in the core sector of the tourism industry, which likely generated other positive employment effects on sectors upstream and downstream along the tourism value chain. Importantly, the evaluation results were consistent in the comparisons with both synthetic clones.

The IDB’s rigorous evaluation of Salta’s TDP shows that integrated efforts to produce structural change across a number of areas in a specific industry can effectively boost the growth of that industry.

The evaluation also shows that complex structural programs can indeed be evaluated in a much more rigorous manner than the traditionally used case study approach.

This also opens the door to using the same approach with the creation of multiple synthetic control units to evaluate programs with a dual industry-location focus, such as the widely diffused cluster development programs.

This story is part of Chapter 6: In Search of Attribution – Our Impact Evaluations, Developmet Effectiveness Overview.


Filed Under: What does and doesn't work in development Tagged With: Argentina, DEO, DEO 2014, IDB, impact evaluation, Inter-American Development Bank, Latin America, Salta, tourism, Tourism impact

Autor invitado

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Follow Us

Subscribe

Search

About this blog

This blog highlights effective ideas in the fight against poverty and exclusion, and analyzes the impact of development projects in Latin America and the Caribbean.

Categories

Footer

Banco Interamericano de Desarrollo
facebook
twitter
youtube
youtube
youtube

Blog posts written by Bank employees:

Copyright © Inter-American Development Bank ("IDB"). This work is licensed under a Creative Commons IGO 3.0 Attribution-NonCommercial-NoDerivatives. (CC-IGO 3.0 BY-NC-ND) license and may be reproduced with attribution to the IDB and for any non-commercial purpose. No derivative work is allowed. Any dispute related to the use of the works of the IDB that cannot be settled amicably shall be submitted to arbitration pursuant to the UNCITRAL rules. The use of the IDB's name for any purpose other than for attribution, and the use of IDB's logo shall be subject to a separate written license agreement between the IDB and the user and is not authorized as part of this CC- IGO license. Note that link provided above includes additional terms and conditions of the license.


For blogs written by external parties:

For questions concerning copyright for authors that are not IADB employees please complete the contact form for this blog.

The opinions expressed in this blog are those of the authors and do not necessarily reflect the views of the IDB, its Board of Directors, or the countries they represent.

Attribution: in addition to giving attribution to the respective author and copyright owner, as appropriate, we would appreciate if you could include a link that remits back the IDB Blogs website.



Privacy Policy

Derechos de autor © 2023 · Magazine Pro en Genesis Framework · WordPress · Log in

Banco Interamericano de Desarrollo

Aviso Legal

Las opiniones expresadas en estos blogs son las de los autores y no necesariamente reflejan las opiniones del Banco Interamericano de Desarrollo, sus directivas, la Asamblea de Gobernadores o sus países miembros.

facebook
twitter
youtube
This site uses cookies to optimize functionality and give you the best possible experience. If you continue to navigate this website beyond this page, cookies will be placed on your browser.
To learn more about cookies, click here
X
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Non-necessary

Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.

SAVE & ACCEPT