Oportunidades

Oportunidades (English: Opportunities) (Now rebranded as Prospera) is a government social assistance (welfare) program in Mexico founded in 2002, based on a previous program called Progresa, created in 1997.[1] It is designed to target poverty by providing cash payments to families in exchange for regular school attendance, health clinic visits, and nutritional support.[2] Oportunidades is credited with decreasing poverty and improving health and educational attainment in regions in which it has been deployed.[3]

Key features of Oportunidades include:

Oportunidades has become a model for programs instituted in other countries, such as a pilot program in New York City, the Opportunity NYC [1] and the Social Protection Network in Nicaragua. Other countries that have instituted similar conditional cash transfer programs include Brazil, Peru, Honduras, Jamaica, Chile, Malawi and Zambia.[4]

The Political Organization of Progresa-Oportunidades

Progresa-Oportunidades is designed to be a centrally run program that relies on a horizontal integration of programs and services among the various agencies and ministries within the executive branch. This required the establishment of a body with enough power to coordinate the participants in the program and monitor the budget.[6] Instead of restructuring an old agency, it was decided to form a new agency with all of the appropriate powers and the backing from the president.

Although this provided for an easier and faster startup, it also meant that many of the related agency structures, which Progresa-Oportunidades would have to rely upon for its future sustainability, were incompatible with the new program. Officials in related structures such as the Ministry of Health and Education were not provided with the appropriate incentives to channel their work towards Progresa-Oportunidades. Many were individuals who had worked on earlier poverty programs and who now saw their resources shifting in a new direction. Also, officials often had more to gain politically from abandoning this program and starting a new one.[6]

As a centrally administered program, Oportunidades allows for low operational costs and a greater level of efficiency in the transmission of benefits directly to the participants in the program. The program has sometimes been criticized for this completely “top down” approach. However, the lack of community participation in the identification of beneficiaries and the allocation of funding also helps to limit the opportunities for corruption at the local level, which has traditionally been a problem with such government-funded programs.[6]

Information Strategies

To effectively disseminate information about the program, Progresa-Oportunidades pursued a “three-pronged” information strategy. First, an extensive amount of information was made generally available through the Internet. Secondly, information also provided to Congress and other government officials at all levels in the form of detailed budget proposals, program evaluations, and other relevant documents. Finally, public relations campaigns were initially minimal to avoid raised public expectations. However, since 2006, the public profile of the program has been raised, particularly through extensive radio and television advertisements.[6]

Transparency and Accountability in Progresa-Oportunidades

Traditionally, most anti-poverty programs in Mexico have relied upon presidential support to establish their funding and public profile. Although Oportunidades originally was no different in its dependence upon Zedillo to support its startup costs, much effort has since been made to establish an image of Progresa-Oportunidades as existing independently of the president and party politics, to heighten chances it would survive transfers of power in the executive branch. Several congressional provisions have helped to ensure this identity. Among these are several provisions that prevent the program being used for political proselytizing. Also, in 2000 and 2003, program officials were prohibited from signing up new beneficiaries within six months of national elections in order to prevent vote buying from taking place. In addition, budget provisions have been enacted that attempt to directly communicate with program beneficiaries to educate them about rights and responsibilities regarding the program.[6]

Progresa-Oportunidades under Political Transitions

The transition between the Zedillo and Fox administrations was a crucial test of the long-term sustainability of Progresa-Oportunidades. President Fox’s administration achieved early public recognition for its commitment to anti-poverty strategies as well as its willingness to continue with earlier initiatives that had already proved to be successful. Also, Fox ultimately decided to continue with the program because the independent image of the program meant that it had not become identified with the old ruling party (the PRI) or with former President Zedillo in the eyes of the public. In addition, Fox had received confirmation of the program’s benefits both from the program’s own impact evaluations and outside international financial institutions who all held the program in high esteem and hoped to see it continue.[6]

Effectiveness of Oportunidades

Oportunidades has been hailed as a success by many actors both in Mexico and globally. The first round of evaluations were carried out by the prestigious International Food Policy Research Institute (IFPRI), between 1997 and 2000. The #IFPRI-Progresa partnership played a large role in shaping Mexican social policy, and in bringing the Randomized controlled trial (RCT) to the forefront of policy evaluation worldwide.

Since 2002, the Instituto Nacional de Salud Pública (National Public Health Institute, INSP) and the Centro de Investigaciones y Estudios Superiores en Antropología Social (Center for Research and Higher Studies in Social Anthropology, CIESAS) have been responsible for carrying out ongoing evaluations of both program operations and impact. The Oportunidades evaluation website contains a relatively comprehensive listing of the documents and databases produced during all of the evaluation rounds.


IFPRI-Progresa

Communications between IFPRI and Progresa's leadership commenced in late 1997,[7] with the final contract ($2.5 million USD)[8] signed during the third quarter of 1998.[9] The IFPRI-Progresa research team's overall objective was to "determine if Progresa was functioning in practice as it [was] intended to by design."[10] The evaluation was divided between 'operational' evaluation (is the program being carried out according to the design?) and 'impact' evaluation (is the program having the intended effect on the target population?). Without discounting the importance of the operational evaluation, this article focuses exclusively on the impact evaluation, which received far greater attention and had a much broader audience. The impact evaluation also involved the production of far more technical documents, reports, and later, published journal articles and books.

The results of IFPRI's initial evaluations began to form into reports in late 1999 and early 2000; most final reports (18 in total) were submitted before the end of 2000, with the executive synthesis report published on September 1st of that year. The thematic core of the IFPRI evaluations conformed to the three program components: health, education, and nutrition.[11] In these areas, Progresa increased school enrollment,[12] lowered incidence of disease in children,[13] and increased growth for young children receiving nutritional supplements.[14] In sum "in the central impact areas...the results [were] encouraging."[15]

Methodology

According to the bulk of literature describing IFPRI-Progresa, the project was the first large-scale social policy evaluation implemented in a ‘developing’ country context to use the Randomized controlled trial (RCT) research design. In the now perennial debates surrounding the RCT as a tool of social policy evaluation IFPRI-Progresa provided (and continues to provide) an important proof-of-concept, an example exalted by proponents and held aloft before critics.

Sampling Design

Original sample selection took place in mid-1997.[16] All available information indicates that personnel at SEDESOL undertook and directed the actual process prior to the arrival of most of the IFPRI research team.

One of the most detailed accounts is as follows:

"The design of the impact evaluation of Progresa in communities and households is quasi-experimental...To undertake this component of the evaluation, a random sample of communities with 'high' or 'very high' degrees of marginalization were selected which would be incorporated into the program during Phase II (November 1997) and which would serve as the [treatment] communities...Another sample of communities with similar characteristics was randomly designated from those that could have been the object of later selection, and that could function as controls...the size of the sample was estimated starting from a universe of 4,546 localities to choose 330 base localities, and from a universe of 1,850 to choose 191 control localities, using a distribution proportional to the size of the locality.”[17]


Attrition

Attrition bias is a well-known issue in quantitative study designs which can create a situation "analytically similar"[18] to selection bias in that "attrition lead[s] to selective [read: systematically different] samples."[19] "The IFPRI evaluation did not follow up migrants as part of the evaluation surveys,"[20] and yet by November 2000, 17% of households and 29% of individuals from the original November 1997 sample were no longer in the survey.[21] Moreover "attrition differ[ed] significantly between treatment and control groups, even after controlling for household characteristics and the eligibility criteria." [22] The presence of nonrandom attrition indicates that even if the samples were experimentally selected and statistically equivalent to begin with, by the end of the experiment period they would have been significantly unequal.

As opposed to selection bias, which features prominently in the IFPRI-Progresa documentation, only two final reports mention attrition bias (which, recall, creates essentially the same problem as selection bias from an analytic point of view). Schultz (2000) carries out analyses of enrollment using both a "panel sample" (households with data across all five survey rounds) and "pooled sample" (households with data in at least one survey round). While admitting that "it is not possible to implement a satisfactory sample-selection-correction model,"[23] the word 'attrition' appears only once. The rest of the report frames the use of both samples as a form of robustness testing. This framing turns attention away from attrition bias, instead highlighting the dual-sample testing as a strength of the analysis. Behrman and Todd (1999) discuss attrition more extensively.

Contamination

Here, contamination refers to the possibility that "families or individuals from control localities or other localities [can] immigrate to treatment group localities in order to receive program services." (although the term can refer to several other concepts)[24] As with attrition bias, the decision to not track down sample out-migrants makes any quantification of this bias impossible. For later survey rounds, however, the outlook is worrisome: "The rapid expansion of the program, even before households in the original control communities started receiving transfers, meant that control communities often literally were surrounded by other communities that were already receiving them. Under such circumstances, it is likely that households in the control communities may have expected to receive [Progresa] transfers before they actually started to receive them, which complicates interpretation of the estimated program effects."[25]

Changing Eligibility Requirements

The targeting mechanisms Progresa employed were the subject of much discussion and varied across time. To summarize, Progresa targeted beneficiaries using a three-tiered mechanism: (1) the selection of marginal communities according to specially-developed marginality index, (2) the selection of poor households using a multidimensional poverty line, and (3) community validation of the list of beneficiaries at a town meeting.[26]

The weighting of different household characteristics in the calculations of household (not community) eligibility was modified during mid-1999, between the IFPRI-Progresa surveys, a process dubbed densificación or densification (in response to "the tendency of the [targeting] method to classify as beneficiaries households with more children and to exclude smaller households or older households that have no young children,"[27]). These adjustments shifted the definition of 'poor'/eligible households and increased the number of eligible households in the sample from 53% to 78% in the treatment group, and from 50% to 78% in the control group.[28] As of November 1999, when the final round of ENCEL surveys was conducted, "819 of the 3023 densified households [27% of those added through densification, 3% of the overall sample] had been incorporated."[29] Three of the final evaluation studies define 'eligible' households as only the group originally chosen for incorporation (pre-densification). Ten others employ the post-densification criteria, and finally two more experiment with both.[30]

Wider Influence of IFPRI-Progresa

IFPRI-Progresa catalyzed a number of changes in Mexican governance and global international development agendas.

By the time Progresa began to form in the heads of Mexican social policy designers, the controversy surrounding the long rule of the Partido Revolucionario Institucional (Institutional Revolutionary Party, PRI) and its social policies was already entrenched. Under 'New Federalism,' president Ernesto Zedillo (1994-2000) was attempting to de-politicized social programs. One of the paramount objectives at the core of Progresa’s development, therefore, was to establish the program's apolitical status by sustaining it through the presidential switch in 2000. Vicente Fox Quesada, leader of the Partido Acción Nacional (National Action Party, PAN), won the presidential elections on July 2nd, 2000, and took office on December 1st.[31] The IFPRI final reports were released primarily during this interval. Program supporters used the transition period to convince skeptical parties in the new administration of Progresa' effectiveness through personal contact, meetings, and media reports.[32]

Due to the IFPRI evaluations, Progresa gained political hardiness and funding sources, while evaluation became a codified part of Mexican social programming. Fox not only continued the program, but expanded it significantly into urban areas.[33] A loan for the amount of US$1B from the Inter-American Development Bank (IDB) for the expansion of the program was negotiated during 2001, and disbursed beginning in 2002.[34] In 2003, the Ley General de Desarollo Social (General Law of Social Development, LGDS) explicitly codified the requirement for independent evaluation for all federally-run Mexican social programs[35] and for this purpose established the Consejo Nacional de Evaluación (National Council on Evaluation, CONEVAL).[36]

The excitement for the new program spread not only through Mexico, but through the IDB and World Bank.[37] Both of these organizations extensively employed the example of IFPRI-Progresa to forward both CCTs and EBP (via rigorous evaluation of social programs). The World Bank featured the program as a model in the 2004 Conference on Poverty in Shanghai,[38] and in 2006 the former President James D. Wolfensohn commented "Progresa’s rigorous emphasis on evaluation has set a standard for poverty reduction programs in the developing world."[39] The evaluation remains one of the programs' most celebrated features, having "inspired many others in Latin America and other regions." [40]

CCTs worldwide have drawn from the Oportunidades' model, often through direct consultation with its designers and managers. Numerous subsequent evaluations of both Oportunidades and other CCT programs have corroborated the positive effects found in the results found by IFPRI-Progresa.[41]

See also

References

  1. ↑ 1.0 1.1 1.2 1.3 Paying for Better Parenting - New York Times Accessed 12/07/06
  2. ↑ 2.0 2.1 Mexico's Oportunidades Program Accessed 12/07/06
  3. ↑ Bulletin of the World Health Organization - Reaching Mexico's poorest Accessed 12/07/06
  4. ↑ 4.0 4.1 Lessons offered by Latin American cash transfer programmes, Mexico’s Oportunidades and Nicaragua's SPN. Implications for African countries Accessed 12/07/06
  5. ↑ SEDESOL - Oportunidades Accessed 12/07/06
  6. ↑ 6.0 6.1 6.2 6.3 6.4 6.5 Levy, S. (2006): Progress Against Poverty: Sustaining Mexico's Progresa-Oportunidades Program, Washington, D.C., Brookings Institution Press.
  7. ↑ Jere Behrman, "Policy-Oriented Research Impact Assessment (PORIA) Case Study on the International Food Policy Research Institute (IFPRI) and the Mexican PROGRESA Anti-Poverty and Human Resource Investment Conditional Cash Transfer Program," IFPRI (2007), p. 19-20.
  8. ↑ Susan W. Parker and Graciela Teruel. “Randomization and Social Program Evaluation: The Case of Progresa.” The ANNALS of the American Academy of Political and Social Science 599, no. 1 (May 1, 2005): 210.
  9. ↑ Jere Behrman, “Policy-Oriented Research Impact Assessment (PORIA) Case Study,” 38
  10. ↑ Emmanuel Skoufias, Is PROGRESA Working? Summary of the Results of an Evaluation by IFPRI, (Washington, DC: IFPRI, 2000), 9.
  11. ↑ Greenspun, “Assessing Mexico’s Anti-Poverty Program ‘Oportunidades’: Combining and Comparing Objective and interview-Based Indicators,” Tulane University, 2011, 23.
  12. ↑ T. Paul Schultz, Final Report on the Impact of PROGRESA on School Enrollment. Evaluation (Washington, DC: IFPRI, 2000), 34-36.
  13. ↑ Paul Gertler, Final Report: The Impact of PROGRESA on Health (Washington, DC: IFPPRI, 2000), 14.
  14. ↑ Jere R. Behrman and John Hoddinott, An Evaluation of the Impact of PROGRESA on Pre-School Child Height (Washington, DC: IFPRI, 2000), 20.
  15. ↑ Emannuel Skoufias, Is Progresa Working? (Washington, DC: IFPRI, 2000), 4.
  16. ↑ "IFPRI’s active involvement in the evaluation of Progresa started in July 1998, more than one year after the selection of the evaluation sample by PROGRESA authorities.” Emmanuel Skoufias, PROGRESA and Its Impacts on the Welfare of Rural Households in Mexico, (Washington, DC: IFPRI, 2005), 28 (footnote 30).
  17. ↑ Translated from Spanish. SEDESOL, Más Oportunidades para las Familias Pobres - Primeros Avances, 393-394.
  18. ↑ James Heckman et al., “Characterizing Selection Bias Using Experimental Data,” Econometrica 66, no. 5 (1998): 1018.
  19. ↑ Harold Alderman et al., “Attrition in Longitudinal Household Survey Data.” Demographic Research, 5 (November 13, 2001): 80.
  20. ↑ Susan W. Parker, “Case Study: The Oportunidades program in Mexico,” paper presented at Shanghai Poverty Conference - Scaling Up Poverty Reduction, Shanghai, China, 2003, 21, footnote 9.
  21. ↑ Luis Rubalcava and Graciela Teruel, “The Effect of PROGRESA on Demographic Composition” (Mexico City: CIDE, 2003), 7.
  22. ↑ Luis Rubalcava and Graciela Teruel, “The Effect of PROGRESA on Demographic Composition” (Mexico City: CIDE, 2003), 7.
  23. ↑ T. Paul Schultz, Final Report on the Impact of PROGRESA on School Enrollment. Evaluation (Washington, DC: IFPRI, 2000), 6.
  24. ↑ Jere R. Behrman and Petra E. Todd, Randomness in the Experimental Samples of PROGRESA. (Washington, DC: IFPRI, 1999), 2
  25. ↑ Ariel Fiszbein and Norbert Schady, "Conditional Cash Transfers: Reducing Present and Future Poverty," Journal of Banking & Finance, 28 (June 2009): 311.
  26. ↑ Early on, it appears that these community meetings did occur, but were not used for this intended purpose. See: W. N. Faulkner. Negotiated Perspectives: A Complexity Approach to IFPRI-Progresa in Mexico. Master’s Thesis. Tulane University: 2012, 88. http://wnfaulkner.files.wordpress.com/2012/08/faulknerw_negotiatedperspectives.pdf
  27. ↑ Skoufias, Emmanuel, Benjamin Davis, and Jere R. Behrman. An Evaluation of the Selection of Beneficiary Households. Program. (Washington, DC: IFPRI, 1999), 18
  28. ↑ Susan Parker and Emmanuel Skoufias (2000) "IFPRI Final Report: The Impact of Progresa on Work, Leisure, and Time Allocation" (Washington, DC: IFPRI), 8.
  29. ↑ Emmanuel Skoufias, PROGRESA and Its Impacts on the Welfare of Rural Households in Mexico, (Washington, DC: IFPRI, 2005), 44
  30. ↑ For a listing of the specific reports, criteria used, and method of estimation see Emmanuel Skoufias, PROGRESA and Its Impacts on the Welfare of Rural Households in Mexico, (Washington, DC: IFPRI, 2005), Table 5.1, 45-46.
  31. ↑ As if surviving the presidential election cycle, a feat never before accomplished by a Mexican social program, were not hard enough, Progresa endured through the first changeover of the national ruling party in seventy-one years. Sources: Behrman (2007), p. 6-8; Rocha-Menocal (2005).
  32. ↑ Nora Lustig. “Scholars Who Became Practitioners: The Influence of Research on the Design, Evaluation, and Political Survival of Mexico’s Antipoverty Program Progresa/Oportunidades.” Working Paper no. 263, (CGDEV: Washington, D.C., 2011). http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1910074 (accessed August 28, 2012)
  33. ↑ Santiago Levy, Progress Against Poverty (Washington, DC: The Brookings Institution, 2006) , 112-113
  34. ↑ At the time, this was the largest loan ever granted by the IDB. Source: Susan W. Parker, “Case Study: The Oportunidades program in Mexico,” paper presented at Shanghai Poverty Conference - Scaling Up Poverty Reduction, Shanghai, China, 2003, 28-29
  35. ↑ Samantha Greenspun, “Assessing Mexico’s Anti-Poverty Program ‘Oportunidades’: Combining and Comparing Objective and interview-Based Indicators,” Tulane University, 2011, 23.
  36. ↑ Andrew D Oxman, Arild Bjørndal, Francisco Becerra-Posada, Mark Gibson, Miguel Angel Gonzalez Block, Andy Haines, Maimunah Hamid, et al. “A framework for mandatory impact evaluation to ensure well informed public policy decisions.” The Lancet 375, no. 9712 (January 30, 2010): 427–31. http://www.ncbi.nlm.nih.gov/pubmed/20113827 (accessed September 13, 2011).
  37. ↑ Santiago Levy, Progress Against Poverty (Washington, DC: The Brookings Institution, 2006) , 112
  38. ↑ Alina Rocha Menocal, “Less political and more pro-poor? The evolution of social welfare spending in Mexico in a context of democratisation and decentralisation.” Nord-Süd Aktuell 3, no. 4 (2005): 353
  39. ↑ Santiago Levy, Progress Against Poverty (Washington, DC: The Brookings Institution, 2006) , viii
  40. ↑ Székely, Miguel. “Toward Results-Based Social Policy Design and Implementation.” Working Paper no. 249, (CGDEV: Washington, D.C., 2011), 20
  41. ↑ For a useful summary of many of these, see: Ariel Fiszbein and Norbert Schady, "Conditional Cash Transfers: Reducing Present and Future Poverty," Journal of Banking & Finance, 28 (June 2009)

Further reading

External links