Economic Research Forum (ERF)

Vocational training fails the cost-benefit test: evidence from Turkey

Rising unemployment in Turkey during the global financial crisis prompted the government to expand its provision of free vocational training. This column reports an evaluation of the newly introduced programme, which finds that the costs of training the unemployed exceeded the benefits.

In a nutshell

Vocational training programmes can struggle to have any meaningful and sustained impact on the employment outcomes of the unemployed.

Despite a small short-term improvement in employment in the first year, Turkey’s training programme didn’t improve people’s chances of being employed three years later.

Other evidence indicates that this result is not unique to Turkey, and suggests that in most cases, skills training programmes do not pass a cost-benefit test.

Over the last decade, the World Bank and its client governments have invested almost $1 billion a year in vocational training programmes for the unemployed. But in a large-scale randomised experiment evaluating Turkey’s programme, our research finds that despite a small short-term improvement in employment in the first year, the training didn’t improve people’s chances of being employed three years later.

We conclude that the costs of training the unemployed exceeded the benefits. These impacts are much less than expected by both the participants and the Turkish government.

Programme evaluation

Unemployment in Turkey rose during the global financial crisis, especially for youth. In response, the government expanded its free vocational training programmes, based on the idea that the unemployed often lack the right skills for the jobs that are available. The courses cover a wide range of fields, they are offered by both public and private providers, and they generally run for six hours a day over a three-month period.

So does vocational training actually improve unemployed people’s chances of finding work, and do the jobs pay enough to justify the costs? The typical problem in evaluating the impact of such programmes is that the people who attend training may not be comparable to those who don’t, making it difficult to know whether any differences in their subsequent employment outcomes reflect the impact of the course, or just that those who take the courses differ from those who don’t.

But in the Turkish case, the courses were so popular that in many cases more people registered than there were available slots. This allowed us to carry out a randomised controlled trial to measure the programme’s impact: 5,902 applicants who passed the eligibility criteria were randomly assigned to a slot in a course (a ‘treatment group’ of 3,001 applicants) or not (a ‘control group’ of 2,901 applicants).

This random assignment ensured that on average the two groups were similar to one another before training, so that any differences in employment outcomes afterwards would reflect the result of the training.

The evaluation covered courses in the last quarter of 2010 and the start of 2011. A follow-up survey took place one year after the courses ended, while employment outcomes over a longer three-year period were obtained by tracking participants through the social security system.

Results

The programme had a small positive impact in the first year. There was a three percentage point increase in formal employment, compared with a 29% employment rate for the control group. But this had disappeared by the third year, when the employment rates were similar for both groups.

The lack of impact doesn’t appear to be due to the duration of the course or the quality of the staff, with no larger impacts for those taking longer courses or courses taught by more educated or experienced instructors.

The cost of the training programme averaged $1,600-1,800 per person trained. People enrolled in public courses earned an extra $15 a month, but this gain did not last more than one and half years, so that the cost of the course wasn’t offset by higher earnings or lower unemployment. Private courses did slightly better, but still had costs that exceeded the gains.

Surveys of programme officials and participants reveal that they expected much higher impacts from the programme: participants expected a 32 percentage point increase in the likelihood of employment, and programme officials a 24 percentage point increase, compared with the short-term increase of three percentage points that actually occurred and no long-term effect.

Our findings suggest that vocational training programmes can struggle to have any meaningful and sustained impact on the employment outcomes of the unemployed. A recent review (Blattman and Ralston, 2015) shows that this result is not unique to Turkey, and suggests that in most cases, skills training programmes do not pass a cost-benefit test.

Further reading

Blattman, Christopher and Laura Ralston (2015) ‘Generating Employment in Poor and Fragile States: Evidence from Labor Market and Entrepreneurship Programs’, Poverty Action Lab.

Hirshleifer, Sarojini, David McKenzie, Rita Almeida and Cristobal Ridao-Cano (2016) ‘The Impact of Vocational Training for the Unemployed: Experimental Evidence from Turkey’, Economic Journal 126(597): 2115-46.

Most read

Why the West got rich and the Middle East did not

Today’s rulers of the three largest Middle Eastern economies all look to religious authorities as a key source of legitimacy. Drawing on a broad sweep of historical analysis, this column explores what this might mean for the region’s economic future. One notable danger is that the types of people who would push for policies that promote long-run growth are excluded from the political bargaining table.

Why Turkish growth ended

Following a period of rapid economic growth, the Turkish economy has slowed significantly since 2007. This column argues that these economic ups and downs reflect institutional improvements in the aftermath of the country’s 2001 financial crisis, followed by an ominous slide in the quality of these economic and political institutions.

Implications of the current low oil prices for MENA countries

The current low oil price environment, in part driven by the US shale oil revolution, has important macroeconomic implications for the Middle East and North Africa (MENA). This column reports research evidence on its likely impact on both oil-exporting and oil-importing countries in the region.

Prospects for development with democracy in the Arab world

What are the prospects for democracy in the Arab world? This column expresses the hope that as conflict-afflicted countries embark on their programmes of economic reconstruction, autocratic institutions will not be re-established under the pretext of the need for a speedy and steady recovery. The optimal path of development necessarily includes robust growth, equity as well as democracy.

An agenda for reducing income inequality in the Arab countries

What can be done to reduce income inequality in Arab countries? This column explores issues of measurement as well as potential policy measures. It concludes by calling for a new multipurpose pan-Arab survey that would allow for an evidence-based decision-making process on the impact of proposed policies on poverty and inequality.

The United Arab Emirates’ dilemma

As energy-producing economies strive to reduce their reliance on oil revenues, they must strike a balance between the competing demands of fiscal sustainability and steady growth of the non-energy sector. This column outlines how the United Arab Emirates is addressing this challenge.

Freedom for women is crucial for economic progress in MENA

The Middle East was once the cradle of civilisation: can it prosper once again? Looking back at lessons from the European Enlightenment, this column argues that if the region wants to advance economically, it needs to advance in terms of its treatment of women. Female agency is central to understanding the West’s technological leadership of the past two centuries.

Inequality in higher education: Egypt, Jordan and Tunisia

Attainment of higher education is strikingly unequal in Egypt and Tunisia, and a little less so in Jordan. This column reports research showing that in all three countries, family background is the primary driver of inequality. Particularly in Egypt and Tunisia, public spending on higher education is regressive, with the result that what purports to be a meritocratic and equitable system in reality perpetuates inequality.

Oil exporters’ responses to the US fracking boom

What are the implications of low oil prices for the economic and political stability of Arab oil-exporting countries such as Saudi Arabia? This column explores the impact of the US fracking boom on Arab oil revenues – and how policy-makers in these countries should respond.

Pension reform that avoids harming MENA labour markets

To tackle the deficits in their pension systems, should governments in Arab countries raise social security contributions, reduce pension levels or increase the statutory retirement age? This column summarises the results of research assessing the costs and benefits of different pension reforms in terms of their impact on different generations and on the labour market.