Economic Research Forum (ERF)

Vocational training fails the cost-benefit test: evidence from Turkey

1335
Rising unemployment in Turkey during the global financial crisis prompted the government to expand its provision of free vocational training. This column reports an evaluation of the newly introduced programme, which finds that the costs of training the unemployed exceeded the benefits.

In a nutshell

Vocational training programmes can struggle to have any meaningful and sustained impact on the employment outcomes of the unemployed.

Despite a small short-term improvement in employment in the first year, Turkey’s training programme didn’t improve people’s chances of being employed three years later.

Other evidence indicates that this result is not unique to Turkey, and suggests that in most cases, skills training programmes do not pass a cost-benefit test.

Over the last decade, the World Bank and its client governments have invested almost $1 billion a year in vocational training programmes for the unemployed. But in a large-scale randomised experiment evaluating Turkey’s programme, our research finds that despite a small short-term improvement in employment in the first year, the training didn’t improve people’s chances of being employed three years later.

We conclude that the costs of training the unemployed exceeded the benefits. These impacts are much less than expected by both the participants and the Turkish government.

Programme evaluation

Unemployment in Turkey rose during the global financial crisis, especially for youth. In response, the government expanded its free vocational training programmes, based on the idea that the unemployed often lack the right skills for the jobs that are available. The courses cover a wide range of fields, they are offered by both public and private providers, and they generally run for six hours a day over a three-month period.

So does vocational training actually improve unemployed people’s chances of finding work, and do the jobs pay enough to justify the costs? The typical problem in evaluating the impact of such programmes is that the people who attend training may not be comparable to those who don’t, making it difficult to know whether any differences in their subsequent employment outcomes reflect the impact of the course, or just that those who take the courses differ from those who don’t.

But in the Turkish case, the courses were so popular that in many cases more people registered than there were available slots. This allowed us to carry out a randomised controlled trial to measure the programme’s impact: 5,902 applicants who passed the eligibility criteria were randomly assigned to a slot in a course (a ‘treatment group’ of 3,001 applicants) or not (a ‘control group’ of 2,901 applicants).

This random assignment ensured that on average the two groups were similar to one another before training, so that any differences in employment outcomes afterwards would reflect the result of the training.

The evaluation covered courses in the last quarter of 2010 and the start of 2011. A follow-up survey took place one year after the courses ended, while employment outcomes over a longer three-year period were obtained by tracking participants through the social security system.

Results

The programme had a small positive impact in the first year. There was a three percentage point increase in formal employment, compared with a 29% employment rate for the control group. But this had disappeared by the third year, when the employment rates were similar for both groups.

The lack of impact doesn’t appear to be due to the duration of the course or the quality of the staff, with no larger impacts for those taking longer courses or courses taught by more educated or experienced instructors.

The cost of the training programme averaged $1,600-1,800 per person trained. People enrolled in public courses earned an extra $15 a month, but this gain did not last more than one and half years, so that the cost of the course wasn’t offset by higher earnings or lower unemployment. Private courses did slightly better, but still had costs that exceeded the gains.

Surveys of programme officials and participants reveal that they expected much higher impacts from the programme: participants expected a 32 percentage point increase in the likelihood of employment, and programme officials a 24 percentage point increase, compared with the short-term increase of three percentage points that actually occurred and no long-term effect.

Our findings suggest that vocational training programmes can struggle to have any meaningful and sustained impact on the employment outcomes of the unemployed. A recent review (Blattman and Ralston, 2015) shows that this result is not unique to Turkey, and suggests that in most cases, skills training programmes do not pass a cost-benefit test.

Further reading

Blattman, Christopher and Laura Ralston (2015) ‘Generating Employment in Poor and Fragile States: Evidence from Labor Market and Entrepreneurship Programs’, Poverty Action Lab.

Hirshleifer, Sarojini, David McKenzie, Rita Almeida and Cristobal Ridao-Cano (2016) ‘The Impact of Vocational Training for the Unemployed: Experimental Evidence from Turkey’, Economic Journal 126(597): 2115-46.

Most read

Green hydrogen production and exports: could MENA countries lead the way?

The Arab region stands at the threshold of a transformative opportunity to become a global leader in green hydrogen production and exports. But as this column explains, achieving this potential will require substantial investments, robust policy frameworks and a commitment to technological innovation.

Freedom: the missing piece in analysis of multidimensional wellbeing

Political philosophy has long emphasised the importance of freedom in shaping a meaningful life, yet it is consistently overlooked in assessments of human wellbeing across multiple dimensions. This column focuses on the freedom to express opinions, noting that it is shaped by both formal laws and informal social dynamics, fluctuating with the changing cultural context, particularly in the age of social media. Data on public opinion in Arab countries over the past decade are revealing about how this key freedom is perceived.

Climate change threats and how the Arab countries should respond

The Arab region is highly vulnerable to extreme events caused by climate change. This column outlines the threats and explores what can be done to ward off disaster, not least moving away from the extraction of fossil fuels and taking advantage of the opportunities in renewable energy generation. This would both mitigate the potential for further environmental damage and act as a catalyst for more and better jobs, higher incomes and improved social outcomes.

Child stunting in Tunisia: an alarming rise

Child stunting in Tunisia seemed to have fallen significantly over the past two decades. But as this column reports, new analysis indicates that the positive trend has now gone dramatically into reverse. Indeed, the evidence is unequivocal: the nutritional health of the country’s youngest citizens is rapidly deteriorating and requires immediate and decisive action.

Egypt’s labour market: new survey data for evidence-based decision-making

As Egypt faces substantial social and economic shifts, understanding the labour market is crucial for designing policies that promote employment and inclusive economic growth. This column introduces the latest wave of the Egypt Labor Market Panel Survey, which provides fresh, nationally representative data that are vital for examining these dynamics.

New horizons for economic transformation in the GCC countries

The countries of the Gulf Cooperation Council (GCC) have historically relied on hydrocarbons for economic growth. As this column explains ahead of a high-level ERF policy seminar in Dubai, emerging technologies like artificial intelligence, blockchain and robotics – what some call the fourth industrial revolution – present a unique opportunity for the region to reduce its dependence on oil and make the transition to a knowledge-based economy.

Exchange rate undervaluation: the impact on participation in world trade

Can currency undervaluation influence participation in world trade through global value chains (GVC)? This column reports new evidence on the positive impact of an undervalued real exchange rate on the involvement of a country’s firms in GVCs. Undervaluation acts as an economy-wide industrial policy, supporting the competitiveness of national exports in foreign markets vis-à-vis those of other countries.

Shifting public trust in governments across the Arab world

The Arab Spring, which began over a decade ago, was driven by popular distrust in governments of the region. The column reports on how public trust has shifted since then, drawing on survey data collected soon after the uprising and ten years later. The findings reveal a dynamic and often fragile landscape of trust in Arab governments from the early 2010s to the early 2020s. Growing distrust across many countries should raise concerns about future political and social instability.

Corruption in Iran: the role of oil rents

How do fluctuations in oil rents influence levels of corruption in Iran? This column reports the findings of new research, which examines the impact of increases in the country’s oil revenues on corruption, including the mechanisms through which the effects occur – higher inflation, greater public spending on the military and the weakness of democratic institutions.

More jobs, better jobs and inclusive jobs: the promise of renewable energy

Among the many economic and environmental challenges facing the countries of the Middle East and North Africa (MENA), two stand out: the need for jobs and the need to combat the threat of climate change by moving away from reliance on fossil fuels. As this column explains, embracing renewable energy technologies presents an opportunity for the region to diversify its economy, mitigate the possible negative impacts of digital technologies on existing jobs, reduce its carbon footprint and create significant levels of employment, particularly for women and the youth, across a variety of sectors.




LinkedIn