Economic Research Forum (ERF)

Vocational training fails the cost-benefit test: evidence from Turkey

1444
Rising unemployment in Turkey during the global financial crisis prompted the government to expand its provision of free vocational training. This column reports an evaluation of the newly introduced programme, which finds that the costs of training the unemployed exceeded the benefits.

In a nutshell

Vocational training programmes can struggle to have any meaningful and sustained impact on the employment outcomes of the unemployed.

Despite a small short-term improvement in employment in the first year, Turkey’s training programme didn’t improve people’s chances of being employed three years later.

Other evidence indicates that this result is not unique to Turkey, and suggests that in most cases, skills training programmes do not pass a cost-benefit test.

Over the last decade, the World Bank and its client governments have invested almost $1 billion a year in vocational training programmes for the unemployed. But in a large-scale randomised experiment evaluating Turkey’s programme, our research finds that despite a small short-term improvement in employment in the first year, the training didn’t improve people’s chances of being employed three years later.

We conclude that the costs of training the unemployed exceeded the benefits. These impacts are much less than expected by both the participants and the Turkish government.

Programme evaluation

Unemployment in Turkey rose during the global financial crisis, especially for youth. In response, the government expanded its free vocational training programmes, based on the idea that the unemployed often lack the right skills for the jobs that are available. The courses cover a wide range of fields, they are offered by both public and private providers, and they generally run for six hours a day over a three-month period.

So does vocational training actually improve unemployed people’s chances of finding work, and do the jobs pay enough to justify the costs? The typical problem in evaluating the impact of such programmes is that the people who attend training may not be comparable to those who don’t, making it difficult to know whether any differences in their subsequent employment outcomes reflect the impact of the course, or just that those who take the courses differ from those who don’t.

But in the Turkish case, the courses were so popular that in many cases more people registered than there were available slots. This allowed us to carry out a randomised controlled trial to measure the programme’s impact: 5,902 applicants who passed the eligibility criteria were randomly assigned to a slot in a course (a ‘treatment group’ of 3,001 applicants) or not (a ‘control group’ of 2,901 applicants).

This random assignment ensured that on average the two groups were similar to one another before training, so that any differences in employment outcomes afterwards would reflect the result of the training.

The evaluation covered courses in the last quarter of 2010 and the start of 2011. A follow-up survey took place one year after the courses ended, while employment outcomes over a longer three-year period were obtained by tracking participants through the social security system.

Results

The programme had a small positive impact in the first year. There was a three percentage point increase in formal employment, compared with a 29% employment rate for the control group. But this had disappeared by the third year, when the employment rates were similar for both groups.

The lack of impact doesn’t appear to be due to the duration of the course or the quality of the staff, with no larger impacts for those taking longer courses or courses taught by more educated or experienced instructors.

The cost of the training programme averaged $1,600-1,800 per person trained. People enrolled in public courses earned an extra $15 a month, but this gain did not last more than one and half years, so that the cost of the course wasn’t offset by higher earnings or lower unemployment. Private courses did slightly better, but still had costs that exceeded the gains.

Surveys of programme officials and participants reveal that they expected much higher impacts from the programme: participants expected a 32 percentage point increase in the likelihood of employment, and programme officials a 24 percentage point increase, compared with the short-term increase of three percentage points that actually occurred and no long-term effect.

Our findings suggest that vocational training programmes can struggle to have any meaningful and sustained impact on the employment outcomes of the unemployed. A recent review (Blattman and Ralston, 2015) shows that this result is not unique to Turkey, and suggests that in most cases, skills training programmes do not pass a cost-benefit test.

Further reading

Blattman, Christopher and Laura Ralston (2015) ‘Generating Employment in Poor and Fragile States: Evidence from Labor Market and Entrepreneurship Programs’, Poverty Action Lab.

Hirshleifer, Sarojini, David McKenzie, Rita Almeida and Cristobal Ridao-Cano (2016) ‘The Impact of Vocational Training for the Unemployed: Experimental Evidence from Turkey’, Economic Journal 126(597): 2115-46.

Tags: , , , ,

Most read

Trust in Lebanon’s public institutions: a challenge for the new leadership

Lebanon’s new leadership confronts daunting economic challenges amid geopolitical tensions across the wider region. As this column explains, understanding what has happened over the past decade to citizens’ trust in key public institutions – parliament, the government and the armed forces – will be a crucial part of the policy response.

Qatarisation: playing the long game on workforce nationalisation

As national populations across the Gulf have grown and hydrocarbon reserves declined, most Gulf countries have sought to move to a more sustainable economic model underpinned by raising the share of citizens in the productive private sector. But, as this column explains, Qatar differs from its neighbours in several important ways that could render aggressive workforce nationalization policies counterproductive. In terms of such policies, the country should chart its own path.

Small businesses in the Great Lockdown: lessons for crisis management

Understanding big economic shocks like Covid-19 and how firms respond to them is crucial for mitigating their negative effects and accelerating the post-crisis recovery. This column reports evidence on how small and medium-sized enterprises in Tunisia’s formal business sector adapted to the pandemic and the lockdown – and draws policy lessons for when the next crisis hits.

Economic consequences of the 2003 Bam earthquake in Iran

Over the decades, Iran has faced numerous devastating natural disasters, including the deadly 2003 Bam earthquake. This column reports evidence on the unexpected economic boost in Bam County and its neighbours after the disaster – the result of a variety of factors, including national and international aid, political mobilisation and the region’s cultural significance. Using data on the intensity of night-time lights in a geographical area, the research reveals how disaster recovery may lead to a surprising economic rebound.

Qatar’s pursuit of government excellence: promises and pitfalls

As Qatar seeks to make the transition from a hydrocarbon-based economy to a diversified, knowledge-based economy, ‘government excellence’ has been identified as a key strategic objective. This column reports what government effectiveness means in terms of delivery of public services, digitalisation of services, and control of corruption – and outlines the progress made to date on these development priorities and what the country needs to do to meet its targets.

The impact of climate change and resource scarcity on conflict in MENA

The interrelationships between climate change, food production, economic instability and violent conflict have become increasingly relevant in recent decades, with climate-induced economic shocks intensifying social and political tensions, particularly in resource-constrained regions like MENA. This column reports new evidence on the impact of climate change on economic and food production outcomes – and how economic stability, agricultural productivity and shared water resources affect conflict. While international aid, economic growth and food security reduce the likelihood of conflict, resource scarcity and shared water basins contribute to high risks of conflict.

A Macroeconomic Accounting of Unemployment in Jordan:  Unemployment is mainly an issue for adults and men

Since unemployment rates in Jordan are higher among young people and women than other groups, unemployment is commonly characterised as a youth and gender issue. However, the majority of the country’s unemployed are adults and men. This suggests that unemployment is primarily a macroeconomic issue challenge for the entire labour market. The appropriate response therefore is coordinated fiscal, monetary, structural and institutional policies, while more targeted measures can still benefit specific groups.

The green energy transition: employment pathways for MENA

The potential employment impacts of green and renewable energy in the Middle East and North Africa are multifaceted and promising. As this column explains, embracing renewable energy technologies presents an opportunity for the region to diversify its economy, mitigate the possible negative impacts of digitalisation on existing jobs, reduce its carbon footprint and create significant levels of employment across a variety of sectors. Green energy is not just an environmental imperative but an economic necessity.

Global value chains, wages and skills in MENA countries

The involvement of firms in production across different countries or regions via global value chains (GVCs) can make a significant contribution to economic development, including improved labour market outcomes. This column highlights the gains from GVC participation in terms of employment quality in Egypt, Jordan and Tunisia. Given the high unemployment, sticky wages and wide skill divides that are common in the MENA region, encouraging firms to participate in GVCs is a valuable channel for raising living standards.

Tunisia’s energy transition: the key role of small businesses

Micro, small and medium-sized enterprises (MSMEs) play a critical role in Tunisia’s economy, contributing significantly to GDP and employment. As this column explains, they are also essential for advancing the country’s ambitions to make a successful transition from reliance on fossil fuels to more widespread use of renewable energy sources. A fair distribution of the transition’s benefits across all regions and communities will secure a future where MSMEs thrive as leaders in a prosperous, inclusive and sustainable Tunisia.