Economic Research Forum (ERF)

Vocational training fails the cost-benefit test: evidence from Turkey

1106
Rising unemployment in Turkey during the global financial crisis prompted the government to expand its provision of free vocational training. This column reports an evaluation of the newly introduced programme, which finds that the costs of training the unemployed exceeded the benefits.

In a nutshell

Vocational training programmes can struggle to have any meaningful and sustained impact on the employment outcomes of the unemployed.

Despite a small short-term improvement in employment in the first year, Turkey’s training programme didn’t improve people’s chances of being employed three years later.

Other evidence indicates that this result is not unique to Turkey, and suggests that in most cases, skills training programmes do not pass a cost-benefit test.

Over the last decade, the World Bank and its client governments have invested almost $1 billion a year in vocational training programmes for the unemployed. But in a large-scale randomised experiment evaluating Turkey’s programme, our research finds that despite a small short-term improvement in employment in the first year, the training didn’t improve people’s chances of being employed three years later.

We conclude that the costs of training the unemployed exceeded the benefits. These impacts are much less than expected by both the participants and the Turkish government.

Programme evaluation

Unemployment in Turkey rose during the global financial crisis, especially for youth. In response, the government expanded its free vocational training programmes, based on the idea that the unemployed often lack the right skills for the jobs that are available. The courses cover a wide range of fields, they are offered by both public and private providers, and they generally run for six hours a day over a three-month period.

So does vocational training actually improve unemployed people’s chances of finding work, and do the jobs pay enough to justify the costs? The typical problem in evaluating the impact of such programmes is that the people who attend training may not be comparable to those who don’t, making it difficult to know whether any differences in their subsequent employment outcomes reflect the impact of the course, or just that those who take the courses differ from those who don’t.

But in the Turkish case, the courses were so popular that in many cases more people registered than there were available slots. This allowed us to carry out a randomised controlled trial to measure the programme’s impact: 5,902 applicants who passed the eligibility criteria were randomly assigned to a slot in a course (a ‘treatment group’ of 3,001 applicants) or not (a ‘control group’ of 2,901 applicants).

This random assignment ensured that on average the two groups were similar to one another before training, so that any differences in employment outcomes afterwards would reflect the result of the training.

The evaluation covered courses in the last quarter of 2010 and the start of 2011. A follow-up survey took place one year after the courses ended, while employment outcomes over a longer three-year period were obtained by tracking participants through the social security system.

Results

The programme had a small positive impact in the first year. There was a three percentage point increase in formal employment, compared with a 29% employment rate for the control group. But this had disappeared by the third year, when the employment rates were similar for both groups.

The lack of impact doesn’t appear to be due to the duration of the course or the quality of the staff, with no larger impacts for those taking longer courses or courses taught by more educated or experienced instructors.

The cost of the training programme averaged $1,600-1,800 per person trained. People enrolled in public courses earned an extra $15 a month, but this gain did not last more than one and half years, so that the cost of the course wasn’t offset by higher earnings or lower unemployment. Private courses did slightly better, but still had costs that exceeded the gains.

Surveys of programme officials and participants reveal that they expected much higher impacts from the programme: participants expected a 32 percentage point increase in the likelihood of employment, and programme officials a 24 percentage point increase, compared with the short-term increase of three percentage points that actually occurred and no long-term effect.

Our findings suggest that vocational training programmes can struggle to have any meaningful and sustained impact on the employment outcomes of the unemployed. A recent review (Blattman and Ralston, 2015) shows that this result is not unique to Turkey, and suggests that in most cases, skills training programmes do not pass a cost-benefit test.

Further reading

Blattman, Christopher and Laura Ralston (2015) ‘Generating Employment in Poor and Fragile States: Evidence from Labor Market and Entrepreneurship Programs’, Poverty Action Lab.

Hirshleifer, Sarojini, David McKenzie, Rita Almeida and Cristobal Ridao-Cano (2016) ‘The Impact of Vocational Training for the Unemployed: Experimental Evidence from Turkey’, Economic Journal 126(597): 2115-46.

Tags: , , , ,

Most read

Making trade agreements more environmentally friendly in the MENA region

Trade policy can play a significant role in efforts to decarbonise the global economy. But as this column explains, there need to be more environmental provisions in trade agreements in which developing countries participate – and stronger legal enforcement of those provisions at the international level. The MENA region would benefit substantially from such changes.

Jordan: navigating through multiple crises

Jordan’s real GDP per capita is today no higher than it was 40 years ago. While external factors have undoubtedly had an adverse effect on the country’s economic outcomes, weak macroeconomic management and low public spending on investment and the social sectors have also played a substantial role. This column explores what can be done to reduce high public debt, accelerate private sector development and enhance social outcomes.

Iran’s globalisation and Saudi Arabia’s defence budget

How might Saudi Arabia react to Iran's renewed participation in global trade and investment? This column explores whether the expanding economic globalisation of Iran, following the lifting of nuclear sanctions, could yield a peace dividend for Saudi Arabia, consequently dampening the Middle East arms competition. These issues have attracted increased attention in recent times, notably after a pivotal agreement between the two countries in March 2023, marking the resumption of their political ties after a seven-year conflict.

Egypt and Iraq: amenities, environmental quality and taste for revolution

The Middle East and North Africa is a region marked by significant political turbulence. This column explores a novel dimension of these upheavals: the relationship between people’s satisfaction with, on one hand, the amenities to which they have access and the environmental quality they experience, and, on the other hand, their inclination towards revolutionary actions. The data come from the World Value Survey collected in 2018 in Egypt and Iraq.

Global value chains and domestic innovation: evidence from MENA firms

Global interlinkages play a significant role in enhancing innovation by firms in developing countries. In particular, as this column explains, participation in global value chains fosters a variety of innovation activities. Since some countries in the Middle East and North Africa display a downward trend on measures of global innovation, facilitating the GVC participation of firms in the region is a prospective channel for stimulating underperforming innovation.

Labour market effects of robots: evidence from Turkey

Evidence from developed countries on the impact of automation on labour markets suggests that there can be negative effects on manufacturing jobs, but also mechanisms for workers to move into the services sector. But this narrative may not apply in developing economies. This column reports new evidence from Turkey on the effects of robots on labour displacement and job reallocation.

Food insecurity in Tunisia during and after the Covid-19 pandemic

Labour market instability, rising unemployment rates and soaring food prices due to Covid-19 are among the reasons for severe food insecurity across the world. This grim picture is evident in Tunisia, where the government continues to provide financial and food aid to vulnerable households after the pandemic. But as this column explains, the inadequacy of some public policies is another important factors causing food insecurity.

Manufacturing firms in Egypt: trade participation and outcomes for workers

International trade can play a large and positive role in boosting economic growth, reducing poverty and making progress towards gender equality. These effects result in part from the extent to which trade is associated with favourable labour market outcomes. This column presents evidence of the effects of Egyptian manufacturing firms’ participation in exporting and importing on their workers’ productivity and average wages, and on women’s employment share.

Sustaining entrepreneurship: lessons from Iran

Does entrepreneurial activity naturally return to long-term average levels after big economic disturbances? This column presents new evidence from Iran on trends in entrepreneurship among various categories of firm size, sector and location – and suggests policies that could be effective in promoting entrepreneurial activities.

Do capital inflows cause industrialisation or de-industrialisation?

There is a clear appeal for emerging and developing economies, including those in MENA, to finance investment in manufacturing industry at home with capital inflows from overseas. But as the evidence reported in this column indicates, this is a potentially risky strategy: rather than promoting industrialisation, capital flows can actually lead to lower manufacturing value added and/or a reallocation of resources towards industries with lower technology intensity.