Go to content

Appendix A – Collection of Data

A.1 Literature review

Relevant studies are identified through searches in international electronic databases and grey literature. In the following we will describe the search methods.

Searches in international electronic databases

The following international databases are searched:
  • Academic Search Premier (EBSCOhost Research Databases)
  • EconLit (EBSCOhost Research Databases)
  • SocINDEX (EBSCOhost Research Databases)
  • Science Citation Index Expanded (SCI-EXPANDED)
  • Social Sciences Citation Index (SSCI)
The search string is based on the PICO(S)‐model, which have the following aspects: Population (P), Intervention (I), Comparison (C), Outcome (O), Study design. We only utilize three aspects: population (P), intervention (I) and outcomes (O). We have developed three corresponding search facets and add limits concerning geographic area and period.
Populations (P):
  1. Persons with a disability
  2. Immigrants
  3. Seniors or older worker
  4. Young people
Intervention (I):
  • Active labour market programmes (ALMP)
  • Population A: protected employment, accommodated job, workplace accommodations
  • Population B: language training, introduction programme
  • Sanctions
  • Economic incentives
Outcomes (O):
Labour market outcomes such as employment probability, earnings and welfare benefit.
Limits:
  • The Nordic countries
  • English language
  • Published in the period 2017–2023
  •  
The following search string (exemplified with a search from Academic Search Premier, see Table A.1) has been implemented on the chosen bibliographic databases and modified according to each databases' thesaurus and controlled subject terms:
  • S1-5 covers the population
  • S6-10 covers the interventions
  • S11-15 covers the outcome
  • S16 combines the four first mentioned facets
  • S17-18 add geographical region, the period and language

Searching other resources (grey literature)

We have search for working papers and published papers from the following resources:

Selection of studies

In the first step the literature is screened on title and abstracts. In the next step the remaining studies are full text screened. Information on study type/methodology is used in the screening, as we are only interested in quantitative evaluation studies with a comparison condition. After screening at the two levels do we end with 46 publications.
Table A.1 Search string: Academic Search Premier. Search History
#
Query
Results
S10
S6 OR S7 OR S8 OR S9
3,075,108
S9
(((((DE "EMPLOYMENT of people with disabilities") OR (DE "EMPLOYMENT subsidies")) OR (DE "SUPPORTED employment" OR DE "EMPLOYMENT of people with disabilities")) OR (DE "INTERNSHIP programs" OR DE "EMPLOYEE training")) OR (DE "RETIREMENT benefits" OR DE "EARLY retirement incentives")) OR (DE "INCOME maintenance programs" OR DE "EFFECT of income maintenance programs on labor supply")
27,088
S8
KW ( "ALMP" OR "Active Labo#r Market Program*" OR "Active labo#r market polic*" OR activat* OR "subsidi?ed employ*" OR training OR "supported employ*" OR "job search*" OR "combination program*" OR coaching OR mentor* OR classroom* OR "class-room*" OR "class room*" OR retrain* OR internship* OR counsel#ing OR guid* OR "skill develop*" OR "on-the job train*" OR "on the job train*" OR "work* practic*" OR upgrad* OR vocation* OR "individual placement and support" OR "protected employment" OR "workplace accomodation*" OR "language training" OR "introduction program*" OR "integration program*" OR sanction* ) OR KW ( incentive* N1 (economic* OR finance*) ) OR KW ( "benefit cut*" OR "employment bonus" OR "retirement age" OR "pension age" ) OR KW ( (reduc* OR low* OR extend*) N1 (benefit* OR "income transfer*" OR "retirement benefit*" OR pension*) )
288,441
S7
AB ( "ALMP" OR "Active Labo#r Market Program*" OR "Active labo#r market polic*" OR activat* OR "subsidi?ed employ*" OR training OR "supported employ*" OR "job search*" OR "combination program*" OR coaching OR mentor* OR classroom* OR "class-room*" OR "class room*" OR retrain* OR internship* OR counsel#ing OR guid* OR "skill develop*" OR "on-the job train*" OR "on the job train*" OR "work* practic*" OR upgrad* OR vocation* OR "individual placement and support" OR "protected employment" OR "workplace accomodation*" OR "language training" OR "introduction program*" OR "integration program*" OR sanction* ) OR AB ( incentive* N1 (economic* OR finance*) ) OR AB ( "benefit cut*" OR "employment bonus" OR "retirement age" OR "pension age" ) OR AB ( (reduc* OR low* OR extend*) N1 (benefit* OR "income transfer*" OR "retirement benefit*" OR pension*) )
2,800,499
S6
TI ( "ALMP" OR "Active Labo#r Market Program*" OR "Active labo#r market polic*" OR activat* OR "subsidi?ed employ*" OR training OR "supported employ*" OR "job search*" OR "combination program*" OR coaching OR mentor* OR classroom* OR "class-room*" OR "class room*" OR retrain* OR internship* OR counsel#ing OR guid* OR "skill develop*" OR "on-the job train*" OR "on the job train*" OR "work* practic*" OR upgrad* OR vocation* OR "individual placement and support" OR "protected employment" OR "workplace accomodation*" OR "language training" OR "introduction program*" OR "integration program*" OR sanction* ) OR TI ( incentive* N1 (economic* OR finance*) ) OR TI ( "benefit cut*" OR "employment bonus" OR "retirement age" OR "pension age" ) OR TI ( (reduc* OR low* OR extend*) N1 (benefit* OR "income transfer*" OR "retirement benefit*" OR pension*) )
692,749
S5
S1 OR S2 OR S3 OR S4
2,370,725
S4
((((DE "PEOPLE with disabilities") OR (DE "DISABILITIES")) OR (DE "FOREIGN workers")) OR (DE "EMPLOYMENT of older people")) AND (DE "YOUNG adults" OR DE "YOUTH employment" OR DE "YOUTH")
324
S3
KW ( disable* OR disabilit* OR handicap* OR impair* OR "work* incapacit*" ) OR KW ( immigrant* OR migrant* OR refugee* OR "foreign worker*" ) OR KW ( senior* OR "old worker*" OR "old* people" OR "old citizen*" OR elderly) OR (young* OR youth )
206,296
S2
AB ( disable* OR disabilit* OR handicap* OR impair* OR "work* incapacit*" ) OR AB ( immigrant* OR migrant* OR refugee* OR "foreign worker*" ) OR AB ( senior* OR "old worker*" OR "old* people" OR "old citizen*" OR elderly) OR (young* OR youth )
2,277,585
S1
TI ( disable* OR disabilit* OR handicap* OR impair* OR "work* incapacit*" ) OR TI ( immigrant* OR migrant* OR refugee* OR "foreign worker*" ) OR TI ( senior* OR "old worker*" OR "old* people" OR "old citizen*" OR elderly) OR (young* OR youth )
1,562,420
Note: Limits: Published date: 2017-2023; Language: English; Countries: Nordic/Scandinavian Searched 11/09/2023.

A.2 Qualitative data collection among Nordic caseworkers

In order to supplement the insights gained through our literature review, we have also conducted interviews with caseworkers in various parts of the Nordic countries’ public employment services. These interviews aimed at uncovering the practical knowledge and experiences among the caseworkers concerning the effectiveness of the different types of employment instruments on which the literature review focusses. Hence, the point of departure of this qualitative study was the framework of the employment instruments and its main categories that helped us structure the interviews around the ‘instrument themes’ that are evident in Figure 2.1. Secondly, we chose to reach out to caseworkers who worked with one of the main target groups that were to point of departure of this project, i.e. vulnerable youth, seniors, immigrants and persons with disabilities. The work of caseworkers in the public Nordic employment and integration services is obviously structured by the target group categories defined by national legislation. Still, focussing on these broad demographic groups and their potential employment barriers helped us gather knowledge through these interviews that we could subsequently analyse in a cross-Nordic perspective. Hence, by not focussing on the specifics of e.g. Danish or Norwegian legislation pertaining to members of the NEETs group turning on in a Danish ‘job center’ or a Norwegian ‘NAV’, it became easier to gain knowledge across these settings on what the caseworker actually did and which tools they found useful in practice.
To identify relevant caseworkers, we received the help from the different employment ministries in Denmark, Finland, Iceland, Norway and Sweden. We aimed at interviewing caseworkers working with each of our demographic groups ideally from different parts of each Nordic country. More specifically, we aimed at interviewing caseworkers from both cities/ large towns and from small towns in (remote) rural areas. Ideally, we wanted to conduct a group interview in each country with participation of 2-4 caseworkers from different parts of the country but working with the same target group. The intention behind this approach was to gain knowledge reflecting different job opportunities facing vulnerable groups given the internal differences in each Nordic country where the labour markets surrounding large university cities may differ very much from similar opportunities in small towns in rural areas. We managed to stick to this approach to some extent, especially in Iceland and Norway (as reflected in Table A.2). However, it turned out that caseworkers are typically very busy people with very busy schedules that are not easily coordinated in a relatively short-term perspective. Given the need to conduct the interviews within a 2–3 months-timeframe, we had to diverge from our approach if it was not possible to find an interview date where different caseworkers working with the same target group but in different parts of the country was able to participate. In that instance, we chose to conduct individual interviews with each caseworker at a specific time suiting this particular person. In total we conducted 9 group interviews, 24 individual interviews with a total of 44 interview persons (for more details see Table A.2
Practically, the interviews were conducted over Zoom and recorded. The interviews were relatively structured inspired by a the funnel approach starting out with open questions and then later following up with more specific questions about their experience with specific employment instruments (Wengraf, 2001). Hence, we started out asking open questions to the interview persons about their work, experience with clients from the specified target group, and what they experience as useful instruments to help these citizens closer to finding a job. Secondly, based on previous research and analyses in this project, we presented on a PowerPoint slide a vignette describing a fictitious but potentially typical citizen from the target group. In qualitative studies, this method is good for introducing a topic on which the researcher wants the interview persons to reflect (Ejrnæs and Monrad, 2012). In our study, for example, caseworkers working with persons with disabilities were presented a vignette describing in a brief text an unemployed unmarried female 35 years ole suffering anxiety and depression who has been out of work the last three years. Caseworkers working with vulnerable youth was presented with the vignette below:
Anders is a young man 22 years old who is unemployed and has no education beyond lower secondary school. He has been out of work for a couple of year after dropping out of upper secondary school. He says he is not motivated for starting in school again or for taking vocational education. Still, he would like to become a mechanic and repair cars. He also has problems relating to frequently smoking cannabis. Some of his best friends are in jail for selling drugs.
Subsequently, we asked the caseworkers if they could recognize this person as someone they could meet in their work, which they usually could or could with minor modifications of the characteristics of our vignette person, and what they would do to help her or him find work. Finally, we presented on six separate slides the employment instruments and asked them to reflect on and tell us about their experiences concerning the use of these instruments and the extent to which they found the instrument useful in their work. 
The PowerPoints presented to Danes/Norwegians/Swedes were in Danish/Norwegian/Swedish and the interviews were conducted in those languages. The PowerPoints to Finnish and Icelandic caseworkers were in English and these interviews were conducted in English. All interviews lasted 45-65 minutes; the group interviews typically lasting longer than the individual interviews. All interviews were recorded, and their content was summarized.
We subsequently conducted a thematic analysis, i.e. analysed which reflections among the interview persons were most prevalent in relation to specific themes. These themes related primarily to: A) which barriers are most prevalent among members of our target groups. B) How it is important to get to know the person that the caseworker is to assist and establish a good trustful relation, especially if this relation due to the nature of the employment barriers becomes a long-term relationship. C) How different types of instruments may help the persons from the target groups into the labour market.
Table A.2 Qualitative data collected among caseworkers in the employment services in the Nordic countries, April - June 2024
Country
Group
interviews
Individual
interviews
Interview
persons, total
Total
interviews
Denmark
0
5
5
5
Young people
 
1
1
 
Seniors
 
1
1
 
Immigrants
 
2
2
 
Persons with disabilities
 
1
1
 
Finland
3
5
12
8
Young people
 
3
3
 
Seniors
1
 
3
 
Immigrants
1
2
4
 
Persons with disabilities
1
 
2
 
Iceland
3
2
8
5
Young people
1
 
2
 
Seniors
1
 
2
 
Immigrants
 
2
2
 
Persons with disabilities
1
 
2
 
Norway
3
3
10
6
Young people
1
1
3
 
Seniors
 
2
2
 
Immigrants
1
 
2
 
Persons with disabilities
1
 
3
 
Sweden
0
9
9
9
Young people
 
2
2
 
Seniors
 
2
2
 
Immigrants
 
3
3
 
Persons with disabilities
 
2
2
 
Total
9
24
44
33