Go to content

4. Nordic research methodology

4.1 Metric selection

The research began with a structured literature review of 25 academic and grey literature articles, prioritising those which themselves were meta-reviews of existing indicators. The full list of reviewed articles is contained in the bibliography. All metrics discussed in the articles were extracted into an analysis sheet ready for evaluation. This led to 38 novel indicators being longlisted for evaluation:
    • Green Growth Index
    • UN SDG Index/​Dashboards
    • Transitions Performance Index
    • Genuine Progress Indicator (GPI)
    • OECD Better Life Index 
    • Social Progress Index (SPI) 
    • Doughnut Economy Indicators 
    • Sustainable Development Index (SDI) 
    • Happy Planet Index (HPI) 
    • Planetary Pressure-adjusted Human Development Index (PHDI) 
    • System of Environmental Economic Accounting (SEEA) 
    • Ecological Footprint 
    • Sustainable Society Index (SSI) 
    • Adjusted Net Savings (ANS)
    • Just Transition Score
    • Human Development Index (HDI) 
    • ASviS Composite Index
    • Competitive Sustainability Index
    • Environmental Performance Index (EPI)
    • UK Measures of National Wellbeing Dashboard 
    • Environmental Sustainability Index (ESI)
    • Inclusive Wealth Index (IWI) 
    • Scottish national performance framework
    • The World Happiness Index (WHI)
    • Thriving places index
    • Canadian Index of Wellbeing
    • NZ Living Standards Framework 
    • OECD, How is life? Well-being
    • Planetary Boundaries framework
    • SEEA-Ecosystem Accounting
    • Swedish Measures of Wellbeing
    • Australia's National Wellbeing Dashboard
    • Bhutan GNH Index 
    • Findicator
    • Germany W3 indicators
    • Gross National happiness index
    • Sustainable National Income
    • U-Index
    An evaluation framework was then developed, allocating each metric a score of either 0, 0.5 or 1 across a range of criteria. These criteria, as copied verbatim from the framework, are as follows:

    Thematic coverage

    Covers a range of thematic areas which are important; wellbeing, inclusion/inequality and sustainability. 0 = 1, 0.5 = 2, 1 = 3

    Multidimensionality

    Uses a range of indicators to measure the different dimensions of the thematics covered e.g. using both carbon emissions and material footprint for sustainability. 0 = one indicator per thematic area, 0.5 = 2-3 indicators per thematic area, 1 = 3< indicators per thematic area

    Intelligibility

    How easily the final metric can be understood by non-experts, in terms of overall message/​assessment of a country. 0 = very hard to understand what the metric is saying, 0.5 = somewhat understandable, 1 = easy to understand.
    This is not about the complexity of underlying calculations; the maths underpinning GDP is complex, but the principle and final number is very simple.

    Well established

    How widely the metric is discussed and used by mainstream institutional actors like governments and IGOs. 0 = not at all, 0.5 = widely discussed but limited use, 1 = discussed and used by multiple actors

    Measured for Nordic countries

    Whether the metric is calculated for Nordic countries. 0 = none, 0.5 = 1-2 countries, 1 = 2<

    Credibility of creator

    Whether the creator of the metric is a well-known and credible actor. 0 = unknown/untrusted creator (e.g. single nonexpert or poorly viewed state), 0.5 = actors such as think-tanks, academics, smaller states etc, 1 = major IGOs such as the UN or similarly legitimate actors
    The project team then conducted an in-depth analysis on each longlisted metric, scoring each across the criteria above. Scores were then triangulated with the independent assessment of the research group to derive a shortlist. No metric scoring 4.5 or below was able to be selected and all metrics scoring 5.5 or above were selected by default. In recognition of the limits and innate subjectivity of such numeric scoring researchers were able to propose for inclusion a metric scoring in the 4.75-5.25 range for discussion if they identified compelling alternative reasons to do so. This led to the following final shortlist of metrics:
    1. Green Growth Index
    2. UN SDG Index/Dashboards
    3. Transitions Performance Index
    4. Genuine Progress Indicator (GPI)
    5. OECD Better Life Index
    6. Social Progress Index (SPI)
    7. Doughnut Economy Indicators
    8. Sustainable Development Index (SDI)
    9. Happy Planet Index (HPI)
    10. Planetary Pressure-adjusted Human Development Index (PHDI)
    11. System of Environmental Economic Accounting (SEEA)
    The shortlisting process consisted of a final workshop within the consortium to evaluate these options against the project objectives. In the workshop each research team presented what they deemed to be the most promising metrics for further exploration, based on the underlying reasoning which guided their scoring in the previous phase as well as qualitative criteria which were not otherwise captured, such as potential significance to the Nordic policy context, the potential to generate novel insight and diversity of measurement and calculation approaches used across the options. Through these internal discussions the team aligned on the selection of the following three metrics for full analysis:
    1. Transitions Performance Index
    2. Doughnut Economy Indicators 
    3. Sustainable Development Index (SDI)  
    It was also acknowledged that while the System of Environmental Economic Accounting (SEEA) was not suitable for inclusion in this core group due to its sole focus on environmental factors, its being arguably the most developed, institutionally recognised and rigorously calculated alternative indicator currently in existence warranted its detailed coverage elsewhere in the report.

    4.2 Selected metrics

    4.2a Sustainable Development Index

    The Sustainable Development Index (SDI) was introduced by Hickel (2020) as a novel approach by combining human development with ecological impact. It is an adaptation of the UN’s Human Development Index (HDI) and alternative to the Planetary-pressure adjusted Human Development Index (PHDI), meant to better capture the realities of ecological sustainability. Its dual approach accounts for international trade, including emissions and materials embodied in imports and subtracting those of exports. High-income countries, due to globalisation, have shifted their ecological impact by outsourcing production and extraction (Hickel, J., 2020).                      
    The Sustainable Development Index (SDI) is based upon five (5) indicators: education, life expectancy, income, (consumption based) CO2 emissions and (consumption based) material footprint. Notably the value of the income measure is capped at $20,000, an amount Hickel argues is an adequate threshold for sustainable wellbeing for all under adequate policy conditions (Ibid.). Excess income beyond this threshold does not contribute to improving a country’s performance according to the SDI.
    The index is calculated from each country’s national development index score (based on life expectancy, education, and sufficiency income) and then divides it by their ecological overshoot. This overshoot represents how much consumption-based CO2 emissions and material footprint exceed the per capita planetary boundaries (Hickel, J., 2020). When calculating both the development index and ecological overshoot, all indicators are given an equal weighting. The full calculation methodology is found in the original research paper referenced.
    The material footprint indicator quantifies the overall weight of a country’s material extraction and consumption, encompassing biomass, minerals, fossil fuels, and construction materials. This subcategory is fundamental as material extraction from terrestrial and marine ecosystems significantly influences land-use changes, chemical loading, biodiversity loss, and other critical processes outlined in the planetary boundary framework (Sustainable Development Index, 2024). In summary, the SDI offers a holistic perspective on development, considering both human well-being and ecological sustainability.

    4.2b Transition Performance Index

    The Transition Performance Index (TPI) is an index developed by the European Commission to determine how Member states, as well as a selection of non-EU countries, are performing in a transition to “a fair and prosperous sustainability” (Directorate-General for Research and Innovation, 2021). There is only a one time off publication of the TPI, where the data used run between 2011-2020.
    The TPI was designed with the UN SDGs in mind. As the objectives of the TPI are compatible for comparison with the Eurostat Sustainable Development Goals, the index is likely to have some policy advantages in terms of being in line with the established sustainability policy landscape in the Nordics, as the SDGs are used as a measure of progress.
    TPI was presented in 2021 by the Directorate-General for Research and Innovation (European Commission) in a report presenting the first results (European Commission, Directorate-General for Research and Innovation, Vigier, P., 2020). The TPI has later been updated in terms of the number of indicators, and thus the dataset and rankings (European Commission, Directorate-General for Research and Innovation, Prevost, S., Benavente, D., Stevenson, A.,2022).  The purpose of the TPI was to provide an additional metric of prosperity beyond GDP, and thus adding further dimensions to the measure of wellbeing in a sustainable future. The index is measuring EU member states´ progression towards “the six priorities of the Commission” (Directorate-General for Research and Innovation, 2021), that outlines the political guidelines of the commission between 2019-2024. The six priorities are namely:
    • The European Green deal
    • A Europe fit for the digital age
    • An economy that works for people
    • A stronger Europe in the world
    • Promoting our European way of life
    • A new push for European democracy
    Besides the countries within the EU, 45 other countries are measured in the TPI, thus making it suitable for global comparison. According to the European Commission, the TPI covers 76% of the world population, covering 72 countries in total, where 45 are outside of the EU (Directorate-General for Research and Innovation, 2021).
    The index is based upon 4 dimensions of transition:
    • Economic
    • Social
    • Environmental
    • Governance
    These four dimensions are in turn categorised into 16 internationally comparable indicators with 4 sub-indicators within each pillar:
    Transition
    Indicators
    Economic
    • Education
    • Wealth
    • Labour Productivity and R&D
    • Industrial Base
    Social
    • Health
    • Work & Inclusion
    • Free or non-remunerated time
    • Equality
    Environmental
    • Emissions reduction
    • Biodiversity
    • Resource productivity/​material use
    • Energy productivity
    Governance
    • Fundamental rights
    • Security
    • Transparency
    • Sound Public Finances
    Figure 7: Four dimensions and comparable indicators for TPI.
    All indicators have individual rankings within the dimension that are weighted to index scores and rankings for the dimensions, whereas 1 indicates best performance and 72 indicates the lowest ranking. Each sub-indicator is in turn based on another 1-3 sub-indicators.
    European Commission (2021). Appendix II - Country Profiles.
    For example, the indicator for Material Use is based on the sub-indicators Resource productivity and Material footprint.
    The scores are divided between the four dimensions, and then weighted into an overall TPI score. The weighting system of the four pillars are divided equally. There are four dimensions in total, each composed of four indicators. The overall score per dimensions is in turn computed as weighted arithmetic averages of the indicators´ scores, meaning that all dimensions are weighted equally. The index score is computed similarly (Directorate-General for Research and Innovation, n.d.-a).  Practically, the countries are ranked based on a score from 0-100 divided into the following five tiers:
    Transition leader
    Score between [75–100]
    Strong transition
    Score between [65–75]
    Good transition
    Score between [55–65]
    Moderate transition
    Score between [45–55]
    Weak transition
    Score between [0–45]
    Figure 8: Transition scoring.
    An important aspect to highlight with regards to the ranking system is that it should not be misleading in the sense that it can give a true answer to how the countries are performing in each of the dimensions. Since the TPI is based on a ranking system, the countries´ performance is based on how well the other countries are doing as well. Hence, if a country is improving the score from one year to another, it is both affected by the country's own performance as well as if the others are doing better or worse. The results should therefore be interpreted with cautiousness.
    On a final note, as mentioned above, there has not been an updated release of the TPI from the EU Commission. Hence, to get a better understanding of whether the TPI is expected to be developed and used further within the EU, a personal request was sent to the European Research Enquiry Service. In the answer on the request, it was explained that there is no envisioning on further updating the TPI. The reasoning for this being that the TPI as a tool lacks transparency in its design, and the potential for its use as a policy tool was deemed not sufficient at this point.
    But there has on the other hand been other developments as kind of an extension of the TPI. In 2023, three years following the first report of the TPI, a new report by the European Commission (European Commission, Directorate-General for Research and Innovation, Vladimirov, M., Gerganov, A., Petrova, V. (2023) presented two new alternatives to the TPI, with the aim of developing better policy instruments to monitor the member states progress towards sustainable transition. This is suggesting that the TPI has not been sufficient in delivering a full assessment of the Commission's political priorities. The report further states that as of 2023 there has not been a ‘Beyond GDP’ monitoring framework with clear and measurable targets to report for the UN SDGs or achieve the EU Agenda 2030. Newer editions of a ‘Beyond GDP’ metric seeks to integrate a broader aspect of well-being in European countries, building on the methodology of TPI and other metrics developed by the European Commission. In the report, five in depth interviews with experts on the subject of ‘Beyond GDP’ were conducted, with specific comments on the TPI and possible improvements on the index’s dimensions.  It is suggested that the social dimension is unpacked to favour more inclusion, health and wellbeing, as well as a greater emphasis on sustainability within the dimensions. One expert suggests integrating the ‘Doughnut approach’ in the sustainability aspect, to have a clearer dimension of the environmental transition in terms of input and output.
    Further development of the report from 2023, is a preliminary study (European Commission, Directorate-General for Research and Innovation, Charveriat, Abdallah, & Jong, 2024) for a new metric published by the European Commission presenting another alternative in the ‘Beyond GDP’ approach for a sustainable prosperous future. The framework for the study is called GDP+3, which is similar to the TPI in terms of dimensions. As the name suggests, the GDP+3 framework adds three dimensions to GDP as a measure on wellbeing and prosperity, namely social, environmental and institutional prosperity. The report emphasises that the framework needs to have strong policy traction for it to be a strong and influential political tool. Here, the strong relation to GDP in the framework might be an advantage, as it is familiar to policymakers and the wide public.
    Even though the TPI in its current form will not be developed and used further, the TPI has still been influential in providing a solid baseline for the further development of ‘Beyond GDP’ metrics within the EU, as it has been a stepping stone in finding more appropriate metrics for policymakers in terms of recent research and the work on the GDP+3 measure. With these findings, the TPI is thus not recommended for direct implementation in policies in the Nordic countries. However, since the work on efficient indicators is still being developed, it is accurate for policymakers to stay up to date with the current work presented by the European Commission on the ‘Beyond GDP’ approach, as this can be relevant for the Nordic countries’ work going forward towards well-being economies.

    4.2c Doughnut Economy Indicators

    To date there is no single and centrally produced set of indicators which both quantify and evaluate performance of individual countries against the DE framework. However, a number of scholars have undertaken distinct calculations to understand relative and comparative national performance. These have often been based on distinct but overlapping synthetic indicators. There have been, to our knowledge, only four studies which conduct large-scale comparative studies, including European countries. Three of these use the same data sets from 2011 and 2015, whilst the last uses more recent data sources ranging till 2019.
    Based on data collected from 2011, the seminal paper ‘A good life for all within planetary boundaries’ looked at over 150 countries. It determined there were profligate transgressions: no country met the basic human needs of its citizens while using resources at a globally sustainable level (O’Neill et al. 2018). Based on the same set of data, a follow-up paper ‘Is it possible to achieve a good life for all within planetary boundaries’ looked at the ability of poorer nations to pursue a good life for all within planetary boundaries, due in part, to the ecological overshoot by richer nations (Hickel 2019).
    A follow-up to the first of these papers – ‘The social shortfall and ecological overshoot of nations’ – was based on updated time-series data till 2015 (Fanning et al. 2022). Reviewing over 140 countries till 2015, it concluded that countries are likely to overshoot their biophysical boundaries faster than achieving the social foundations for prosperity, with projections suggesting that deep transformations were needed to safeguard human and planetary health.
    This study draws on the data used in ‘The social shortfall and ecological overshoot of nations’ (Fanning et al. 2022). This selection was based on the fact that this is the most comprehensive time series data available and has been referenced on the official website of the Doughnut Economy Action Lab (DEAL, 2021). However, three major limitations should be noted.
    First, this dataset nor any of the others reviewed contained data for Iceland. The research team searched extensively for data which would enable novel calculations for Icelandic performance to be undertaken, but such data was not publicly available. Analysis of Iceland in terms of the doughnut economy is thus missing.
    Second, this dataset does not contain data for Cyprus, Luxembourg or Malta. This means that EU comparisons are based on an average of the remaining 24 EU member states, rather than the full EU27. However given the size of the omitted countries, we are confident that such a comparison can still provide valuable insight.
    Third, and most importantly, the fact that historical data only exists until 2015 places considerable limitations on the conclusions that can be drawn. The datasets do include projections under business-as-usual scenarios, however given the ensuing years have seen the global pandemic, a war on Europe’s eastern border, drastically increased energy costs and high persistent inflation, not to mention ecological changes seemingly accelerating far faster than models had predicted, these projections are likely to deviate significantly from reality. For this reason we have elected not to include these projections in our analysis.
    Indicators in Fanning et al. 2022
    Ecological ceiling
    Social foundation
    CO2 emissions (consumption based)
    Life satisfaction
    Ecological footprint
    Life expectancy
    Material footprint (consumption based)
    Nutrition
    Land-system change (consumption based)
    Sanitation
    Phosphorus (consumption based)
    Income poverty
    Nitrogen (consumption based)
    Access to energy
    Secondary education
    Social support
    Democratic quality
    Equality
    Employment
    Figure 8: Indicators for doughnut adapted from (Fanning et al. 2022).
    The data are normalised with respect to nationally calculated biophysical boundaries and social foundations. In the former case, these are downscaled, per capita allocations of the ecological ‘space’ beneath the planetary boundaries or, in the case of ecological and material footprints, their globally sustainable levels. In the case of biophysical boundaries a value >1 means the nation is transgressing a biophysical boundary i.e. operating ecologically unsustainably. Here a higher number indicates poorer performance.  In the case of social foundations a value <1 means the country is falling below a social foundation i.e. failing to provide a basic need for some of its population. Here a lower number indicates poorer performance.
    In addition to Fanning et al. 2022 there is a more recent paper entitled ‘How close are European countries to the doughnut-shaped safe and just space? Evidence from 26 EU countries’ (Gómez-Alvarez Díaz et al. 2024). This paper conducts a snapshot analysis using different indicators and data-sets from the papers identified above. These are shown in figure 9 below. The data used by this paper has been sourced from between 2015–2019 for indicators relating to social foundations, and between 2010–2021 for biophysical indicators, with most coming from different sources in 2019. Gómez-Alvarez Díaz et al. 2024 does not gather data for Norway. And whilst we outline the approach below, this data, due to its disparate nature and incongruence with established datasets in the field, shall not be used for this study.
    Ecological ceiling
    Indicators used in
    Gómez- Alvarez Díaz et al. 2024
    Years in which data is sourced
    Atmospheric pollution
    The population weighted annual mean concentration of particulate matter at urban background stations in
    agglomerations
    2021 / 2019
    Biodiversity loss
    Habitats with good conservation status
    2010 / 2018
    Species with good conservation status
    2010 / 2018
    Biochemical flows
    Nutrient nitrogen use
    2015 / 2019
    Nutrient phosphate use
    2015 / 2019
    Chemical pollution
    Waste without hazardous chemicals
    2014 / 2018
    Climate change
    CO2 emissions
    2018 / 2019 / 2020
    Freshwater use
    Water Exploitation Index plus (WEI+)
    2016 / 2017
    Health of oceans and rivers
    Inland water excellent
    2016 / 2019
    Coastal water excellent
    2016 / 2019
    Land-change system
    Temperate forest
    2015 / 2018
    Stratospheric ozone depletion
    Free of consumption of ozone-depleting substance (ODS)
    1987 / 2019
    Social floor
    Connectivity
    Households with high-speed internet
    2019
    Culture
    Population reports that non-participation in cultural or sport activities is not for financial reasons or because of there being none in the neighbourhood
    2015
    Education
    15-year-old students achieve level 2 (‘basic skills level’) on the PISA scale for the subject of reading (zi=15-year-old students)
    2018
    Energy
    Households are able to keep their home adequately warm
    2019
    Food
    Population with appropriate meals: the ability to eat a meal with meat, chicken, fish (or vegetarian equivalent) every second day
    2019
    Gender equality
    Proportion of women in national parliaments and national government (zi= 50% of seats)
    2019
    Gross hourly earnings of females (zi=earnings of males)
    2019
    Health
    Population covers needs for medical care without problems due to ‘financial reasons,’ ‘waiting list’ or ‘too far to travel’
    2019
    Housing
    Population without overcrowding
    2019
    Income
    Population without risk of poverty
    2019
    Peace & justice
    Population reports that they do not face the problem of crime, violence, or vandalism in their local area
    2019
    Population does not perceive the independence of the courts and judges in a country as “being very bad” or “fairly bad”
    2019
    Political voice
    Population does not answer “not at all satisfied” with the way democracy in the country
    2019
    Social equality
    Population thinks differences in people’s incomes in the country are not today too high
    2017
    Population affirms that they do not feel discriminated against
    2019
    Social support
    Population has someone to ask for help
    2015
    Transport
    Population with great or very great difficult in accessing public transport
    2012
    Water and sanitation
    Population with bath or shower and indoor flushing toilet in their household
    2019
    Work
    Total active population without long-term unemployment
    2019
    Employees not at-risk-of-poverty (zi = total employees)
    Figure 9: Outline of environmental and social indicators, with year of data source, used in Gómez-Alvarez Díaz et al. 2024.