In the current survey, the questions and statements have been constructed aiming to target these eight proficiencies. The following analysis of the results is structured around the eight proficiencies. Some of them overlap in the questionnaire or concern topics that are closely related, for example points 2 and 8 in the list above, about media freedom and the role of media and social media platforms in democratic societies and will thus be presented in the same section.
Comments on the development of a survey method
The survey focused on two key demographics: Adults aged 16 years and older, and children and youth aged 9 to 15 years. Data was collected through a digital questionnaire, and responses were gathered via an online web panel. In total, 12,744 responses were received, comprising 9,487 adults and 3,257 children.
The questionnaire has been developed in collaboration between experts within the Nordic media authorities. More information can be found in appendix I About the project. Constructing a questionnaire aimed at the general public to assess aspects of media literacy is a challenge. Firstly, because of the width and complexity of the concept of media literacy, including the mastering of tools and technology, as well as asking questions about more abstract features such as exercising judgement and critical thinking skills. The questionnaire also comprises questions about issues that are probably not foremost in mind on a daily basis, which may be demanding for the respondents, such as the role of journalists in a democratic society. Secondly, assessing knowledge and skills may take the form of a school test. To avoid this, attitudes towards something were asked for instead of testing understanding, where alternative answers were in some cases provided rather than open questions. Certain sections comprised a number of statements for respondents to agree or not agree on. The different types of questions also made the completion of the survey more varied for respondents.
In a follow-up, it would be interesting to complement the study with thematic sections focusing on gaining a deeper understanding of a few aspects. Another development could be to find ways to test actual skills in larger groups of respondents instead of self-assessment questions given their drawbacks.
A note on social media
In order to be able to reproduce the survey over time and diminish its sensitivity to certain platforms, the questionnaire often uses ‘social media’ as a concept. Since different social media platforms have their own characteristics, it may be questionable to treat them as one entity. The use of broad definitions where some of the precision is lost may induce differences regarding what respondents are referring to. However, the platforms also have many traits in common. They provide a personalised content based on user data and algorithms; they usually allow for users to post and engage with other posts; they are quick and easy to use without any major costs or advanced equipment involved and are continuously updated. In public discussion and debate it is also quite common to refer to social media in general, not specifying the name of platforms.
When creating a questionnaire for a survey, with the aim to be sustainable over time, understood by many age groups and different nationalities, and by people with experiences from different walks of life, the lowest common denominator can still be useful.