Digital Media Literacy:

A Systematic Resource Review

Background

Team:

  • Maya Nair: Student Researcher

  • Emily Bascom: Student Researcher

  • Advisor: Jevin West

    Both myself and the other research partner, Emily, had a background teaching misinformation at the college level as TAs for INFO 270, Data Reasoning in the Digital World.

Context:

All undergraduate students from the UW Informatics program are required to complete a 2-quarter long capstone project, focusing on a topic of their choice. For this, my research partner and I conducted an in-depth literature review, investigating the need for and availability of digital media literacy curriculum for all ages.

My partner and I both had previous experience working with misinformation research, as well as teaching this content at a college level. However, we wanted to better understand the state of current tools available to all age groups ranging from elementary schoolers, to the retired community.

We both felt this would be an interesting and important problem-space to explore, as neither of us had much in-depth misinformation education until coming to college.


Research Statement

As misinformation and disinformation continue to become an increasingly prevalent problem in modern society, there is a growing need for educational support to combat this problem for all ages through media literacy. 

Our goal was to investigate the current availability of up-to-date educational support tools and the amount of resources per age group (for example, elementary school, high school, higher education, mid life, late life, etc.), as well as where educators and community members need more support and guidance when educating the public about this complex topic.


Methods

To investigate the need for and availability of digital media literacy curriculum for supporting community members of all ages, we conducted a systematic literature review of fifty-six existing online resources and curriculum for combating misinformation and disinformation, as well as promoting digital media literacy.

For this resource search, we used four databases: Google Scholar, Google Search, the Association for Computing Machinery Library, and the Institute of Electrical and Electronics Engineers Library.

Within these databases, we used five search terms: “digital media literacy curriculum,” “misinformation literacy,” “digital media literacy curriculum,” “disinformation curriculum,” and “misinformation curriculum.”

From this initial search, fifty-six resources were selected by two reviewers (EB & MN) based on the title of the resource.

Once the initial list of resources was generated, two reviewers (EB & MN) individually generated Miro boards where they conducted a deductive categorization of the resources by theme to come up with a preliminary list of resource types.

At this stage, six resources were rejected for reasons such as the links being dead, the resources being out-of-date, or the topic of the resource was irrelevant.

These reviewers then met to compare and discuss their categorization and debate how the resources were rejected. Once consensus was met, the remaining resources (n = 50) were divided in half and each reviewer did an in-depth review of their twenty-five resources to further categorize and reject the resources, as well as document what audience (i.e. age group, teachers, librarians) the resource was geared toward.

Additionally at this stage, each reviewer skimmed the other reviewer’s resources to help facilitate a more thorough conversation surrounding the relevance of the resource during discussion.

Reviewers again met to discuss the categorization of resources and rejections; at this stage, twelve resources were rejected and two resources were added, resulting in a final list of forty resources. Resources were rejected for being irrelevant, the URL link being dead, or the resource being behind a paywall, while two resources were discovered while vetting resources.

At the end of the vetting process, the reviewers had a list of 19 codes. This list of codes was consolidated into nine final codes due to redundancy. The reviewers also categorized all resources by the following potential audiences Elementary-School Aged, Middle and High School Aged, College and Adults, and Educators.

Final Code List

  1. Source Reliability & Bias

  2. Information Reasoning

  3. Fact-Checking

  4. Digital Literacy

  5. Media & News Literacy

  6. Civic & Internet Citizenship

  7. Fake News & Propaganda

  8. Misinformation & Disinformation

  9. COVID-19

  1. Elementary

  2. Middle and High School

  3. College & Adults

  4. Educators.

Audiences


Results

Each of the forty resources received one to eight codes and one to four audiences depending on the content of the information included in the resources. The categorization of resources can be found in the table below.

Because resources could be categorized as more than one code and/or audiences, frequently the sum of columns and rows in the will be greater than the total number of resources (n = 40).

Each number represents how many resources were categorized as the code for each audience type. The column all the way to the right represents the total number of resources found for a code. 

Key Findings

Top 3 Categories

  1. Media & News Literacy (n = 27)

  2. Digital Literacy (n = 18)

  3. Misinformation & Disinformation (n = 18)

Bottom 3 Categories

  1. COVID-19 (n = 2)

  2. Civic & Internet Literacy (n = 6)

  3. Fact-Checking (n = 9)

While the reviewers classified resources for College Aged people and general Adults together, there were only three resources specifically geared toward the general Adult population as a whole.

The reviewers found no official resources specifically geared toward elderly adults or unconventional learning environments, such as teaching parents or grandparents about digital literacy. 

  1. Middle and High School (n = 26)

  2. Elementary School (n = 16)

  3. College & Adults (n = 16)

  4. Educators (n = 8)

Resources Ranked by Audience


Conclusions

At the moment, a majority of the curriculum is geared toward educational settings, such as for K-12 classrooms and college course material. However, our research did indicate a need for educational resources surrounding digital media curated towards post-college adults and the retired community, as well as non-traditional learning environments.


Potential Limitations

To be expected, there were limitations to this research. We only included resources written in English that were published and publicly accessible online.

We chose to do this as we wanted to focus on resources easily available to the public. However, we recognize that there may be other resources accessible behind paywalls or available through search engines or keywords that we did not discover that may be just as valuable as the resources we have located.

Works Cited

Burkhardt, J. M. (2017). Combating fake news in the digital age (Vol. 53, No. 8, pp. 5-9). Chicago:
American Library Association.

Cheng, M., Yin, C., Nazarian, S., & Bogdan, P. (2021). Deciphering the laws of social
network-transcendent COVID-19 misinformation dynamics and implications for combating
misinformation phenomena. Scientific Reports, 11(1), 1-14.

Collins, B., Hoang, D. T., Nguyen, N. T., & Hwang, D. (2021). Trends in combating fake news on social
media–a survey. Journal of Information and Telecommunication, 5(2), 247-266.

Dordevic, M., Safieddine, F., Masri, W., & Pourghomi, P. (2016, September). Combating misinformation
online: identification of variables and proof-of-concept study. In Conference on e-Business,
e-Services and e-Society (pp. 442-454). Springer, Cham.

Livingstone, S., Van Couvering, E., & Thumim, N. (2005). Adult media literacy: A review of the research
literature on behalf of Ofcom. Department of Media and Communications, London School of
Economics and Political Science.

Koulolias, V., Jonathan, G. M., Fernandez, M., & Sotirchos, D. (2018). Combating Misinformation: An
ecosystem in co-creation. OECD Publishing.

Lazer, D., Baum, M., Grinberg, N., Friedland, L., Joseph, K., Hobbs, W., & Mattsson, C. (2017).
Combating fake news: An agenda for research and action.

McCright, A. M., & Dunlap, R. E. (2017). Combatting misinformation requires recognizing its types and
the factors that facilitate its spread and resonance. Journal of Applied Research in Memory and
Cognition, 6(4), 389–396.

Sharma, K., Qian, F., Jiang, H., Ruchansky, N., Zhang, M., & Liu, Y. (2019). Combating fake news: A
survey on identification and mitigation techniques. ACM Transactions on Intelligent Systems and
Technology (TIST), 10(3), 1-42.

Torres, R., Gerhart, N., & Negahban, A. (2018, January). Combating fake news: An investigation of
information verification behaviors on social networking sites. In Proceedings of the 51st Hawaii
international conference on system sciences.

Next
Next

Cozy & Co