Extremism On TikTok In 2022, A Year In Review: Neo-Nazis, White Supremacists, And Anti-Government Extremists Active On TikTok; Call For Violent Revolution; Discuss Mass Shootings And Constructing Bombs; Post Racist, Anti-LGBTQ, Antisemitic Content

print
December 23, 2022

Introduction

In November 2022, Federal Communications Commission commissioner Brendan Carr became the latest in a line of officials who have called for the total banning of video-sharing app TikTok, on the grounds of threats to national security.[1]The app, Carr claimed, had repeatedly mishandled the data of U.S. users, and had deep ties to the Chinese government, opening the door for massive data collection by a foreign power.

Only a few weeks later, the Senate Homeland Security Committee accused the FBI, DHS, and major social media companies of not adequately addressing the growing threat of domestic extremism. In a 128-page report, committee members argue that these entities have not allocated sufficient resources to counter the "metastasizing" threat of white supremacist and anti-government extremism and that they have failed to track and report on data about domestic terrorism incidents. Federal law enforcement agencies and social media platforms responded to reaffirm their commitment to stopping the spread of violent extremism.[2]

In the context of these two major sources of pressure, TikTok, which was included in the Committee's report, released a statement saying that "a safe and trusted platform is critical" to their "long-term success," and maintaining their dedication to "removing content that incites or glorifies violence or promotes violent extremist organizations."[3] Despite these public promises, TikTok remains home to many white supremacist and antigovernment extremists who share hateful content to the video platform.

TikTok has admittedly taken a hardline approach to banning content, using its aggressive algorithmic content net to catch and deplatform content and users in violation of its terms of use. This has ultimately led to many new methods of evading detection, including the emergence of algorithm-friendly language called "Algospeak," which is used to evade content filters.[4] While a vast majority of users of this technique are in no way extremist, neo-Nazis and white supremacists have adopted this moderation evasion technique, and many have remained on the platform despite this strict policing of content.

Many of the accounts that have posted extremist content throughout 2022 have been taken down or otherwise removed from the platform, however some are still active and post content while others have created new accounts. Additionally, the identity of many account holders is hidden, and some accounts may be linked to intentional misinformation campaigns through botnets and algorithm manipulation.

The MEMRI DTTM produced a report offering a review of extremist content on TikTok from 2022. This content includes threats from neo-Nazis, white supremacists, and accelerationists against immigrants, Jews, the LGBTQ+ community, politicians, healthcare workers, schools, and more. The content also includes the dissemination of misinformation and conspiracy theories, particularly as they relate to the antisemitic white genocide and QAnon conspiracy theories. The report includes research from the DTTM team around the world covering content on the platform in dozens of languages.

YOU MUST BE SUBSCRIBED TO THE MEMRI DOMESTIC TERRORISM THREAT MONITOR (DTTM) TO READ THE FULL REPORT. GOVERNMENT AND MEDIA CAN REQUEST A COPY BY WRITING TO DTTMSUBS@MEMRI.ORG WITH THE REPORT TITLE IN THE SUBJECT LINE. PLEASE INCLUDE FULL ORGANIZATIONAL DETAILS AND AN OFFICIAL EMAIL ADDRESS IN YOUR REQUEST. NOTE: WE ARE ABLE TO PROVIDE A COPY ONLY TO MEMBERS OF GOVERNMENT, LAW ENFORCEMENT, MEDIA, AND ACADEMIA, AND TO SUBSCRIBERS; IF YOU DO NOT MEET THESE CRITERIA PLEASE DO NOT REQUEST.

 

[1] CNN.com/2022/11/02/tech/fcc-commissioner-tiktok-ban/index.html, November 2, 2022.

[2] Ken Dilanian, "FBI, DHS and social media firms like Meta, TikTok aren't adequately addressing threat of domestic extremists, Senate report says," NBC News, November 16, 2022.

[3] Dilanian, "FBI, DHS and social media firms like Meta, TikTok..."

[4] Washingtonpost.com/technology/2022/04/08/algospeak-tiktok-le-dollar-bean/, April 8, 2022.

The full text of this post is available to DTTM subscribers.

If you are a subscriber, log in here to read this report.

For information on the required credentials to access this material, visit the DTTM subscription page

Subscribe to DTTM

Join U.S. and other Western government agencies and law enforcement, as well as leading businesses and business organizations, in subscribing to the MEMRI Domestic Terrorism Threat Monitor (DTTM) Project, for the latest alerts, updates, and reports on imminent and potential threats from around the world.

ONLY GOVERNMENT, MEDIA, AND ACADEMIA WITH FULL CREDENTIALS CAN REQUEST ACCESS TO DTTM REPORTS.

Subscribe to DTTM

The Cyber & Jihad Lab

The Cyber & Jihad Lab monitors, tracks, translates, researches, and analyzes cyber jihad originating from the Middle East, Iran, South Asia, and North and West Africa. It innovates and experiments with possible solutions for stopping cyber jihad, advancing legislation and initiatives federally – including with Capitol Hill and attorneys-general – and on the state level, to draft and enforce measures that will serve as precedents for further action. It works with leaders in business, law enforcement, academia, and families of terror victims to craft and support efforts and solutions to combat cyber jihad, and recruits, and works with technology industry leaders to craft and support efforts and solutions.

Read More