US government report shows tech companies collaborated with law enforcement in the fight against domestic extremism

According to a recently published US Government Accountability (GAO) Report, Discord, Reddit, Roblox, and other communication platforms helped law enforcement agencies, specifically the Federal Bureau of Investigation (FBI) and the Department of Homeland Security (DHS), in policing domestic violent extremism online.

This report was first mentioned by the Intercept. The GAO report examined several online communication platforms, focusing on how law enforcement agencies and the US government interact with them to address extreme content.

They interviewed five companies, including Roblox, Reddit and Discord, to learn more about their collaboration with the FBI and DHS. This coordination involved regular meetings wherein the DHS shared information related to online activities that promote domestic violent extremism.

How do these extremists work?

The report mentioned that these extremists use gaming and social media platforms for different purposes, such as reaching wider audiences, promoting their ideas into the mainstream, and radicalizing, recruiting, and mobilizing others. Here is an example to help you understand more about it.

Experts also mentioned that violent extremists use different platforms for various purposes based on audiences, available features and content moderation rules.

According to the information provided by social media and gaming companies interviewed by GAO, they use content moderation tools to detect and delete content which violates their platform’s policies concerning domestic violent extremism on their platforms.

However, since no two companies have the same policies, the content banned on one platform could be allowed on another; that’s what extremists check and exploit.

How does the FBI & DHS collab with the tech companies work?

The Federal Bureau of Investigation (FBI) and Department of Homeland Security (DHS) use different mechanisms to share & receive domestic violent extremism threat-related information with gaming and social media companies.

The collaboration involves meetings between companies and law enforcement agencies. Companies can share information related to online activities promoting domestic violent extremism with I&A (DHS’s intelligence office). They can also report activities that violate the company’s terms of service. The FBI then follows up on the reports.

However, law agencies need a strategy that defines how to identify and choose companies to engage with. They are also unaware of the aim and results of these engagements. Without a plan, there is no way to determine how effective their communication with companies could be and how the information-sharing mechanisms help with the agencies’ mission.

The report suggested that both agencies involved should have a strategy in place, and the DHS has agreed and given an estimated completion date of June 28, 2024.

A popular Twitch streamer, Hasan Piker said:

All I can think of is the awful track record of the FBI when it comes to identifying extremism. They’re much better at finding vulnerable teenagers with mental disabilities to take advantage of.

The report also included:

Researchers have identified user-generated re-creations of mass shootings on the gaming platform Roblox, such as the 2019 shooting in Christchurch, New Zealand, and the 2022 shooting in Buffalo, New York. Roblox officials told us their moderation team reviewed their content moderation tools and adjusted them to block these games and prevent content glorifying violent incidents from appearing on the platform.

Towards the end, the report also expressed that the government’s definition of domestic violent extremism includes anti-government, racially motivated, anti-authority, environmental, abortion-related, and animal rights extremism.

The categories defined are so broad that people may find it difficult to distinguish between responsible intervention and potential overreach. Therefore, there must be a balance to ensure Americans’ free speech rights are not violated.

What are your thoughts on the matter? Share your opinions in the comments section below.