Facebook, Twitter, Google and Microsoft team up to tackle extremist content

By  | 

The tech companies plan to create a shared database of unique digital fingerprints that can identify images and videos promoting terrorism

Google, Facebook, Twitter and Microsoft have pledged to work together to identify and remove extremist content on their platforms through an information-sharing initiative.

The companies are to create a shared database of unique digital fingerprints known as hashes for images and videos that promote terrorism. This could include terrorist recruitment videos or violent terrorist imagery or memes. When one company identifies and removes such a piece of content, the others will be able to use the hash to identify and remove the same piece of content from their own network.

We hope this collaboration will lead to greater efficiency as we continue to enforce our policies to help curb the pressing global issue of terrorist content online, said the companies in a shared statement.

Because the companies have different policies on what constitutes terrorist content, they will start by sharing hashes of the most extreme and egregious terrorist images and videos as they are most likely to violate all of our respective companies content policies, they said.

The precise technical details remain to be established, said Facebook, although the approach echoes that adopted to tackle child sexual abuse imagery. The same companies use the National Center for Missing and Exploited Childrens PhotoDNA technology, developed by Microsoft, to identify images of child sexual abuse. However, with PhotoDNA the images are categorized centrally by law enforcement and the technology companies are legally obliged to remove the content.

Earlier this year Hany Farid, the computer scientist who helped develop PhotoDNA, proposed a sister program for extremist content. He teamed up with the Counter Extremism Project to develop a system that could proactively flag extremist photos, videos and audio clips as they are posted online.

We are happy to see this development. Its long overdue, he told the Guardian, explaining that he has been in conversations with Facebook and Microsoft since January.

Despite welcoming the announcement he remained cautious, particularly because of the lack of an impartial body to monitor the database: There needs to be complete transparency over how material makes it into this hashing database and you want people who have expertise in extremist content making sure its up to date. Otherwise you are relying solely on the individual technology companies to do that.

The strength of PhotoDNA comes from the single central database, he said. If its removed from one site, its removed everywhere. Thats incredibly powerful. Its less powerful if it gets removed from Facebook and not from Twitter and YouTube.

What we want is to eliminate this global megaphone that social media gives to groups like Isis. This doesnt get done by writing a press release.

Technology companies have been under pressure from governments around the world over the spread of extremist propaganda online from terror networks such as Isis.

In January top White House officials met with representatives from Apple, Facebook, Twitter and Microsoft to explore ways to tackle terrorism.

We are interested in exploring all options with you for how to deal with the growing threat of terrorists and other malicious actors using technology, including encrypted technology, said a briefing document released before the secretive summit.

Are there technologies that could make it harder for terrorists to use the internet to mobilize, facilitate, and operationalize?

Facebook said the latest initiative was not the direct result of the January meeting. But it said all the companies agreed there was no place for content that promotes or supports terrorism on their networks.

Read more:

We use cookies to give you the best online experience. By agreeing you accept the use of cookies in accordance with our cookie policy.

Privacy Settings saved!
Privacy Settings

When you visit any web site, it may store or retrieve information on your browser, mostly in the form of cookies. Control your personal Cookie Services here.

We use Google Tag Manager to monitor our traffic and to help us AB test new features.

Decline all Services
Accept all Services