Facebook Will Start Scanning 10,000 Posts a Second to Make Comments Less Terrible

Grow Your Business, Not Your Inbox

Stay informed and join our daily newsletter now!
Will be used in accordance with our Privacy Policy
Facebook Will Start Scanning 10,000 Posts a Second to Make Comments Less Terrible
Image credit: Getty Images/Justin Sullivan
Facebook founder and CEO Mark Zuckerberg.
3 min read
This story originally appeared on Business Insider

While Facebook has lot of noise around using artificial intelligence to better sort photos and videos, text is still an huge part of the Facebook experience. 

Today, we got a look behind the scenes on how AI is helping Facebook sift all that text and improve the Facebook experience with "Deep Text" -- a system developed by Facebook's AI labs that scans 10,000 posts every second in 20 languages.

People post more than 1 billion items -- statuses, links, photos, whatever -- to Facebook every day, says a company spokesperson.

Deep Text is "deep learning-based text understanding engine," as Facebook puts it. Its ability to understand text like a human would is already being put to work in Facebook Messenger. And Facebook plans to take it a lot further.

It's the technology behind the scenes that can distinguish the words "I need a ride," in which case Messenger might prompt you to order an Uber, versus "I was going to get a ride," in which case the moment has already passed. Not to mention "I like to ride a donkey," which is a whole different thing entirely.

More intriguingly, Mehanna says Deep Text can be used in busy Facebook comment threads. 

Say for example when Mark Zuckerberg does a live Facebook Q&A, and the top few comments are often in another language, off-topic, or both: 

It can be hard to sift out the relevant comments, as this screenshot of a recent Mark Zuckerberg post's comments proves.

"It becomes really hard to find interesting comments," says Mehanna.

Mehanna says that there's a lot of potential for Deep Text to scan those comments and rank them for you, personally. If Facebook's AI has figured out that you speak English and Farsi, it'll prioritize relevant comments in those languages so you see them first -- while pushing annoying things down.

It's an elegant solution for Facebook: It maintains the platform's very public commitment to global free speech, since Deep Text isn't actually deleting the comments. 

But it also means that you'll see relevant comments in your own language first, making for a better Facebook experience. And if the comments do contain spam or straight-up hate speech, Deep Text could one day be empowered to automatically regulate. 

Another cool thing is that Deep Text will be able to understand when your Facebook status is offering an item for sale, and offer to cross-list it automatically to your regional networks.

Going forward, Mehanna says that they want to train Deep Text to understand more of Facebook's 40 officially-supported languages. But he says that it's also almost inevitable: One Facebook engineer took Deep Text's "brains" and trained it how to speak Indonesian in a weekend. 

That ability to learn will also behoove Facebook's future artificial intelligence efforts, especially around chatbots. Unlike Google, Facebook's users are speaking the way that real actual humans speak. It'll make for more humanoid bots.

"I think with Facebook data, we can make AI far more human, and social, and conversational," says Mehanna.

More from Entrepreneur

Get heaping discounts to books you love delivered straight to your inbox. We’ll feature a different book each week and share exclusive deals you won’t find anywhere else.
Jumpstart Your Business. Entrepreneur Insider is your all-access pass to the skills, experts, and network you need to get your business off the ground—or take it to the next level.
Starting, buying, or growing your small business shouldn’t be hard. Guidant Financial works to make financing easy for current and aspiring small business owners by providing custom funding solutions, financing education, and more.

Latest on Entrepreneur

Entrepreneur Media, Inc. values your privacy. In order to understand how people use our site generally, and to create more valuable experiences for you, we may collect data about your use of this site (both directly and through our partners). By continuing to use this site, you are agreeing to the use of that data. For more information on our data policies, please visit our Privacy Policy.