Facebook Will Start Scanning 10,000 Posts a Second to Make Comments Less Terrible

Facebook Will Start Scanning 10,000 Posts a Second to Make Comments Less Terrible
Image credit: Getty Images/Justin Sullivan
Facebook founder and CEO Mark Zuckerberg.

Grow Your Business, Not Your Inbox

Stay informed and join our daily newsletter now!
3 min read
This story originally appeared on Business Insider

While Facebook has lot of noise around using artificial intelligence to better sort photos and videos, text is still an huge part of the Facebook experience. 

Today, we got a look behind the scenes on how AI is helping Facebook sift all that text and improve the Facebook experience with "Deep Text" -- a system developed by Facebook's AI labs that scans 10,000 posts every second in 20 languages.

People post more than 1 billion items -- statuses, links, photos, whatever -- to Facebook every day, says a company spokesperson.

Deep Text is "-based text understanding engine," as Facebook puts it. Its ability to understand text like a human would is already being put to work in . And Facebook plans to take it a lot further.

It's the technology behind the scenes that can distinguish the words "I need a ride," in which case Messenger might prompt you to order an Uber, versus "I was going to get a ride," in which case the moment has already passed. Not to mention "I like to ride a donkey," which is a whole different thing entirely.

More intriguingly, Mehanna says Deep Text can be used in busy Facebook comment threads. 

Say for example when does a live Facebook Q&A, and the top few comments are often in another language, off-topic, or both: 

It can be hard to sift out the relevant comments, as this screenshot of a recent Mark Zuckerberg post's comments proves.

"It becomes really hard to find interesting comments," says Mehanna.

Mehanna says that there's a lot of potential for Deep Text to scan those comments and rank them for you, personally. If Facebook's AI has figured out that you speak English and Farsi, it'll prioritize relevant comments in those languages so you see them first -- while pushing annoying things down.

It's an elegant solution for Facebook: It maintains the platform's very public commitment to global free speech, since Deep Text isn't actually deleting the comments. 

But it also means that you'll see relevant comments in your own language first, making for a better Facebook experience. And if the comments do contain spam or straight-up hate speech, Deep Text could one day be empowered to automatically regulate. 

Another cool thing is that Deep Text will be able to understand when your Facebook status is offering an item for sale, and offer to cross-list it automatically to your regional networks.

Going forward, Mehanna says that they want to train Deep Text to understand more of Facebook's 40 officially-supported languages. But he says that it's also almost inevitable: One Facebook engineer took Deep Text's "brains" and trained it how to speak Indonesian in a weekend. 

That ability to learn will also behoove Facebook's future artificial intelligence efforts, especially around chatbots. Unlike , Facebook's users are speaking the way that real actual humans speak. It'll make for more humanoid bots.

"I think with Facebook data, we can make AI far more human, and social, and conversational," says Mehanna.

More from Entrepreneur

We created the SYOB course to help you get started on your entrepreneurial journey. You can now sign up for just $99, plus receive a 7-day free trial. Just use promo code SYOB99 to claim your offer.
Jumpstart Your Business. Entrepreneur Insider is your all-access pass to the skills, experts, and network you need to get your business off the ground—or take it to the next level.
Are you paying too much for business insurance? Do you have critical gaps in your coverage? Trust Entrepreneur to help you find out.

Latest on Entrepreneur