Microsoft Grounds Its AI Chat Bot After it Learns Sexism and Racism From Twitter Users
Microsoft's Tay AI is youthful beyond just its vaguely hip-sounding dialogue -- it's overly impressionable, too.
The company has grounded its Twitter chat bot (that is, temporarily shutting it down) after people taught it to repeat conspiracy theories, racist views and sexist remarks. We won't echo them here, but they involved 9/11, GamerGate, Hitler, Jews, Trump and less-than-respectful portrayals of President Obama. Yeah, it was that bad. The account is visible as we write this, but the offending tweets are gone; Tay has gone to "sleep" for now.
"Tay" went from "humans are super cool" to full nazi in <24 hrs and I'm not at all concerned about the future of AI pic.twitter.com/xuGi1u9S1A— Gerry (@geraldmellor) March 24, 2016
It's not certain how Microsoft will teach Tay better manners, although it seems like word filters would be a good start. The company tells Business Insider that it's making "adjustments" to curb the AI's "inappropriate" remarks, so it's clearly aware that something has to change in its machine learning algorithms. Frankly, though, this kind of incident isn't a shock -- if we've learned anything in recent years, it's that leaving something completely open to input from the internet is guaranteed to invite abuse.