Get All Access for $5/mo

AI-Generated Voices and Deepfakes Are Surging on TikTok, Other Platforms — And European Regulators Have Had Enough Advanced AI tools are enabling the creation of eerily convincing fake voices and deepfakes, and it's being exacerbated amid the Israel-Hamas conflict.

By Madeline Garfinkle

Key Takeaways

  • AI's advanced voice cloning capabilities create realistic deepfakes, raising concerns for misinformation.
  • As deepfake content infiltrates mainstream channels, misinformation is rampant.

Opinions expressed by Entrepreneur contributors are their own.

A convincing artificial intelligence voice, closely resembling that of former President Barack Obama, emerged on TikTok in late August, addressing allegations surrounding the death of his former chef.

"I am deeply saddened by the tragic loss of Tafari Campbell [mispelled in the video as Talafi Cambell]," fake Obama says in the video, "who was not just an employee, but a valued member of our extended family."

The (eerily convincing) voice is the result of new tools allowing AI to clone and manipulate real voices with ease and humanlike mimicry, commonly known as "deepfakes."

Since the release of these tools in 2017, AI-generated voices have been employed in videos to propagate disinformation, as exemplified by the fake Obama video identified by NewsGuard, The New York Times reported.

TikTok CEO Shou Zi Chew listens to questions from U.S. representatives during his testimony at a Congressional hearing on TikTok in Washington, DC on March 23rd, 2023. Nathan Posner/Anadolu Agency | Getty Images.

The NewsGuard report released late last month found that the deepfake Obama video was one of 17 in a network of accounts generating and posting fake news content. Thirteen of the 17 accounts were discovered to be deceptively branded to resemble mainstream news outlets, TV shows, and well-known TikTok accounts, blurring the lines between what is real and AI-generated for an unsuspecting scroller.

Platforms like TikTok are now grappling with the challenge of flagging and labeling AI-generated content, and although TikTok has introduced tools for labeling AI-generated content, the issue remains a concern as new content is rapidly posted on various platforms, including YouTube, Instagram, and Facebook.

Related: 'Biggest Risk of Artificial Intelligence': Microsoft's President Says Deepfakes Are AI's Biggest Problem

While motives may vary, AI-generated content can serve as a means for bad actors to manipulate public opinion and spread falsehoods.

EU Calls on Meta and X to Take Action Against Misinformation

On Wednesday, European regulator Thierry Breton penned a letter to Mark Zuckerberg, CEO of Meta, urging him to be "vigilant" in combating disinformation on his company's platforms amidst the ongoing Israel-Hamas conflict, CNBC reported.

"After the terrorist attacks by Hamas on Israel on Saturday, we quickly established a special operations center staffed with experts, including fluent Hebrew and Arabic speakers, to closely monitor and respond to this rapidly evolving situation," a Meta spokesperson told the outlet. "Our teams are working around the clock to keep our platforms safe, take action on content that violates our policies or local law, and coordinate with third-party fact-checkers in the region to limit the spread of misinformation."

Breton sent a letter to X owner Elon Musk the day before, stating that there were "indications" that groups were sharing misinformation and content of a "violent and terrorist" nature concerning the Israel-Hamas conflict on the platform.

X CEO Linda Yaccarino responded to the letter on Thursday on X, stating that the platform is taking action to remove or label "tens of thousands" of pieces of content that could indicate misinformation.

"In response to the recent terrorist attack on Israel by Hamas, we've redistributed resources and refocused internal teams who are working around the clock to address this rapidly evolving situation," the CEO added.

Since the attack by Hamas on Saturday, Reuters has fact-checked and identified at least 15 videos labeled as occurring during the current conflict, when, in reality, they were found to either predate the attacks or occurred in entirely different parts of the world.

Reuters also found that a video of CNN journalists seeking shelter from rockets near the Israel-Gaza border was fabricated and manipulated with a voiceover instructing them to stage their coverage, giving a false impression that CNN orchestrated the attack.

Related: 'This Is Personal': What Business Leaders Around the World Are Saying About Hamas' Attack on Israel

Madeline Garfinkle

News Writer

Madeline Garfinkle is a News Writer at Entrepreneur.com. She is a graduate from Syracuse University, and received an MFA from Columbia University. 

Want to be an Entrepreneur Leadership Network contributor? Apply now to join.

Editor's Pick

Business Solutions

Increase Productivity with This Microsoft 365 Subscription, Now $25 Off

It can make the entrepreneur life a lot easier.

Business News

Apple Pay Later Is Ending. Here's What's Taking Its Place.

The program was available for less than a year.

Leadership

This Artist Answered a Businessman's 'Powerful' Question — Then His Work Became 'the Poster Child for Juneteenth': 'Your Network Really Becomes Your Net Worth'

Reginald Adams was the executive director of a Houston-based art museum for more than a decade before he decided to launch his own public art and design firm.

Leadership

Harvard Business School Professor Says 65% of Startups Fail for One Reason. Here's How to Avoid It.

Team alignment isn't nice to have -- it's critical for running a successful business.

Business News

Here's What Companies Are Open and Closed on Juneteenth 2024

Since it became a holiday in 2021, Juneteenth has been recognized by some major corporations as a paid day off.

Growing a Business

I Hit $100 Million in Annual Revenue by Being More Transparent — Here Are the 3 Strategies That Helped Me Succeed

Three road-tested ways to be more transparent and build relationships that can transform your business — without leaving you feeling nightmarishly over-exposed.