Get All Access for $5/mo

The Most Common Misuse of GenAI Is For Influencing Public Opinion: Google's DeepMind When it comes to goals and strategies of misuse, Opinion Manipulation ranked first with 27 per cent of all reported cases

By Paromita Gupta

You're reading Entrepreneur India, an international franchise of Entrepreneur Media.

Freepik

A recently published study 'Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data' by DeepMind, a division of Google's parent company Alphabet revealed that the most common misuse of artificial intelligence is the creation of deepfakes of politicians and celebrities, rather than AI-assisted cyber attacks.

The findings are based on the analysis of media reports of GenAI misuse between January 2023 and March 2024.

Source: Report

The study notes that the most reported cases of GenAI misuse involve actors exploiting the capabilities of these systems, rather than launching direct attacks at the models themselves. Nine out of ten cases fall into this category, DeepMind shared.

Manipulation of human likeness is the most prevalent cluster of tactics. These may include Impersonation; Sockpuppeting: Appropriated Likeness: and NCII. Scaling & Amplification and Falsification are also prominent tactics, accounting for 13 per cent and 12 per cent of reported cases respectively.

When it comes to goals and strategies of misuse, Opinion Manipulation ranked first with 27 per cent of all reported cases, followed by Monetization & Profit at 21 per cent and Scam & Fraud at 18 per cent.

In case of Opinion Manipulation, a range of tactics are deployed to distort the public's perception of political realities. These include impersonating public figures, using synthetic digital personas to simulate grassroots support for or against a cause ('astroturfing'), and creating falsified media.

Deemed as the 'election year, 2024 will see at least 64 countries head to the polls. The influence of deepfakes has been felt in countries like the USA, Nigeria, and Bangladesh, particularly during elections. In India, voters saw deep fakes of politicians and celebrities such as Aamir Khan, Ranveer Singh, and KT Rama Rao make rounds during the election phases. Other cases include Vladimir Putin declaring martial law after Ukrainian forces entered Russian territory;

ALSO READ: Election Essentials: 4 Websites to Identify Deepfakes and Fake News During India's 2024 Elections

The study found defamation to be another central strategy for opinion manipulation. According to the study, data involved depicted electoral candidates spouting abuse towards protected groups, party staffers, or their own constituents; while in other cases, actors shared AI-generated images of politicians appearing visibly aged to make them look unfit for leadership, and showing them in intimate settings with other public figures.

A common factor was the lack of appropriate disclosure around the use of GenAI tools in the context of campaigning risks misleading users and causing harm through deception.

The second most common goal behind GenAI misuse was to monetize products and services. These tactics include content scaling, amplification, and falsification.

Content farming saw users producing low-quality AI-generated articles, books, and product ads for placement on websites such as Amazon and Etsy to cut costs and capitalize on advertising revenue. The creation of non-consensual intimate imagery (NCII) constituted a significant portion. This tactic saw the creation and selling of sexually explicit videos of celebrities who did not consent to the production of that content.

The Scam & Fraud misuse saw the leveraging of real identities to deceive victims. This included celebrity scam ads and phishing scams. These not only infringe upon the targeted individual or organization's rights and reputation but also inflict a financial and psychological cost on victims.

"Addressing these challenges will require not only technical advancements, but a multi-faceted approach to interventions, involving collaboration between policymakers, researchers, industry leaders, and civil society. We highlight these implications in our discussion," said Nahema Marchal, lead author of the study and researcher at Google DeepMind on X.

Paromita Gupta

Entrepreneur Staff

Features Writer with Entrepreneur India

Covering news and trends in AI and Metaverse segments. An avid book reader running her personal blog on the side. You may reach me at paromita@entrepreneurindia.com. 
News and Trends

"45% of All Ongoing Hydropower Projects in India are Ours": Patel Engineering

Patel Engineering reported a turnover of INR 4,400 crore in the last fiscal year, with a projected 10 per cent growth for the current year.

Side Hustle

'Hustling Every Day': These Friends Started a Side Hustle With $2,500 Each — It 'Snowballed' to Over $500,000 and Became a Multimillion-Dollar Brand

Paris Emily Nicholson and Saskia Teje Jenkins had a 2020 brainstorm session that led to a lucrative business.

Science & Technology

5 Rule-Bending AI Hacks to Make Your Mornings More Productive and Profitable

By 2025, AI will transform productivity by streamlining workflows and cutting costs. Major companies like Microsoft, Google, and OpenAI are leading the way, advancing AI into "Phase 3," where tools act as digital assistants. Discover 5 AI hacks to boost efficiency and redefine your daily routine.

Marketing

5 Critical Mistakes to Avoid When Giving a Presentation

Are you tired of enduring dull presentations? Over the years, I have compiled a list of common presentation mistakes and how to avoid them. Here are my top five tips.

Leadership

Should I Stay or Should I Go? 8 Key Points to Navigate the Founder's Dilemma

Here are eight key signs that help founders determine whether to persevere or let go.

Business News

Former Steve Jobs Intern Says This Is How He Would Have Approached AI

The former intern is now the CEO of AI and data company DataStax.