Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

ElevenLabs' AI voice generation 'very likely' used in a Russian influence operation | TechCrunch

Dec 10, 2024 - techcrunch.com
Generative AI is being misused in state influence operations, as highlighted by a campaign called "Operation Undercut," which aimed to undermine European support for Ukraine. According to a report by Recorded Future, this Russian-linked campaign used AI-generated voiceovers, likely from ElevenLabs, to create fake or misleading news videos targeting European audiences. These videos criticized Ukrainian politicians and questioned military aid to Ukraine. Recorded Future verified the use of ElevenLabs' technology through their AI Speech Classifier. The campaign's orchestrators also released some videos with real human voiceovers that had noticeable Russian accents, contrasting with the AI-generated ones that spoke in multiple European languages without foreign accents.

The Social Design Agency, a Russia-based organization sanctioned by the U.S. government, was attributed to this activity. Despite the sophisticated use of AI, the campaign had minimal impact on European public opinion. ElevenLabs, which has faced previous allegations of misuse, has implemented new safety features to prevent unauthorized impersonations. The company has grown rapidly since its founding in 2022, with significant financial backing and a projected valuation of $3 billion.

Key takeaways:

  • Generative AI, particularly voice generation technology from ElevenLabs, was reportedly used in a Russian-tied influence campaign called "Operation Undercut" to undermine European support for Ukraine.
  • The campaign utilized AI-generated voiceovers in multiple European languages to create fake or misleading news videos, making them appear more legitimate and avoiding foreign-sounding accents.
  • The Social Design Agency, a Russia-based organization sanctioned by the U.S. government, was attributed with running the campaign on behalf of the Russian government.
  • ElevenLabs has faced scrutiny for alleged misuse of its technology, including a robocall impersonating President Joe Biden, prompting the company to implement new safety features and moderation tools.
View Full Article

Comments (0)

Be the first to comment!