The FTC has also expressed concerns about generative AI being used improperly or deceiving consumers, and whether voice cloning tools adequately obtain permission when using individuals' speech samples. Through the challenge, the FTC aims to guide the development of best practices for responsibly collecting and handling personal data, and techniques to accurately attribute synthetic speech and avoid misleading deepfakes.
Key takeaways:
- The Federal Trade Commission (FTC) is concerned about the potential for consumer fraud through voice cloning, and is launching an exploratory Voice Cloning Challenge to encourage the development of solutions to protect consumers from AI-enabled voice cloning harms.
- Voice cloning technology is advancing rapidly, with startups like ElevenLabs leading the way. However, this rapid advancement could lead to harmful misuse before safeguards are in place.
- Current mitigation efforts rely on voluntary practices and standards, but experts warn that self-regulation may not be enough. The FTC's challenge seeks to develop technical, legal, and policy solutions through stakeholder collaboration.
- The FTC has expressed concerns about the potential misuse of generative AI, including the use of pirated content and the risk of AI impersonating people. The Voice Cloning Challenge could help develop best practices for responsibly collecting and handling personal data, and techniques to accurately attribute synthetic speech.