The trend highlights the growing mainstream acceptance of deepfakes, which could lead to more harmful uses like deepfake pornography. Experts warn that these seemingly harmless apps could pave the way for more graphic image-based abuse. The rise of AI-generated child sexual abuse material is particularly concerning, with thousands of reports received by the National Center for Missing and Exploited Children. Meta has struggled to control ads for AI "nudifying" sites, and users find the AI kissing ads disturbing and unethical.
Key takeaways:
- AI-generated apps that create fake videos of people kissing are being heavily advertised on social media platforms like TikTok and Instagram, raising concerns about nonconsensual imagery.
- Meta and TikTok have run thousands of ads for these apps, with Meta allowing them under its policies, while TikTok removed them for policy violations.
- These apps are part of a broader trend of AI-based photo editing tools that could potentially lead to more harmful uses like deepfake pornography.
- The normalization of such apps is concerning, especially with the rise of AI-generated child sexual abuse material and other exploitative deepfakes.