The piece raises concerns about the impact on individuals whose images are used without their consent, including celebrities, influencers, and sex workers. It also discusses the broader implications of this trend, with some experts suggesting that the proliferation of AI-generated porn represents a kind of "singularity" in which human images are merely raw material for AI to generate any kind of sexual image.
Key takeaways:
- Generative AI tools have led to a massive increase in non-consensual porn, with platforms like CivitAI hosting thousands of models that can produce any kind of pornographic scenario.
- These AI models are often trained on real images of real people scraped without consent from the internet, leading to serious ethical and privacy concerns.
- Despite some platforms having policies against generating pornographic images of real people, enforcement is difficult and non-consensual sexual imagery is still regularly posted and shared.
- The creators of these AI models often make money through donations or through programs that pay per image generated, leading to a profitable industry built on non-consensual sexual images.