However, the move has raised concerns, given the rise of AI-generated pornography, particularly deepfake porn, which involves creating explicit images or videos of real people without their consent. Danielle Keats Citron, a professor at the University of Virginia School of Law, called OpenAI's potential move "alarming," citing the damage caused by such nonconsensual intimate images. While OpenAI's usage policies prohibit impersonation without permission, it remains uncertain how the company would moderate explicit content generation to prevent misuse.
Key takeaways:
- OpenAI is considering changes to its usage policies to allow the generation of NSFW content in age-appropriate contexts through its AI technology, including ChatGPT.
- The company's Model Spec document suggests that NSFW content could include erotica, extreme gore, slurs, and unsolicited profanity.
- OpenAI's exploration of explicit content generation has raised concerns, particularly in light of the rise of AI-generated pornography and deepfake porn, which often involve nonconsensual depictions of individuals.
- While OpenAI's usage policies currently prohibit impersonation without permission, it is unclear how the company would effectively moderate explicit content generation to prevent misuse.