The move follows a surge in AI undressing apps and the misuse of AI for bullying and harassment. Google's policies aim to exclude apps featuring harmful AI-generated content. Developers are also required to monitor user feedback, avoid advertising that breaks Google Play's rules, and safeguard their apps against prompts manipulating AI features to create offensive content. Google encourages developers to use its closed testing feature for early user feedback and to document tests for future review.
Key takeaways:
- Google is issuing new guidelines for developers of AI apps on Google Play, aiming to reduce inappropriate and prohibited content. Apps with AI features must prevent the generation of restricted content and provide a way for users to flag offensive content.
- Developers are required to rigorously test their AI tools and models to ensure user safety and privacy. Google is also cracking down on apps that promote inappropriate use cases in their marketing materials.
- Google's policies aim to exclude apps from Google Play that feature AI-generated content that can be harmful or inappropriate. Developers are also responsible for safeguarding their apps against prompts that could manipulate their AI features to create harmful and offensive content.
- Google is providing resources and best practices for developers building AI apps, including its People + AI Guidebook. Developers are encouraged to use Google's closed testing feature to share early versions of their apps with users for feedback.