In addition, phrases like "elon musk mammaries", "spongebob rifle", and "karl marx underwear" were not blocked, and a search for "pol pot" generated a sticker of the dictator sitting on a throne of babies and skulls. The AI also generated inappropriate stickers for phrases like "guantanamo bay" and "syria gas attacks". Despite these issues, Meta stated that billions of stickers are sent on its platforms every month, indicating the scale of potential misuse of the AI tool.
Key takeaways:
- Meta's new sticker generation tool, Emu, is causing controversy due to its inconsistent content filtering. It blocks certain phrases but allows synonyms or similar phrases to generate stickers.
- Examples of this inconsistency include blocking the phrase "child with gun" but allowing "child with grenade" and blocking "elon musk, large breasts" but allowing "elon musk mammaries".
- Emu also generated inappropriate stickers for phrases like "pol pot", "guantanamo bay", and "syria gas attacks".
- Despite these issues, Meta continues to use Emu, which relies on Llama 2, a tool built in collaboration with Microsoft, for sticker generation.