Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Watch: Reddit is taking a stand against AI crawlers

Jun 27, 2024 - techcrunch.com
Reddit is changing its Robots Exclusion Protocol, or robots.txt file, to prevent AI companies from using its content without compensation. The move is part of a larger negotiation between AI companies that use content to train their language models and the companies that own the content. Reddit's changes aim to prevent practices like those of Perplexity AI, which has been criticized for using content without sending traffic back to the original site or outright plagiarizing.

In other AI news, Meta is being accused of tagging real photos as "Made with AI", OpenAI rival Anthropic released its newest generative AI model, Claude 3.5 Sonnet, and LinkedIn is moving towards AI features. Apple announced its big move into AI with a new technology called Apple Intelligence, and a recent study looked at the political leanings of different text-analyzing AI models.

Key takeaways:

  • Reddit is changing its Robots Exclusion Protocol, or robots.txt file, in a move seen as a stand against AI companies that use its content to train their language models.
  • The change is aimed at preventing practices like those of Perplexity AI, which has been criticized for using content without providing traffic or value in return.
  • Reddit is also continuing to rate limit and block unknown bots and crawlers to protect its content.
  • Other companies and platforms are also grappling with issues around AI and content use, with Meta tagging real photos as “Made with AI” and LinkedIn offering AI-written cover letters.
View Full Article

Comments (0)

Be the first to comment!