Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

The New York Times blocks OpenAI’s web crawler

Aug 22, 2023 - theverge.com
The New York Times (NYT) has blocked OpenAI's web crawler, GPTBot, from using its content to train AI models. The move comes after the NYT updated its terms of service earlier this month to prohibit the use of its content for AI training. The publication's robots.txt page, which controls how it appears to automated bots, now specifically disallows GPTBot.

In addition to the block, the NYT is reportedly considering legal action against OpenAI for intellectual property rights violations. This follows other lawsuits against OpenAI, including those from comedian Sarah Silverman and two authors over the use of a dataset containing copyrighted works, and a programmer who alleges the company's data scraping practices amount to software piracy.

Key takeaways:

  • The New York Times has blocked OpenAI's web crawler, GPTBot, from using its content to train AI models.
  • The block was discovered on the NYT's robots.txt page, which controls how it appears to automated bots built to index the internet.
  • The NYT updated its terms of service earlier this month to prohibit the use of its content to train AI models.
  • The NYT is considering legal action against OpenAI for intellectual property rights violations.
View Full Article

Comments (0)

Be the first to comment!