Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

WTF is OpenAI’s GPTBot?

Sep 11, 2023 - digiday.com
In August, OpenAI introduced a feature allowing website owners to block its GPTBot web crawler from accessing their content. Since then, 12% of the 1000 most-visited websites have utilized this feature, including major publishers like Bloomberg, CNN, and The New York Times, according to Originality AI. This move is seen as a new tool for publishers to protect their content from AI threats.

The issue at hand is that generative AI tools like ChatGPT have been bypassing paywalls and using the content to inform their large language models. OpenAI's new feature aims to make it easier for publishers to protect their content. The article also mentions an explainer video that provides more details about what a web crawler is and how websites can block their access.

Key takeaways:

  • OpenAI has provided a tool for website owners to block its GPTBot web crawler from accessing their webpages’ content.
  • Since the announcement in August, 12% of the 1000 most-visited sites online have blocked OpenAI's web crawlers, including Bloomberg, CNN and The New York Times.
  • Publishers have been struggling to protect against generative AI tools like ChatGPT, which bypass their paywalls and use their content to inform large language models.
  • OpenAI's new tool makes it easier for publishers to protect their content from being accessed by AI tools.
View Full Article

Comments (0)

Be the first to comment!