Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

ChatGPT Exploit Finds 24 Email Addresses, Amid Warnings of 'AI Silo' - Slashdot

Dec 25, 2023 - yro.slashdot.org
A research team, including Rui Zhu, a Ph.D. candidate at Indiana University Bloomington, managed to extract a list of business and personal email addresses for over 30 New York Times employees from OpenAI's GPT-3.5 Turbo. The team was able to bypass the model's restrictions on responding to privacy-related queries, raising concerns about the potential for AI tools like ChatGPT to reveal sensitive personal information. The researchers accessed ChatGPT via its API, where requests typically denied in the interface were accepted, highlighting a vulnerability in the AI's training-data memory.

In related news, a professor at the University of California, Berkeley's school of information warns that Microsoft's increasing investment in OpenAI, including a recent $10 billion investment, could lead to the creation of an AI silo in a walled garden. This could be detrimental to technology development and potentially dangerous for society and the economy. The professor calls for the U.S. government to intervene and reverse the trend towards AI in walled gardens, emphasizing the need for robust competition and an open ecosystem to maximize the benefits and manage the risks of AI technology.

Key takeaways:

  • A research team was able to extract personal and business email addresses of over 30 New York Times employees from GPT-3.5 Turbo, a large language model from OpenAI, by bypassing the model's privacy restrictions.
  • The success of this experiment raises concerns about the potential of AI tools like ChatGPT to reveal sensitive personal information.
  • Microsoft's investment in OpenAI and its exclusive use of Microsoft's Azure cloud is being scrutinized by U.K. competition authorities and the U.S. Federal Trade Commission, as it is seen as a de facto acquisition.
  • The article calls for the U.S. government to intervene and prevent AI from being pushed into 'walled gardens', arguing that this is detrimental for technology development and potentially dangerous for society and the economy.
View Full Article

Comments (0)

Be the first to comment!