Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

This new tool could give artists an edge over AI

Oct 24, 2023 - technologyreview.com
Artists are protesting against tech companies' practice of scraping their visual work from the internet to train their AI models. A new tool called Nightshade, developed by a lab led by Ben Zhao, a computer science professor at the University of Chicago, could change this power dynamic. Nightshade subtly alters the pixels of an image in a way that's invisible to the human eye but tricks machine-learning models into misinterpreting the image, causing the model to malfunction. This could potentially deter tech companies from scraping data that could damage their AI models.

The fight against unauthorized data scraping extends beyond artists to anyone who posts content online. Tools like Nightshade could help shift the power balance back to the content creators. Meanwhile, some companies like OpenAI and Stability AI have offered artists the option to opt out of training sets or have pledged to respect requests not to scrape their work. However, there is currently no mechanism to enforce these promises.

Key takeaways:

  • A new tool called Nightshade developed by a lab at the University of Chicago can subtly alter the pixels of an image in a way that tricks machine-learning models into misinterpreting the image. This could potentially disrupt the training of AI models that use scraped images.
  • Artists are increasingly protesting against the tech sector's practice of scraping their work off the internet to train AI models, with some even filing lawsuits over copyright.
  • Some companies like OpenAI and Stability AI have offered to let artists opt out of training sets or have said they will respect requests not to have their work scraped. However, there's currently no mechanism to enforce these promises.
  • Artists and other content creators are calling for tech companies to shift from opt-out mechanisms to asking for consent first and to start compensating artists for their contributions.
View Full Article

Comments (0)

Be the first to comment!