Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

NYC’s AI Chatbot Tells Businesses to Break the Law – The Markup

Mar 29, 2024 - themarkup.org
New York City's AI-powered chatbot, designed to provide information on starting and operating a business in the city, is reportedly giving out inaccurate and potentially illegal advice. The bot, which was launched five months ago, has been found to provide incomplete or incorrect information on housing policy, worker rights, and rules for entrepreneurs. For instance, it incorrectly informed landlords that they did not need to accept tenants on rental assistance and suggested that it was legal to lock out a tenant. It also gave false information about the city's consumer and worker protections.

The bot, powered by Microsoft’s Azure AI services, is part of the city's MyCity project, a portal for viewing government services and benefits. Despite the bot's inaccuracies, the NYC Office of Technology and Innovation stated that the chatbot is a pilot program that will improve over time. Critics, however, argue that if the chatbot cannot provide accurate and responsible information, it should be taken down. The bot's errors have raised concerns about the use of AI in public services, with similar issues reported with chatbots in other industries.

Key takeaways:

  • New York City's AI-powered chatbot, designed to provide information on starting and operating a business in the city, is reportedly giving out incorrect and potentially illegal advice.
  • The bot has been found to provide false information on housing policy, worker rights, and rules for entrepreneurs, with one expert describing the information as 'dangerously inaccurate'.
  • Despite being a pilot program, concerns have been raised about the potential harm caused by the bot's misinformation, with calls for it to be taken down if it cannot provide accurate and responsible information.
  • The bot is powered by Microsoft's Azure AI services and is part of the city's MyCity project, a portal for viewing government services and benefits.
View Full Article

Comments (0)

Be the first to comment!