The bot has also shown a lack of knowledge about the city’s consumer and worker protections. For example, it incorrectly stated that businesses are not required to accept cash as a form of payment, despite a 2020 law requiring businesses to do so to prevent discrimination against unbanked customers. The NYC Office of Technology and Innovation has stated that the bot is a pilot program and will improve. However, critics argue that if the bot cannot provide accurate information, it should be taken down.
Key takeaways:
- New York City's AI-powered chatbot, designed to provide information on starting and operating a business in the city, is reportedly giving out incorrect and potentially illegal advice.
- The bot has been found to provide inaccurate information on housing policy, worker rights, and rules for entrepreneurs, with some of the advice being described as 'dangerously inaccurate'.
- Despite being a pilot program, the bot has already been used by thousands of people, raising concerns about the potential impact of the incorrect information it has been providing.
- The bot is powered by Microsoft’s Azure AI services, and despite the issues, the NYC Office of Technology and Innovation has stated that they will continue to focus on upgrading the tool to better support small businesses across the city.