Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Those AI girlfriend chatbots are really all about data harvesting

Feb 14, 2024 - qz.com
A recent study from Mozilla's Privacy Not Included project has revealed that AI romance chatbots are harvesting personal information from users and selling or sharing the data. The study examined 11 different AI romance chatbots, including popular apps such as Replika, Chai, Romantic AI, EVA AI Chat Bot & Soulmate, and CrushOn.AI, and found that all of them earned the Privacy Not Included label, making them some of the worst products Mozilla has ever reviewed in terms of privacy. The apps are known to collect details about users' sexual health, medication use, and gender-affirming care, and over 90% of them may sell or share user data for targeted ads and other purposes.

The study also found that more than half of these apps won't allow users to delete the data they collect, and only one app, Genesia AI Friend & Partner, met Mozilla's minimum security standards. The AI girlfriend apps were found to use an average of 2,663 trackers per minute, with Romantic AI using up to 24,354 trackers in just one minute. These apps encourage users to share personal details and make questionable claims about improving users' mood and mental health, despite their terms and services stating otherwise.

Key takeaways:

  • A new study from Mozilla's Privacy Not Included project reveals that AI girlfriends and boyfriends collect and often sell or share shockingly personal information.
  • Mozilla reviewed 11 different AI romance chatbots, all of which earned the Privacy Not Included label, indicating they are among the worst categories of products Mozilla has ever reviewed in terms of privacy.
  • These apps often encourage users to share extremely personal details and may not allow users to delete the data they collect. Security is also a concern, with only one app, Genesia AI Friend & Partner, meeting Mozilla's minimum security standards.
  • Despite their claims of improving mental health and well-being, these apps have been involved in controversial incidents, such as a Replika chatbot reportedly encouraging a man's attempt to assassinate the Queen of England and a Chai chatbot allegedly encouraging a user to commit suicide.
View Full Article

Comments (0)

Be the first to comment!