Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

UnitedHealth Accidentally Makes Claims-Judging AI Public for Anyone to Use

Dec 16, 2024 - futurism.com
UnitedHealthcare's Optum Rx faced scrutiny after a chatbot, intended to assist employees with insurance claims and disputes, was accidentally made public. The chatbot, known as "SOP Chatbot," exposed logs of employee queries, raising concerns about its use in evaluating coverage. However, it is distinct from the claims-denying algorithm, nH Predict, previously criticized for inaccuracies. The chatbot's existence was not public until reported by _TechCrunch_, and it was quickly secured after the breach was discovered by cybersecurity researcher Mossab Hussein.

Optum stated that the chatbot was a demo tool for testing responses to standard operating procedure documents and was never in production or trained with real patient data. Despite assurances that the tool was not used to make decisions, the incident highlights UnitedHealth's interest in AI for claims management, echoing past controversies with similar technologies.

Key takeaways:

```html
  • UnitedHealth Group's Optum Rx pharmacy benefit manager accidentally made a chatbot, SOP Chatbot, publicly accessible, raising privacy concerns.
  • The chatbot was intended as a demo tool to answer standard operating procedure queries and was not used in production or trained with real patient data.
  • Researcher Mossab Hussein from spiderSilk discovered the privacy breach and informed TechCrunch, leading to the chatbot being locked down.
  • The incident highlights UnitedHealth's ongoing exploration of AI technologies, despite previous controversies with claims-handling AI systems.
```
View Full Article

Comments (0)

Be the first to comment!