CHAI, which started as an all-volunteer organization in 2021, incorporated following President Biden’s AI executive order in October 2023. It registered as a nonprofit membership organization known as a 501(c)6 in January 2024. The group plans to create working groups to develop standards and testing and evaluation frameworks, and health systems will establish assurance labs in the third and fourth quarters. The labs will validate AI models as fair and accurate across different types of patients, with all testing information available in a public registry.
Key takeaways:
- The Coalition for Health AI (CHAI) is a newly incorporated nonprofit aiming to standardize, test, validate, and track the use of AI in healthcare. It plans to establish standards, testing metrics, a network of health AI assurance labs, and a national registry of validated health AI tools.
- CHAI was formed in response to President Biden’s AI executive order, which emphasized the need for safety in healthcare applications. It has over 1,300 member organizations and plans to implement a membership dues structure.
- CHAI has announced partnerships with the National Council on Health and HL7, a national health information technology standards organization. It also has a government advisory board with several officials from the Biden Administration.
- Health AI developers will be able to bring their models to CHAI's assurance labs to be validated as fair and accurate across different types of patients. The results of these tests will be available in a public registry to increase trust in AI.