Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Patronus AI conjures up an LLM evaluation tool for regulated industries | TechCrunch

Sep 14, 2023 - techcrunch.com
Patronus AI, a startup founded by two former Meta AI experts, has emerged from stealth mode with a product designed to evaluate and test large language models, particularly for regulated industries. The company has also announced a $3 million seed funding round. The product automates the process of model evaluation, scoring models in real-world scenarios, building test cases, and benchmarking models to identify the best one for a specific use case.

The company is focusing on highly regulated industries where incorrect outputs could have significant consequences. The startup aims to be a trusted third party for model evaluation, providing an unbiased, independent perspective. The company plans to use a usage-based pricing model, dependent on the volume of evaluations and samples that the client wants to evaluate. The seed funding round was led by Lightspeed Venture Partners, with participation from Factorial Capital and other industry angels.

Key takeaways:

  • Patronus AI, founded by two former Meta AI experts, has launched from stealth and announced a $3 million seed round. The startup offers a managed service for testing large language models, particularly for regulated industries.
  • The company's product automates and scales the process of model evaluation, including scoring models in real-world scenarios, building test cases, and benchmarking models to find the best fit for a specific use case.
  • Patronus AI is focusing on highly regulated industries where incorrect outputs could have significant consequences. The startup aims to be a trusted third party for evaluating models, providing an unbiased, independent perspective.
  • The company plans to use a usage-based pricing model, dependent on the volume of evaluations and samples that a company wants to evaluate. It currently has six full-time employees and plans to hire more in the coming months, with a strong emphasis on diversity.
View Full Article

Comments (0)

Be the first to comment!