Baseten grabs $75M to crank up high-performance inference for AI workloads

Baseten Labs Inc., an AI startup specializing in high-performance inference for large language models, has secured a $75 million Series C funding round led by IVP and Spark Capital, bringing its total funding to $135 million. The company offers an AI inference platform that enables enterprises to run LLMs on cloud or on-premises infrastructure, addressing the challenge of accessing high-performance GPUs. By leveraging public cloud infrastructure from providers like AWS, Google Cloud, and Microsoft, Baseten ensures reliable GPU access and reduces inference costs by around 40% for its customers. The platform includes a library of models, tools for deploying and managing LLMs, and access to applied research and AI engineers. Baseten claims to have over 100 enterprise customers, including Patreon, Writer, and Descript, and has grown its revenue six-fold in the past year.

Co-founder and CEO Tuhin Srivastava emphasizes the importance of speed, reliability, and cost-efficiency in AI product deployment, stating that Baseten's ability to guarantee GPU resources is a key differentiator. Spark Capital’s Will Reed highlights the necessity of exceptional inference performance for successful AI projects, noting that choosing the right partner is crucial for product success. Baseten's focus on providing fast and reliable inference solutions has enabled it to attract a significant customer base and achieve rapid revenue growth.

Key takeaways

Baseten Labs Inc. has raised $75 million in a Series C funding round, bringing its total funding to $135 million, to enhance high-performance inference for AI workloads.
The company provides an AI inference platform that allows enterprises to run large language models either in the cloud or on-premises, ensuring fast and reliable access to GPU resources.
Baseten claims its services can reduce inference costs by around 40% for customers, contributing to a six-fold revenue growth over the past year.
With over 100 enterprise customers, including Patreon, Writer, and Descript, Baseten focuses on speed, reliability, and cost-efficiency to help companies bring high-quality AI products to market quickly.

Baseten grabs $75M to crank up high-performance inference for AI workloads - SiliconANGLE

Key takeaways

Discussion (0)