Glide

Glide Overview

Glide is a high-performance, cloud-native, open-source LLM gateway. It is designed to deliver efficient LLMOps in a single binary. Glide offers a simplified approach to building application resilience, reducing latency, and managing API keys, among other features. It is written in Golang and follows the best practices of software development in cloud-native environments.

Glide Highlights

• Unified API: Glide allows you to change your model providers without the need to modify your applications.
• High Performance: Glide is written in Golang and is designed for high performance in cloud-native environments.
• Flexible Routing: Glide supports various routing strategies across several models, including the least latency, weighted round-robin, round-robin, and priority-based routing. It also includes low-latency fallback mechanisms for resiliency.