GitHub - phospho-app/phospho: Text analytics for LLM apps. The PostHog for prompts. Extract evaluations, intents and events from text messages. phospho leverages LLM (OpenAI, MistralAI, Ollama, etc.)
Mar 13, 2024 - github.com
Phospho is a text analytics platform designed for LLM apps, allowing for the detection of issues and extraction of insights from user text messages. The platform facilitates user feedback collection, success measurement, and iterative app improvement. Key features include flexible logging, automatic evaluation, insights extraction, data visualization, and collaboration. The phospho lab, the core analytics component of phospho, enables batched evaluations and event detections on messages.
The platform can be self-deployed, with the repository containing the implementation of the platform frontend, the API backend, and the insights extraction pipeline. The hosted version can also be accessed for collaborative phospho lab evaluations. The project is licensed under the Apache 2.0 License. Related projects include the phospho Javascript client, phospho UI React components, and phospho fastassert constrained inference.
Key takeaways:
Phospho is a text analytics platform for LLM apps that helps detect issues and extract insights from text messages of users or the app.
Key features of Phospho include flexible logging, automatic evaluation, insights extraction, data visualization, and collaboration.
The platform can be self-deployed and requires Docker and Docker Compose for installation.
Phospho also offers a hosted version for managing lab evaluations on a collaborative platform.
