Welcome to LLM ATC’s documentation! — LLM ATC 0.1.3 documentation
Aug 14, 2023 - llm-atc.readthedocs.io
LLM-ATC is a tool designed for finetuning and serving open source large language models (LLMs). It is a multi-cloud tool, meaning it can be used across various cloud platforms including AWS, Azure, GCP, Lambda Cloud, IBM, Samsung, OCI, and Cloudflare. It allows for finetuning on any of these platforms and supports serving on AWS and GCP, with more cloud platforms currently in development.
The tool also provides the feature of saving models to an object store like S3 or GCS, enabling access from anywhere. Additionally, it includes a model registry for serving custom finetuned models. This documentation provides further details and references for using the LLM-ATC tool.
Key takeaways:
LLM-ATC is a tool for finetuning and serving open source large language models (LLMs) and is multi-cloud with one interface.
It allows finetuning on any cloud including AWS, Azure, GCP, Lambda Cloud, IBM, Samsung, OCI, Cloudflare.
Serving is supported on AWS and GCP, with more clouds in development. Models are saved to object store (e.g. S3, GCS) for access anywhere.
LLM-ATC also provides a model registry for serving custom finetuned models.
