Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally

Aug 22, 2023 - github.com
Ollama is a platform designed to run, create, and share large language models (LLMs). It is currently in its early preview stage and supports a list of open-source models available on its library. The platform allows users to download models, build from source, and even create custom models. It also provides a REST API for running and managing models.

The platform bundles model weights, configuration, and data into a single package, defined by a Modelfile. It also provides a list of tools that use Ollama, including LangChain, Continue, LiteLLM, Discord AI Bot, Raycast Ollama, Simple HTML UI for Ollama, and Emacs client for Ollama. The platform is available for download on macOS, with Windows and Linux versions coming soon.

Key takeaways:

  • Ollama is a platform for running, creating, and sharing large language models (LLMs).
  • It supports a list of open-source models available on ollama.ai/library, including Llama2, Orca Mini, Vicuna, and Nous-Hermes among others.
  • Ollama bundles model weights, configuration, and data into a single package, defined by a Modelfile.
  • Various tools use Ollama, including LangChain, Continue, LiteLLM, Discord AI Bot, Raycast Ollama, Simple HTML UI for Ollama, and Emacs client for Ollama.
View Full Article

Comments (0)

Be the first to comment!