Ollama's OpenAI compatible endpoint now also supports tools, allowing the use of Llama 3.1 and other models. Future improvements include streaming tool calls and tool choice, which will force a model to use a tool. The company encourages feedback and collaboration from its users, inviting them to share their thoughts via Discord or email.
Key takeaways:
- Ollama now supports tool calling with popular models such as Llama 3.1, enabling models to perform more complex tasks or interact with the outside world.
- To enable tool calling, a list of available tools should be provided via the 'tools' field in Ollama’s API.
- Supported models will now answer with a 'tool_calls' response, and tool responses can be provided via messages with the 'tool' role.
- Ollama’s OpenAI compatible endpoint also now supports tools, making it possible to switch to using Llama 3.1 and other models.