Open DocumentationOpen Docs

Ollama

Learn how to deploy an open source model with OpenAgent using Ollama.

Introduction

Ollama is a model deployment solution, it enables the quick deployment of many open source models. See: https://ollama.com.

OpenAgent uses Ollama to accelerate your deployment process.

When defining your MODEL_NAME in .env file, use the exact model name from https://ollama.com/library.

Model Compatibility

Theoretically, all models listed on https://ollama.com/library, are compatible with OpenAgent, with a varying degree of performance. Models that support function calling tend to have better overall performance. We have tested with a few models, see our evaluation results:

Compatible Models

Learn about the models compatible with OpenAgent.

On this page