Ollama
Run large language models locally or in the cloud with Ollama
This is a first-class FlyMyAI MCP. Agents discover it automatically via tool search and call the actions below on demand - you never wire it up by hand. See the Composio catalog for how discovery works.
Connect
Ollama authenticates with an API key. Generate the credential in your Ollama account, then paste it into FlyMyAI the first time an agent uses an Ollama action.
Fields to fill in FlyMyAI
| Field | Details |
|---|---|
Ollama Instance URL | The base URL of your Ollama instance (e.g., http://localhost:11434 for local or https://ollama.com/api for cloud) (required) |
API Key | Optional API key for Ollama Cloud (get from https://ollama.com/settings/keys) or for reverse proxy authentication on self-hosted instances |
Actions
Every action this integration exposes. Agents pick the right one from the task; you do not call them by name.
| Action | What it does | Required inputs |
|---|---|---|
OLLAMA_CHAT | Tool to send a chat message with conversation history to Ollama. Use when you need to have a multi-turn conversation with an LLM model. | model, messages |
OLLAMA_GENERATE | Tool to generate text responses from Ollama models with optional raw mode. Use raw=true to bypass prompt templating when you need full control over the prompt for debugging or custom processing. Note that raw mode will not return a context. | model |
OLLAMA_LIST_MODELS | Tool to list all available Ollama models and their details. Use when you need to fetch installed models with metadata including name, size, last modified timestamp, digest, and format information. | - |
OLLAMA_OPEN_AI_CHAT_COMPLETIONS | Tool to create OpenAI-compatible chat completions using Ollama models. Use when you need conversational AI responses with OpenAI API format compatibility. | model, messages |
OLLAMA_OPEN_AI_COMPLETIONS | Tool to create OpenAI-compatible text completions using Ollama models. Use when you need text generation with OpenAI API format compatibility beyond chat-based interactions. | model, prompt |
OLLAMA_OPEN_AI_LIST_MODELS | Tool to list available models using OpenAI-compatible API format. Use when you need to retrieve locally available Ollama models with metadata following OpenAI's model list format. | - |
OLLAMA_SHOW | Tool to show comprehensive information about an Ollama model. Use when you need to retrieve model details, parameters, template, license, or system prompt. | model |
OLLAMA_VERSION | Tool to get the version of Ollama running locally. Use to check which version of Ollama is currently installed. | - |
Links
We love our partners - FlyMy.AI builds with the best. Thanks, Ollama!