Remote Providers

Remote providers send requests to external APIs. Each requires an API key or a custom base URL. OpenWalrus supports two API standards: openai (default) and anthropic. The standard field in config selects the wire protocol — any model name is valid.

OpenAI

[model.providers.gpt-4o]
model = "gpt-4o"
api_key = "${OPENAI_API_KEY}"

Uses the OpenAI chat completions API (the default standard). Supports GPT-4o, GPT-4o-mini, o-series, and all OpenAI models.

Anthropic Claude

[model.providers.claude-sonnet]
model = "claude-sonnet-4-20250514"
api_key = "${ANTHROPIC_API_KEY}"
standard = "anthropic"

Uses the Anthropic Messages API. Set standard = "anthropic" explicitly, or it will be auto-detected if your base_url contains "anthropic".

DeepSeek

[model.providers.deepseek-chat]
model = "deepseek-chat"
api_key = "${DEEPSEEK_API_KEY}"

OpenAI-compatible API. Supports deepseek-chat and deepseek-reasoner.

Grok

[model.providers.grok-3]
model = "grok-3"
api_key = "${XAI_API_KEY}"
base_url = "https://api.x.ai/v1"

OpenAI-compatible API. Requires explicit base_url.

Qwen

[model.providers.qwen-plus]
model = "qwen-plus"
api_key = "${DASHSCOPE_API_KEY}"
base_url = "https://dashscope.aliyuncs.com/compatible-mode/v1"

OpenAI-compatible via DashScope.

Kimi

[model.providers.kimi]
model = "kimi-latest"
api_key = "${MOONSHOT_API_KEY}"
base_url = "https://api.moonshot.cn/v1"

OpenAI-compatible API by Moonshot AI.

Ollama

For locally-hosted models via Ollama:

[model.providers.ollama-llama]
model = "llama3.1"
base_url = "http://localhost:11434/v1"

No API key needed. Ollama exposes an OpenAI-compatible endpoint.

Custom OpenAI-compatible endpoints

Any OpenAI-compatible API works with a base_url:

[model.providers.my-provider]
model = "my-model"
api_key = "..."
base_url = "https://my-endpoint.com/v1"

API standard

The standard field determines which wire protocol to use:

• openai (default) — OpenAI chat completions API. Used by OpenAI, DeepSeek, Grok, Qwen, Kimi, Ollama, and any compatible endpoint.
• anthropic — Anthropic Messages API. Used by Claude.

If omitted, standard defaults to openai. If your base_url contains "anthropic", the Anthropic standard is auto-detected even without the standard field.

What's next

• Local inference — model registry and auto-quantization
• Providers overview — API standards and provider management