Skip to main content

​
Providers and models

Models are referenced as provider/model-id — for example openai/gpt-4o or anthropic/claude-3-5-sonnet-20241022. The gateway knows how to talk to each provider, so you use the same endpoint and auth regardless of which model you pick.

​
Auth schemes

Three schemes cover the full range of use cases. See Authentication for the full guide.

​
Prompts

Prompts are versioned templates stored in the dashboard. They define a model, system message, and variable placeholders. You run them by ID via /v1/prompts/:id/run, passing just the variable values. This separates prompt content from application code.

​
Org model settings

Each organisation can enable or disable specific models. The gateway checks the org’s settings before routing a request. Platform defaults come from the built-in model catalog — no DB lookup required at runtime.