Integrations
The Ferro Labs AI Gateway fits into your existing toolchain. Use a native SDK for typed access, point any OpenAI-compatible client at the gateway with a single base-URL change, deploy to your favorite cloud platform, or connect any of 29 supported AI providers.
SDKs
Python SDK (ferrolabsai)
The official Python SDK provides typed clients, streaming helpers, async support, and full admin API access.
- Quickstart — Install and send your first request
- API Reference — Complete method and type reference
- Async Usage —
AsyncFerroClientand async streaming - Error Handling — Exception hierarchy and retry behavior
pip install ferrolabsai
Go SDK
The community Go SDK offers idiomatic bindings for chat completions, embeddings, and gateway administration.
OpenAI-Compatible SDKs
Any OpenAI-compatible SDK works with zero code changes — just set the base URL to your gateway endpoint.
Covers: TypeScript/JavaScript, Python (openai), Go, curl, LangChain, and LlamaIndex.
If your framework already uses the OpenAI SDK, switching to Ferro Labs is a one-line config change.
Frameworks
All major AI frameworks work through the gateway via the OpenAI-compatible API. See the OpenAI-compatible SDKs guide for ready-to-use code snippets.
| Framework | Status | Integration |
|---|---|---|
| LangChain | Supported | Set openai_api_base to your gateway URL |
| LlamaIndex | Supported | Set api_base to your gateway URL |
| Vercel AI SDK | Supported | Set baseURL to your gateway URL |
Framework-specific guides with end-to-end examples are coming soon. In the meantime, the OpenAI-compatible guide covers LangChain, LlamaIndex, and standard SDK usage.
Deployment
One-click deploys and production-ready configurations for every major platform:
| Platform | Type | Guide |
|---|---|---|
| Railway | One-click (SQLite or PostgreSQL) | Deploy to Railway |
| Render | One-click (PostgreSQL) | Deploy to Render |
| Docker Compose | Self-hosted | Docker Compose guide |
| Kubernetes | Helm chart | Kubernetes guide |
| Fly.io | Cloud | Deploy to Fly.io |
Providers
The gateway supports 29 AI providers out of the box, including OpenAI, Anthropic, Google, Mistral, Cohere, and more. No vendor lock-in — switch between providers by changing a single route configuration.
- Providers overview — Full list of supported providers
- Provider configuration — Environment variables and setup