Skip to main content

SDK usage

You can keep your existing OpenAI SDK and only change the base URL and API key.

JavaScript​

import OpenAI from "openai";

const client = new OpenAI({
  apiKey: process.env.OPENAI_API_KEY,
  baseURL: "http://localhost:8080"
});

Python​

from openai import OpenAI

client = OpenAI(
    api_key="sk-your-key",
    base_url="http://localhost:8080"
)