Inference API overview

​

Base URL

https://inference.tokenchange.io/v1

​

Authentication

Authorization: Bearer ask_...

​

Use an OpenAI SDK

import os
from openai import OpenAI

client = OpenAI(
    base_url="https://inference.tokenchange.io/v1",
    api_key=os.environ["TOKENCHANGE_API_KEY"],
)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://inference.tokenchange.io/v1",
  apiKey: process.env.TOKENCHANGE_API_KEY,
});

​

Differences from the OpenAI API

• Streaming only. Completion requests must set "stream": true. Requests without it, or with "stream": false, fail with 400.
• Models are catalog slugs. Pass a slug from the catalog, or pin an endpoint with <model-slug>/ep/<endpoint>.
• Price options. An optional provider object filters and orders endpoints by price. See Price options.
• Fields are passed through. Other request fields, such as tools, response_format or top_p, go to the endpoint unchanged. Whether they’re honored depends on the endpoint; check its capabilities.
• Request size. Request bodies can be up to 32 MiB.

​

Errors

{
  "error": {
    "message": "Invalid API key",
    "type": "invalid_request_error",
    "code": "invalid_api_key"
  }
}