A
Arbiter

Step 1 of 5 ยท What it is

A router, not a model

Arbiter is a drop-in OpenAI-compatible endpoint. You change one base URL and keep your code. For every request it picks the cheapest model that still gets the job right, on the BTL runtime.

client = OpenAI(base_url=".../v1", api_key="ignored")

The model you pass is ignored - choosing it is Arbiter's whole job.