Blackbox

What it does

Secure, private, fast inference platform offering dedicated deployments of open-weight models or access to 300+ models through one endpoint with end-to-end encryption.

Straight answers

Is it compatible without code changes?

Yes. Change the baseURL and apiKey on the official OpenAI SDK, and existing requests, parsing, and tooling keep working. Streaming uses the same stream: true flag.

What happens when traffic increases quickly?

Endpoints autoscale across the fleet and route to warm GPU capacity. Bursts return 503 only while capacity scales. Retry with backoff, and the request completes.

How does the commit work?

You commit to a token volume through a purchase order, and the balance decreases as your teams consume it, metered at the published per-model rates. Commits are sized so that a director or VP can sign without an approval chain, and then expand. You can watch the balance in real time in the dashboard, and intelligent routing and prompt caching extend the same commit 10–20%, even on closed models.

Is there a platform fee?

No. There is no credit-purchase fee and no per-seat charge. You pay for tokens at or below the list rates.

What does the commit cover?

Every surface uses the same balance: Enterprise Inference, the Blackbox Router, the API, the CLI, and the Agents API. Metering is per token, not per seat, and the contract specifies how seats are treated.