Skip to main content
DocumentationDevelopers

Rate limits and concurrency

The requests-per-minute, concurrent-request and token-per-minute ceilings each plan enforces per API key at the Gateway.

Documentation menu

Every plan carries throughput ceilings that the Gateway enforces per API key: a request rate, a concurrency cap, and a token budget per minute counted on input and output separately. They bound instantaneous load; your plan’s monthly allowances still govern total usage.

Limits by plan

PlanRequests per minuteConcurrent requestsInput tokens per minuteOutput tokens per minute
Starter10052,000,0002,000,000
Business100152,000,0002,000,000
Advanced300456,000,0006,000,000

Enterprise agreements set their own ceilings as part of the contract.

When a limit is hit

A throttled request is rejected immediately with 429 — rate-limit-exceeded or, when the concurrent-request cap is reached, *-concurrency-exceeded. The Gateway does not queue over-limit traffic; back off briefly with jitter and retry, as covered in Errors and retries.

Explore the platform

Get your first API key

Registration is open. Four steps to your first call: create your account, create your organization, create your API key, and start using it.

  1. 01Create your account
  2. 02Create your organization
  3. 03Create your API key
  4. 04Start using it