Limits how many output tokens Foundation Model APIs will produce in 60 seconds. On admission, each request sets aside its max_tokens from this allowance, and a 429 error turns away any that wouldn't fit.
Also called output tokens per minute.
Read more: Databricks docs
In the Ultra Transcenders books
Each book explains OTPM in context, with comparison tables and the common traps.
Terms in this definition
- Foundation Model APIs
A service that lets you call Databricks-hosted foundation models with no deployment of your own to look after. A serving endpoint provides the access, and you can use modes like pay-per-token or provisioned throughput.
- MAX
Gives back the biggest value found in a column holding numbers, dates or text, or compares two expressions and returns the bigger. For TRUE/FALSE values, which this DAX aggregation doesn't accept, turn to MAXA.
Related terms
- ITPM
Caps how many input tokens a pay-per-token endpoint on Foundation Model APIs can process each 60 seconds, a limit set by the platform. A 429 comes back when it is passed, and where OTPM or QPH is tighter, that one governs instead.
- Platform limits
Ceilings on ITPM, OTPM and QPH (input and output tokens a minute, and queries an hour) built into pay-per-token Foundation Model APIs, where the tightest one wins. Any rate limits of your own are a different thing.