Queries per hour: a cap on how many requests can be made in an hour, which is among the limits Databricks sets on its pay-per-token model APIs.
Also called queries per hour.
Read more: Databricks docs
In the Ultra Transcenders books
Each book explains QPH in context, with comparison tables and the common traps.
Terms in this definition
- Databricks
Analytics platform built on Apache Spark where data is processed in notebooks; Unity Catalog is the governance model it recommends.
Related terms
- ITPM
Caps how many input tokens a pay-per-token endpoint on Foundation Model APIs can process each 60 seconds, a limit set by the platform. A 429 comes back when it is passed, and where OTPM or QPH is tighter, that one governs instead.
- Platform limits
Ceilings on ITPM, OTPM and QPH (input and output tokens a minute, and queries an hour) built into pay-per-token Foundation Model APIs, where the tightest one wins. Any rate limits of your own are a different thing.