A SQL clause, available from Databricks Runtime 10.4 LTS, that filters rows by a window function's result with no subquery needed, such as retaining only ROW_NUMBER() = 1 for each key.
Read more: Microsoft Learn
In the Ultra Transcenders books
Each book explains QUALIFY in context, with comparison tables and the common traps.
Terms in this definition
- Serverless
Compute tier for single Azure SQL databases that scales automatically, pauses when idle and charges by the second. It is offered in General Purpose and Hyperscale, not Business Critical, and reserved capacity does not apply.
- Databricks Runtime
The software image, Apache Spark among its core parts, that Azure Databricks installs on compute. Long-term support (LTS) releases are the advised choice when job compute runs production work.
- LTS
Applies to some Databricks Runtime versions, which Learn recommends for job compute in production. Feature work on such a version stops after about six months, and for three years afterwards it gets security and stability fixes backported.
- Window function
A function evaluated OVER a window defined by PARTITION BY, ORDER BY and optionally a frame; unlike GROUP BY aggregation it doesn't collapse rows, but adds to each one a value worked out from its related rows. Examples are RANK, ROW_NUMBER, LAG and running totals.
- Index field attributes
Settings applied to each field in an Azure AI Search index:
searchablefor full text,retrievableto return it,filterablefor exact-match$filter,sortable,facetablefor counts, andkeyfor the unique document ID.
Related terms
- Point read
Retrieving one Cosmos DB item straight from its partition key and id via the REST API or an SDK. It is the lowest-cost read, around 1 RU per 1 KB, and a query with an id filter doesn't qualify.
- Require Microsoft Entra hybrid joined device
Only met by Windows machines that belong to the on-premises domain and are hybrid joined as well. An Edge InPrivate window doesn't qualify.
- Trusted workspace access
Firewalled ADLS Gen2 or Blob Storage becomes reachable, via resource instance rules, from workspaces holding a workspace identity, whether through shortcuts, pipelines, COPY INTO, AzCopy or Import semantic models. Only paid F SKUs qualify; trials don't.