AI Functions that Databricks builds and maintains for a single purpose, for instance classification or parsing documents. For general-purpose work there is ai_query.
Read more: Databricks docs
In the Ultra Transcenders books
Each book explains Task-specific AI Functions in context, with comparison tables and the common traps.
Terms in this definition
- AI Functions
Classic SQL warehouses aside, these built-in functions let SQL, notebooks and pipelines apply LLMs and research techniques to data.
ai_queryhandles general use, while task-specific ones likeai_classifywork without a prompt. - Databricks
Analytics platform built on Apache Spark where data is processed in notebooks; Unity Catalog is the governance model it recommends.
- Classification
Predictive, supervised learning that assigns an item to one of a set of categories, for instance deciding whether an email is spam; it isn't generative.
Related terms
- AI Functions Unity Catalog permissions
Gives metastore admins the ability to grant or block task-specific AI Functions held in the
system.aischema. It is Generally Available, but the account team has to switch it on, and Runtime 17.3 LTS or later is required.