Drafted descriptions for Unity Catalog objects and their columns, which Catalog Explorer produces by reading metadata. Someone should check each one before accepting it, and it is not a dependable way of spotting PII.
Also called AI-generated documentation.
Read more: Microsoft Learn
In the Ultra Transcenders books
Each book explains AI-generated comments in context, with comparison tables and the common traps.
Terms in this definition
- Unity Catalog
Azure Databricks' governance solution covering both data and AI in one place, with centralised permissions, auditing, data discovery and lineage.
- Catalog Explorer
Opened from Catalog in the sidebar, this is where you browse and administer Unity Catalog objects, their permissions and lineage, and their tags and comments.
- Metadata
Describes data rather than being the data itself, for instance how a file is laid out or what rows each chunk contains, so tools can read things efficiently.
- PII
Data that can identify someone, such as their name, email address or national ID number. Unity Catalog can find and label it automatically through Data Classification.