An Auto Loader setting that pins the types of particular columns, using SQL schema syntax such as id long, amount double, while the rest of the schema is still inferred. Hints may also declare columns that haven't appeared yet.
Also called cloudFiles.schemaHints.
Read more: Microsoft Learn
In the Ultra Transcenders books
Each book explains Schema hints in context, with comparison tables and the common traps.
Terms in this definition
- Auto Loader
The
cloudFilesStructured Streaming source, which picks up new files from cloud storage or volumes as they arrive. Its checkpoint records progress so each file is processed exactly once, and it can infer and evolve the schema. - Serverless
Compute tier for single Azure SQL databases that scales automatically, pauses when idle and charges by the second. It is offered in General Purpose and Hyperscale, not Business Critical, and reserved capacity does not apply.
- Schema
The middle part of a Unity Catalog name (
catalog.schema.table), grouping tables, views, volumes, functions and models inside a catalog. A grant on it covers everything in it now and later, and nothing inside can be reached withoutUSE SCHEMA. - DOUBLE
An 8-byte floating-point type with double precision. A materialized view that sums or averages one may need a full refresh, which casting to
DECIMALavoids. - REST
Short for representational state transfer, the style of HTTP API that Azure services expose.