Placed before a source in a query, as in STREAM read_files(...), this keyword tells SQL to process it as a stream, which is how streaming tables get loaded bit by bit.
Read more: Databricks docs
In the Ultra Transcenders books
Each book explains STREAM in context, with comparison tables and the common traps.
Terms in this definition
- READ FILES
Granted on a storage credential or external location, this Unity Catalog permission lets tools like Auto Loader or
COPY INTOpull files directly from cloud storage.WRITE FILEScan't be used without it. - Serverless
Compute tier for single Azure SQL databases that scales automatically, pauses when idle and charges by the second. It is offered in General Purpose and Hyperscale, not Business Critical, and reserved capacity does not apply.
- Streaming
Sending model output piece by piece as server-sent events. Only the delivery changes; the answer's content, completeness and cost stay the same.
- Get
Key Vault permission on secrets that allows a single secret to be read; App Service Key Vault references need nothing beyond it.
Related terms
- Apache Spark pool
Spark compute in Azure Synapse used to build and update Delta Lake tables, run machine learning and stream changes from the Cosmos DB change feed.
- Asynchronous checkpointing
Lets a stateful stream begin its next micro-batch before the state checkpoint has completed, which lowers latency and preserves exactly-once guarantees. If an asynchronous checkpoint fails for any reason, the query fails too.
- AudioOutputConfig
Speech SDK class choosing a single destination for synthesised speech: a file, a named device, a custom output stream or the default speaker.
- AudioStreamFormat
Speech SDK class describing how an audio stream is encoded, namely channels, bits and sample rate. It does not act as an output destination.
- Azure DevOps auditing
Records configuration and security changes across an organisation for 90 days. Export or view it on the Auditing page, or stream it to Event Grid, Splunk or Azure Monitor Logs.
- Backlogged Input Events
Stream Analytics metric showing how many received input events are still waiting to be processed. If it never drops back to zero, the job is falling behind and should be given more streaming units.
- CDF
Change data feed. When switched on for a Delta table it records which rows changed from version to version, exposing extra columns that give the kind of change and the commit version. You can query it with
table_changes(), stream from it, or feed it toAUTO CDC. - Compute log delivery
A compute setting under Advanced > Logging that copies logs from the driver, the workers and the event stream to a chosen destination every five minutes for as long as the compute runs. A Unity Catalog volume is the preferred destination; DBFS also works.