A single step of work within a Lakeflow job. Which compute suits it and how it receives parameters depend on its type.
Read more: Databricks docs
In the Ultra Transcenders books
Each book explains Job task in context, with comparison tables and the common traps.
Terms in this definition
- Job
A sequence of steps executed together on one agent or runner, or on the server for agentless work. While running, each occupies one of your parallel jobs.
Related terms
- Notebook task
A job task whose work is a notebook. Under serverless compute it uses the base environment and dependencies set in that notebook unless told otherwise.
- Retry policy
Controls the number of retry attempts for a job task that fails and the interval between them. Pipelines handle retries of updates and flows by themselves.
- Task parameter
Defined on one job task as key-value pairs or a JSON array. Job parameters are pushed down to key-value tasks too; to change a static value you edit the task.