Books that cover data engineering
Ultra Transcenders DP-750: Implementing Data Engineering Solutions Using Azure Databricks
Know how to build, secure and run Azure Databricks pipelines, and why each setting matters.
Ingesting, modelling, validating and orchestrating data on Azure Databricks: Delta tables, Lakeflow pipelines and jobs, and keeping them fast and governed.
Sections from the books on data engineering, free to read:
How the two retention properties and VACUUM decide which table versions you can still query or restore. DP-750
SCD types 0, 1, 2 and others compared, and when to keep history in a dimension table. DP-750
The table-size thresholds for partitioning, partition sizing, and why liquid clustering is usually the better choice. DP-750
How expectations validate records in Lakeflow Spark Declarative Pipelines and what each violation action does. DP-750
Job and task notifications, system destinations, duration warnings and how retries affect which alerts are sent. DP-750
Search the series glossary for Delta, or browse all 4,053 terms.
Know how to build, secure and run Azure Databricks pipelines, and why each setting matters.