Short for Resilient Distributed Dataset, the older low-level Spark interface for working with distributed collections. Serverless compute and standard access mode don't allow it, so code relying on RDDs needs dedicated compute.
Also called Resilient Distributed Dataset.
Read more: Microsoft Learn
In the Ultra Transcenders books
Each book explains RDD in context, with comparison tables and the common traps.
Terms in this definition
- Serverless compute
Azure Machine Learning compute provided on demand whenever a job names no compute target. No cluster needs creating or managing, and jobs do not wait in a queue behind one another.
- Standard access mode
An access mode for classic compute in which multiple users can share a cluster and run work at once, kept apart by Lakeguard and governed by Unity Catalog. It is the recommended mode unless a needed feature isn't supported.
- Dedicated
Running Azure Functions on an App Service plan, which removes the execution time limit and offers VNet integration on Basic and higher tiers.
Related terms
- Dedicated access mode
Assigns classic compute to one person or one group. Some capabilities work only in this mode, among them R, the RDD API, GPU instances and the ML flavour of Databricks Runtime.