Open source software: for example, the community editions of Apache Spark or Delta Lake, as distinct from the Databricks builds.
Also called open source software.
In the Ultra Transcenders books
Each book explains OSS in context, with comparison tables and the common traps.
Terms in this definition
- Apache Spark
An open-source engine that spreads data processing over a cluster of machines so that big data sets are handled in parallel, in batches or as streams. In Azure you can use it through Microsoft Fabric or Azure Databricks.
- Delta Lake
Table format adding transactions to files in the data lake. In Synapse, Spark pools can write these tables, while serverless SQL pools can only query them.
- DISTINCT
Removes duplicates so that each row appears once; it can be used in a
SELECT, an aggregate or a set operation. - Databricks
Analytics platform built on Apache Spark where data is processed in notebooks; Unity Catalog is the governance model it recommends.
Related terms
- Clustering policy
A choice made when creating Azure Managed Redis (OSS, Enterprise or Non-clustered) that controls how clients see its shards. RediSearch works with Enterprise or Non-clustered, not OSS, and an OSS or Enterprise choice is permanent.
- RediSearch
A Redis module for Azure Managed Redis that provides secondary indexes plus full-text and vector search. It can only be turned on when the cache is created and works with Enterprise or Non-clustered clustering, not OSS.