The Java Virtual Machine hosting the Spark driver and executors. When tasks share a job cluster they use one driver JVM, so libraries already loaded and Scala singleton state persist from one task to the next.
Also called Java Virtual Machine.
Read more: Microsoft Learn
In the Ultra Transcenders books
Each book explains JVM in context, with comparison tables and the common traps.
Terms in this definition
- Share
In OpenSharing, the container you fill with tables, views, volumes, models and notebooks for recipients. You need
CREATE SHAREon the metastore to make one; add a schema and all its assets, including later ones, go with history. - Job
A sequence of steps executed together on one agent or runner, or on the server for agentless work. While running, each occupies one of your parallel jobs.
- State
A parameter in OAuth that carries custom data through the authorisation flow and back, as with the "Support state parameter" option in APIM.
- NEXT
Restricted to visual calculations, this DAX function reads the value one step further along an axis of the visual matrix; writing OFFSET with 1 gives the same result.
Related terms
- Native execution engine
A vectorised engine written in C++, based on Velox and Apache Gluten, that speeds up Fabric Spark by running supported operators natively, notably for Parquet, Delta and CSV. Anything it can't handle, such as JSON, XML or structured streaming, goes back to the JVM engine; you switch it on with spark.native.enabled.