A Dataflow Gen2 setting that hands large loads to the Copy activity engine used by pipelines, for instance CSV or Parquet files of at least 100 MB, or database sources of 5 million rows or more. With Require fast copy, the refresh fails rather than reverting to the normal engine.
Read more: Microsoft Learn
In the Ultra Transcenders books
Each book explains Fast copy in context, with comparison tables and the common traps.
Terms in this definition
- Dataflow Gen2
A visual, low-code Microsoft Fabric item for preparing data, based on Power Query. It links to data sources, transforms the data and writes the output to targets like a lakehouse or a warehouse.
- Copy activity
Activity in a Data Factory pipeline that moves data from one store to another.
- Cluster Shared Volumes
Shared failover cluster storage that all nodes write to simultaneously, typically for Scale-Out File Server or Hyper-V. On SAN-backed storage, ReFS-formatted volumes work in redirected mode.
- Parquet
Columnar file format, open source and aimed at analytics. Event Hubs Capture cannot produce it natively.
- LEAST
Pass up to 254 expressions to this T-SQL function and it hands back whichever is smallest. Both Fabric Warehouse and SQL analytics endpoints support it.
- Schema
The middle part of a Unity Catalog name (
catalog.schema.table), grouping tables, views, volumes, functions and models inside a catalog. A grant on it covers everything in it now and later, and nothing inside can be reached withoutUSE SCHEMA.