A Spark data source that reads every file as a single record containing its metadata and raw bytes. Images, audio and PDFs are typical uses.
Also called binary file data source.
Read more: Databricks docs
In the Ultra Transcenders books
Each book explains binaryFile in context, with comparison tables and the common traps.
Terms in this definition
- Data source
Compliance benchmarks and analytics only cover systems added as data sources, which VCF Operations for networks (or VCF Operations via an integration) then collects from. Examples are physical switches, NSX Manager, vCenter, and flow exporters: the NSX distributed firewall with IPFIX and distributed switches with NetFlow.
- Metadata
Describes data rather than being the data itself, for instance how a file is laid out or what rows each chunk contains, so tools can read things efficiently.
Related terms
- PDF
Portable Document Format, a file type with a fixed layout. Databricks can load these files with the
binaryFilesource and extract their contents usingai_parse_document.