Export SQL Server to OneLake in JSON
Fast, parallel data export with zero intermediate storage
Terminal
.\FastBCP.exe `
--connectiontype "mssql" `
--server "host.domain | host.domain,port | host.domain,port/service" `
--database "tpch" `
--trusted `
--sourceschema "tpch10" `
--sourcetable "orders" `
--query "SELECT * FROM tpch10.orders" `
--directory "onelake://workspace/lakehouse/fastbcpexports/raw/{sourcedatabase}/{sourceschema}" `
--fileoutput "{sourcetable}.json" `
--decimalseparator "." `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--method "Ntile" `
--distributekeycolumn "o_orderkey" `
--paralleldegree -2 `
--merge false `
--runid "runidfromcaller"Source - SQL Server
Microsoft SQL Server is a leading enterprise data platform. FastBCP uses advanced techniques to extract SQL Server data with maximum efficiency.
Features:
- •Native SQL Server driver
- •Support for SQL Server-specific data types
- •Optimized for Windows and Linux environments
Parallel Method - Ntile
Divides data into N equal partitions based on a numeric column.
Requirement: Requires a numeric distribution column
Available parallel methods with SQL Server:
Output Format - JSON (JavaScript Object Notation)
JSON is the most widely used data exchange format on the web. FastBCP exports data to JSON Lines (NDJSON) format, with one record per line for efficient streaming.
Features:
- •JSON Lines (NDJSON) format
- •One record per line for streaming
- •UTF-8 encoding
- •Compatible with all JSON parsers
Destination - Microsoft OneLake
OneLake is Microsoft Fabric's unified data lake. FastBCP exports data directly to OneLake workspaces, enabling seamless integration with Fabric analytics services.
Storage Type:
Unified Data Lake
Features:
- •Direct integration with Microsoft Fabric
- •Workspace and lakehouse support
- •Built on Delta Lake format
- •Unified analytics and governance
