Export SQL Server to AZ Blob Storage in CSV

    Fast, parallel data export with zero intermediate storage

    Terminal
    .\FastBCP.exe `
    --connectiontype "mssql" `
    --server "host.domain | host.domain,port | host.domain,port/service" `
    --database "tpch" `
    --trusted `
    --sourceschema "tpch10" `
    --sourcetable "orders" `
    --query "SELECT * FROM tpch10.orders" `
    --directory "abs://storageaccount.blob.core.windows.net/fastbcpoutput/raw/{sourcedatabase}/{sourceschema}" `
    --fileoutput "{sourcetable}.csv" `
    --decimalseparator "." `
    --delimiter "|" `
    --dateformat "yyyy-MM-dd HH:mm:ss" `
    --encoding "UTF-8" `
    --method "Ntile" `
    --distributekeycolumn "o_orderkey" `
    --paralleldegree -2 `
    --merge false `
    --runid "runidfromcaller"
    Get FastBCP

    Source - SQL Server

    Microsoft SQL Server is a leading enterprise data platform. FastBCP uses advanced techniques to extract SQL Server data with maximum efficiency.

    Features:

    • Native SQL Server driver
    • Support for SQL Server-specific data types
    • Optimized for Windows and Linux environments

    Parallel Method - Ntile

    Divides data into N equal partitions based on a numeric column.

    Requirement: Requires a numeric distribution column

    Available parallel methods with SQL Server:

    Output Format - CSV (Comma-Separated Values)

    CSV is the universal standard for tabular data exchange. FastBCP exports data to CSV format with configurable delimiters, encoding, and date formats for maximum compatibility.

    Features:

    • Configurable delimiters and separators
    • Multiple encoding support (UTF-8, ASCII, etc.)
    • Custom date and decimal formats
    • Header row support

    Destination - Azure Blob Storage

    Azure Blob Storage is Microsoft's object storage solution. FastBCP uploads files to Azure containers with optimized block upload for maximum throughput.

    Storage Type:

    Cloud Object Storage

    Features:

    • Optimized block upload
    • Managed Identity support
    • Container and path configuration
    • Hot, Cool, and Archive tiers