Export SAP HANA to GCS in BSON

    Fast, parallel data export with zero intermediate storage

    Terminal
    .\FastBCP.exe `
    --connectiontype "hana" `
    --server "host.domain | host.domain,port | host.domain,port/service" `
    --database "tpch" `
    --trusted `
    --sourceschema "tpch10" `
    --sourcetable "orders" `
    --query "SELECT * FROM tpch10.orders" `
    --directory "gs://rootbucket/fastbcpexport/raw/{sourcedatabase}/{sourceschema}" `
    --fileoutput "{sourcetable}.bson" `
    --method "Ntile" `
    --distributekeycolumn "o_orderkey" `
    --paralleldegree -2 `
    --merge false `
    --runid "runidfromcaller"
    Get FastBCP

    Source - SAP HANA

    SAP HANA is a high-performance in-memory database platform. FastBCP optimizes exports from HANA to leverage its capabilities.

    Features:

    • Native SAP HANA connector
    • Support for views and columnar tables
    • Optimized for in-memory data

    Parallel Method - Ntile

    Divides data into N equal partitions based on a numeric column.

    Requirement: Requires a numeric distribution column

    Available parallel methods with SAP HANA:

    Output Format - BSON (Binary JSON)

    BSON is a binary-encoded serialization format, primarily used by MongoDB. FastBCP exports to BSON format for efficient integration with MongoDB ecosystems.

    Features:

    • Binary encoding for compact storage
    • MongoDB native format
    • Data type preservation
    • Efficient for document databases

    Destination - Google Cloud Storage

    Google Cloud Storage provides unified object storage. FastBCP uploads files to GCS buckets with parallel chunked uploads for fast transfers.

    Storage Type:

    Cloud Object Storage

    Features:

    • Parallel chunked upload
    • Service account authentication
    • Bucket and prefix configuration
    • Multi-regional storage classes