Export SAP HANA to GCS in JSON

Fast, parallel data export with zero intermediate storage

Terminal

.\FastBCP.exe `
--connectiontype "hana" `
--server "host.domain | host.domain,port | host.domain,port/service" `
--database "tpch" `
--trusted `
--sourceschema "tpch10" `
--sourcetable "orders" `
--query "SELECT * FROM tpch10.orders" `
--directory "gs://rootbucket/fastbcpexport/raw/{sourcedatabase}/{sourceschema}" `
--fileoutput "{sourcetable}.json" `
--decimalseparator "." `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--method "Ntile" `
--distributekeycolumn "o_orderkey" `
--paralleldegree -2 `
--merge false `
--runid "runidfromcaller"

Get FastBCP

Source - SAP HANA

SAP HANA is a high-performance in-memory database platform. FastBCP optimizes exports from HANA to leverage its capabilities.

Features:

•Native SAP HANA connector
•Support for views and columnar tables
•Optimized for in-memory data

Parallel Method - Ntile

Divides data into N equal partitions based on a numeric column.

Requirement: Requires a numeric distribution column

Available parallel methods with SAP HANA:

Output Format - JSON (JavaScript Object Notation)

JSON is the most widely used data exchange format on the web. FastBCP exports data to JSON Lines (NDJSON) format, with one record per line for efficient streaming.