Export Teradata to AWS S3 in JSON

Fast, parallel data export with zero intermediate storage

Terminal

.\FastBCP.exe `
--connectiontype "teradata" `
--server "host.domain | host.domain,port | host.domain,port/service" `
--database "tpch" `
--trusted `
--sourceschema "tpch10" `
--sourcetable "orders" `
--query "SELECT * FROM tpch10.orders" `
--directory "s3://rootbucket/fastbcpexport/raw/{sourcedatabase}/{sourceschema}" `
--fileoutput "{sourcetable}.json" `
--decimalseparator "." `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--method "Ntile" `
--distributekeycolumn "o_orderkey" `
--paralleldegree -2 `
--merge false `
--runid "runidfromcaller"

Get FastBCP

Source - Teradata

Teradata is an enterprise data warehouse platform. FastBCP ensures optimized exports for Teradata environments.

Features:

•Native Teradata protocol support
•Optimized for massively parallel architectures
•Compatible with on-premise and cloud environments

Parallel Method - Ntile

Divides data into N equal partitions based on a numeric column.

Requirement: Requires a numeric distribution column

Available parallel methods with Teradata:

Output Format - JSON (JavaScript Object Notation)

JSON is the most widely used data exchange format on the web. FastBCP exports data to JSON Lines (NDJSON) format, with one record per line for efficient streaming.

Features:

•JSON Lines (NDJSON) format
•One record per line for streaming
•UTF-8 encoding
•Compatible with all JSON parsers

Destination - Amazon S3

Amazon S3 is the industry-leading object storage service. FastBCP uploads exported files directly to S3 buckets with parallel multipart uploads for optimal performance.