Export Netezza to AZ Blob Storage in JSON

Fast, parallel data export with zero intermediate storage

Terminal

.\FastBCP.exe `
--connectiontype "nzsql" `
--server "host.domain | host.domain,port | host.domain,port/service" `
--database "tpch" `
--trusted `
--sourceschema "tpch10" `
--sourcetable "orders" `
--query "SELECT * FROM tpch10.orders" `
--directory "abs://storageaccount.blob.core.windows.net/fastbcpoutput/raw/{sourcedatabase}/{sourceschema}" `
--fileoutput "{sourcetable}.json" `
--decimalseparator "." `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--method "Ntile" `
--distributekeycolumn "o_orderkey" `
--paralleldegree -2 `
--merge false `
--runid "runidfromcaller"

Get FastBCP

Source - Netezza

IBM Netezza is a high-performance data warehouse appliance. FastBCP integrates Netezza-specific optimizations.

Features:

•Full Netezza protocol support
•Optimized for appliance architectures
•Support for native parallel methods

Parallel Method - Ntile

Divides data into N equal partitions based on a numeric column.

Requirement: Requires a numeric distribution column

Available parallel methods with Netezza:

Output Format - JSON (JavaScript Object Notation)

JSON is the most widely used data exchange format on the web. FastBCP exports data to JSON Lines (NDJSON) format, with one record per line for efficient streaming.

Features:

•JSON Lines (NDJSON) format
•One record per line for streaming
•UTF-8 encoding
•Compatible with all JSON parsers

Destination - Azure Blob Storage

Azure Blob Storage is Microsoft's object storage solution. FastBCP uploads files to Azure containers with optimized block upload for maximum throughput.