Export Netezza to S3 Compatible in JSON
Fast, parallel data export with zero intermediate storage
Terminal
.\FastBCP.exe `
--connectiontype "nzsql" `
--server "host.domain | host.domain,port | host.domain,port/service" `
--database "tpch" `
--trusted `
--sourceschema "tpch10" `
--sourcetable "orders" `
--query "SELECT * FROM tpch10.orders" `
--directory "s3://rootbucket/fastbcpexport/raw/{sourcedatabase}/{sourceschema}" `
--fileoutput "{sourcetable}.json" `
--decimalseparator "." `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--method "Ntile" `
--distributekeycolumn "o_orderkey" `
--paralleldegree -2 `
--merge false `
--runid "runidfromcaller"Source - Netezza
IBM Netezza is a high-performance data warehouse appliance. FastBCP integrates Netezza-specific optimizations.
Features:
- •Full Netezza protocol support
- •Optimized for appliance architectures
- •Support for native parallel methods
Parallel Method - Ntile
Divides data into N equal partitions based on a numeric column.
Requirement: Requires a numeric distribution column
Available parallel methods with Netezza:
Output Format - JSON (JavaScript Object Notation)
JSON is the most widely used data exchange format on the web. FastBCP exports data to JSON Lines (NDJSON) format, with one record per line for efficient streaming.
Features:
- •JSON Lines (NDJSON) format
- •One record per line for streaming
- •UTF-8 encoding
- •Compatible with all JSON parsers
Destination - S3 Compatible Storage
FastBCP supports S3-compatible storage services like MinIO, Wasabi, and others with the same high-performance multipart upload capabilities.
Storage Type:
Cloud Object Storage
Features:
- •S3 API compatibility
- •Parallel multipart upload
- •Custom endpoint configuration
- •Works with MinIO, Wasabi, etc.
