Export PostgreSQL to AZ Blob Storage in XLSX

Fast, parallel data export with zero intermediate storage

Terminal

.\FastBCP.exe `
--connectiontype "pgsql" `
--server "host.domain | host.domain,port | host.domain,port/service" `
--database "tpch" `
--trusted `
--sourceschema "tpch10" `
--sourcetable "orders" `
--query "SELECT * FROM tpch10.orders" `
--directory "abs://storageaccount.blob.core.windows.net/fastbcpoutput/raw/{sourcedatabase}/{sourceschema}" `
--fileoutput "{sourcetable}.xlsx" `
--decimalseparator "." `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--method "Ntile" `
--distributekeycolumn "o_orderkey" `
--paralleldegree -2 `
--merge false `
--runid "runidfromcaller"

Get FastBCP

Source - PostgreSQL

PostgreSQL is a powerful and robust open-source relational database. FastBCP optimizes exports from PostgreSQL using its native connector for excellent performance.

Features:

•Direct streaming read from database
•Full support for PostgreSQL data types
•Secure SSL connections

Parallel Method - Ntile

Divides data into N equal partitions based on a numeric column.

Requirement: Requires a numeric distribution column

Available parallel methods with PostgreSQL:

Output Format - Excel (XLSX)

The Excel XLSX format is ubiquitous in enterprise environments. FastBCP exports directly to Excel format, ready to open in Microsoft Excel or compatible tools.

Features:

•Native Excel format (Office Open XML)
•Automatic column headers
•Data type formatting (numbers, dates)
•Ready for business reporting

Destination - Azure Blob Storage

Azure Blob Storage is Microsoft's object storage solution. FastBCP uploads files to Azure containers with optimized block upload for maximum throughput.