Export ODBC to Local Files in Parquet
Fast, parallel data export with zero intermediate storage
Terminal
.\FastBCP.exe `
--connectiontype "odbc" `
--dsn "DSN_4_DATASOURCE" `
--database "tpch" `
--trusted `
--sourceschema "tpch10" `
--sourcetable "orders" `
--query "SELECT * FROM tpch10.orders" `
--directory "D:\Data\fastbcpexport\raw\{sourcedatabase}\{sourceschema}" `
--fileoutput "{sourcetable}.parquet" `
--method "Ntile" `
--distributekeycolumn "o_orderkey" `
--paralleldegree -2 `
--merge false `
--runid "runidfromcaller"Source - ODBC
ODBC (Open Database Connectivity) allows connection to virtually any database. FastBCP supports ODBC connections for maximum compatibility.
Features:
- •Compatible with any database supporting ODBC
- •Maximum flexibility
- •Standard ODBC driver support
Parallel Method - Ntile
Divides data into N equal partitions based on a numeric column.
Requirement: Requires a numeric distribution column
Available parallel methods with ODBC:
Output Format - Apache Parquet
Parquet is a columnar file format optimized for analytical processing. FastBCP exports to Parquet with compression and type preservation, ideal for data lake architectures.
Features:
- •Columnar storage for efficient analytics
- •Integrated compression (Snappy, Gzip)
- •Full data type preservation
- •Optimized for big data tools (Spark, Hadoop)
Destination - Local File System
FastBCP exports data directly to the local file system, ideal for on-premise processing, testing, or archiving.
Storage Type:
Local Disk
Features:
- •Direct write to local storage
- •No network overhead
- •Flexible path configuration
- •Perfect for development and testing
