OneLake Configuration

• 1 - In Entra : Create an application account in your tenant
• 2 - In Entra : Create a secret for this application
• 3 - In Entra : Grant the application on PowerBI Service in API Permission
• 4 - In Fabric : Give the Service principal created in step 1, the Admin Role in your workspace

in you shell set environment variables

Windows

$env:AZURE_TENANT_ID="YOUR_TENANT_ID"
$env:AZURE_CLIENT_ID="APPLICATION_ENTRA_ID"
$env:AZURE_CLIENT_SECRET="Your_AZCLient_Secret"

.\FastBCP.exe `
  --connectiontype "pgsql" `
  --server "localhost" `
  --port "5432" `
  --database "ecommerce" `
  --user "postgres" `
  --password "postgres" `
  --sourceschema "sales" `
  --sourcetable "orders" `
  --query "SELECT * FROM orders WHERE order_date between '2024-01-01' and '2024-12-31'" `
  --directory "onelakes://myworkspace/mylakehouse/{sourcedatabase}/{sourceschema}/{sourcetable}/year=2024/" `
  --fileoutput "orders_2024.parquet" `
  --parallelmethod "Ctid" `
  --paralleldegree 8 

Linux

export AZURE_TENANT_ID="YOUR_TENANT_ID"
export AZURE_CLIENT_ID="APPLICATION_ENTRA_ID"
export AZURE_CLIENT_SECRET="Your_AZCLient_Secret"

./FastBCP `
  --connectiontype "pgsql" \
  --server "localhost" \
  --port "5432" \
  --database "ecommerce" \
  --user "postgres" \
  --password "postgres" \
  --sourceschema "sales"\
  --sourcetable "orders" \
  --query "SELECT * FROM orders WHERE order_date between '2024-01-01' and '2024-12-31'" \
  --directory "onelakes://myworkspace/mylakehouse/{sourcedatabase}/{sourceschema}/{sourcetable}/year=2024/" \
  --fileoutput "orders_2024.parquet" \
  --parallelmethod "Ctid" \
  --paralleldegree 8