Skip to main content
ParameterSample ValueDescription
jdbc_url
required
jdbc:postgresql://<DB_URL>:5432/icebergJDBC connection string for the catalog database. Replace <DB_URL> with your database host or use host.docker.internal for local Docker containers.
jdbc_username
required
icebergDatabase username for JDBC catalog authentication.
jdbc_password
required
passwordDatabase password for JDBC catalog authentication.
iceberg_s3_path
required
s3://warehouseS3 bucket path where Iceberg table data and metadata files will be stored.
aws_region
required
us-east-1AWS Region where your S3 bucket exist. Required so OLake Go calls the correct regional S3 endpoints.
catalog_nameolake_icebergName of the Iceberg catalog OLake Go registers tables under. Defaults to olake_iceberg if left empty.
s3_endpointhttps://glue.ap-south-1.amazonaws.comS3 API endpoint for writing Iceberg data files. Optional for AWS S3 but required for S3-compatible storage like MinIO.
s3_use_sslfalse/trueControls whether OLake Go uses HTTPS when connecting to the S3 API for writing Iceberg files. Set to false when S3 Endpoint uses http:// (for example, local MinIO). Set to true when the endpoint uses https:// (for example, AWS S3 or TLS-enabled MinIO).
s3_path_stylefalse/trueControls how OLake Go formats S3 request URLs. Path-style puts the bucket name in the URL path instead of the hostname. This is required for MinIO and other S3-compatible storage that do not support AWS-style virtual-hosted URLs.
aws_access_keyXXXAWS access key ID for authentication. Optional if using IAM roles or instance profiles.

If using IAM:
Docker Compose: add the required IAM environment variables under x-envs in your compose file. See Service Environment Variables for setup details.
Kubernetes: set up pod IAM in Cloud IAM Integration.
aws_secret_keyXXXAWS secret access key for authentication. Optional if using IAM roles or instance profiles.

If using IAM:
Docker Compose: add the required IAM environment variables under x-envs in your compose file. See Service Environment Variables for setup details.
Kubernetes: set up pod IAM in Cloud IAM Integration.
arrow_writesfalse/trueWrites data and delete files using Apache Arrow based writer and registers them in Iceberg.


💡 Join the OLake Community!

Got questions, ideas, or just want to connect with other data engineers?
👉 Join our Slack Community to get real-time support, share feedback, and shape the future of OLake together. 🚀

Your success with OLake is our priority. Don’t hesitate to contact us if you need any help or further clarification!